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SuiA/cy Paper 

Some Aspects of Parallel and Distributed 
Iterative Algorithms—A Survey*t 

DIMITRI P BKRTSEKASt^ and JOHN N ISri^lKLISi 

Iterative fnethods suitable for use in parallel and distributed fomputinf* 
systems are surveyed. Both .vv7ir/trrmr>i4.v and asvnchronotds tmplementa- 
tiorvi are discussed. A number of theoretical issues rri^’unimjk; the iHilidiiv 
asynchronous algorithms are addressed 
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priX-cssing; asynchninous al^diithms, pzirulk'l algonihrns, dislnhutcd al|j:oiilhin.v 


AlMfracI—Wc cfifiJiidcr iicrativc algorithms of ihc form 
1 -"/|r). executed by a par'allci or disinhuu'i) compuun^' 
svs'cm Wc first consider synchmiuiiis executions t'l such 
ileraiion.s and study their comrnunkaiion requirenvents, as 
well as ivsucs relulcd In processor synchroni/aiion We also 
discuss ihf paralleli/.ahon of iieralions of the (lauss Seiuel 
lv]x: We then consider asynchronous implemenlations 
whereby each priKCssor iieruies on a diflcrcni component ol 
I. ill Its own pace, using ihc rmrsi rrccnlly received (bui 
p^wisihlN ouldated) uiformalion on Ihc remaining com[>oncnis 
of I While certain algonlhms mav lail to conveigc when 
irriplemenled asynchronously, u large number of positive 
convergence results is asailabic We classify asviuhromms 
algorithms into three main categories, depending on the 
amouni ol asynchronism ihev can lolcraic unil survey ihe 
corresponding convergence rcsulis We also discuss issues 
reliiicd lo iheir Icrminaiion 

1 INIKODICIIDN 

F*akai I 1,1 AND DisiKMu II D Computing sysiems have 
received broad atfention motivated hv severiil 
different lypes of applicalion.s Roughly sfKakmg. 
parallel computing systems consist of several lighll> 
coupled prtK'cssors that arc located within a small 
distance of each other Their mam purpose is to 
execute jointly a computational task and they have 
been designed with such a purpose in mind 
communication between jinrccssors is last and 
reliable. Distrihuied computing systems are somewhat 
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different in a numfH*r of icsfKcts Pnvccssors are 
loosely coupled with litllc, if any. central ciHudiiuilion 
and C(>nirol. and inicipnxcs.soi coniniiinication is 
more problematic, C'ommunication delays can Ik 
unpn.dtclabic. and the conummicatioii links them 
selves can Ih‘ unreliable Tinany, while the aichitcc 
lure of a parallel system is usually chovirn with a 
particular stM of computational l.tsvs in rniruL the 
structure ol distiibiited systems is idten dictated by 
exogenous cimsiilciaiions Nevcilhclcss. Ihcre aie 
several algorithmic issues that arise in both parallel 
and distnhuied systems and that can Ih’ addressed 
jointly lo avoid re|>etilion. we will mostly enrploy in 
the scc|ucl the term ‘ distributedbut it should be 
kept in mind that most of the discussion ajrjilies lo 
parallel systems was well 

There are at least two eonlexis where distnhuied 
computation has played ii signhcanf role The first is 
Ihe context of inlormation aiijuisiiHin, information 
extraction, and lunliol, within spatially distnhuied 
systems. An example is a sciisor netwoik in which a 
set of geographically dislnhutcd sensors obtain 
information on the stale of the environment and 
pnxfss It conjH'ratively. Another example is provided 
hy data cnmmuniciiiion networks in which certain 
functions of Ihe network (such as corfecl and timely 
routing of messages) have to he contiolled in a 
distnbuied mannci, through the coopeialioii of the 
computers residing at the nodes of the network Other 
applications arc jKissihle in the qiiasistalic decenlral* 
i/.ed control of large scale systems whereby ceilain 
parameters (e g operating jHimts for each subsystem) 
are to be opiimi/cd locally. while taking mio accounl 
mtcraciions with neighboring subsystems. The second 
important context for parallel tir distrihuled compuia* 
lion IS the solution of very large compulational 
problems in which no single priKcssor has sufficicnl 
computational power to tackle the problem on its 
own 

The ideas of this paper are relevant to both 
conicxls, but our prcvsenifition will emphasi/e large 
scale numerical compulation issues and iterative 
mclhfKis in particular Accordingly, we shall consider 
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algorithms of the form where 

(x,. . IS a vector in ^ and / ; J?" is an 

iteration mapping defining the algorithm. In many 
interesting applitalions, it is natural to consider 
distrihuled executions of this iteration whereby the Mh 
pOKCssor updates x, according to the formula 

X, . xj, (1.1) 

while receiving information from other processors on 
the current values ol the remaining components. 

Our discussion of distributed implementations of 
Iteration (11) focuses on mechanisms for interproces- 
sor communication and synchronization. Wc also 
consKler asynchronous implementations and present a 
survey of the convergence issues that arise in the face 
of asynchronism These issues arc discussed in more 
detail in licrtsekas and Isitsikhs (l‘)Hyb) where proofs 
of most of the results t|uoled here can be found. 

Ileralion (II) can he executed svnr/imnoicv/v 
whereby processors perform an iteration, communi- 
cate their results to the other priKcssors. and then 
proceed to the next iteration. In .Section 2, we 
introduce two alternative synchronous iterations, 
namely Jacobi type and Ciauss Seidel type iterations, 
and discuss briefly ihcii parallcli/alion In Section .T 
we indicate that synchronous parallel execution is 
feasible even if the underlying computing system is 
inherently asynchronous (i.c no processor has access 
to a global clock) provided that certain synchroniza 
lion metliarusms are in place We leview and compare 
three representative synehroni/.ation methods Wc 
also discuss some basic commiiincalion jirohlems (hat 
arise iialiitally in parallel iterations, assuming that 
processors communicate using a point-to poinl com 
municalion network I hen, in Section 4, we provide a 
more detailed iinalysis of the leijuired lime per 
parallel ileiatum In Section 5, wc uulicalc that the 
synchronous execution of iteration (I I) can have 
certain drawbacks, thus motivating a\vn< hranoixs 
implementations whereby each processor computes at 
Its own pace while receiving (jxissihlv outdated) 
information on the values of the componeiUs updated 
by the other processors An .isynchronous implemen- 
tiition id itenition (11) is not mathematically 
equivalent to its synchronous counterpart and an 
ollierwise convergent algorithm may become diver¬ 
gent. It will be seen that asynchronous iterative 
algorithms can display several .ind different con- 
vergence behaviors, ranging (rom ilivergencc to 
guaranteed convergence m the lace of the worst 
[>ossihlc amount of asvnchromsm and communication 
delays We classify the [xvssiblc behaviors m three 
hroail classes, the cor responding convergence results 
arc surveyed m Sections h, 7 and S. respectively In 
Section d, we address some difficulties thal arise if 
wx‘ wish to terminate an asynchronous distributed 
algorithm in finite lime l inallv. Section Id contains 
our conclusions and a brief discussiori of future 
research directions 

7 JACOBI AND CiATSS sr inr I riTKAnONS 

Ix*l A',..V^,, be subsels of the Fuclidcan spaces 

.respectively, l et rr - fi, + 4 , 


and let X c: M*" be the Cartesian product X - fl A', 

Accordingly, any Jt t is decomposed in the form 
X ~ (x,, , , ,x^), with each x, belonging to . For 
I = 1. , . . p, let / : A' ^ A', be a given function and let 

X^X be the function defined by /(x) = 
(/i(x), . . . ,/^(x)) for every x ^X Wc want to solve 
the fixed point problem x == fix). To this end wc will 
consider the iteration 

X r^f(x). 

We will also consider the more general iteration 

( 21 , 

X, otherwise, 

where / is a subset of the c't>mp<meni index set 
jl, . . ,p}. which may change from one iteration to 
the next 

We arc interested in the distributed implemenlation 
of such Iterations. While sr>me of the discussion 
applies to shared memory systems, we will ItKus in 
this and the next two sections on a message-passing 
system with p priKCs.sors, each having its own local 
memory and communicating with the other processors 
over a communication network WY- assume that the 
rlh processor has the responsibility of updating the ilh 
component x, according to the rule x, ;-/’(i) It is 
implicitly assumed here that the /th processor knows 
the form of the function /. In the special case where 
fix) - Ax f h, where A is an n x n matrix and b c ;i9", 
this amounts to assuming that the ilh processor knows 
the rows of the matrix ,1 corresponding to the 
components assigned to it Other implementations of 
the linear iteration x \v + h arc also pnissihlc. Tor 
example, each [)n>ccs.s()r could be given certain 
columns of A Wc do not pursue this issue further and 
rcicr the reader to MeBryan and Van der Velde 
(I9H7) arid fox rt ul (IMSH) for discussions of 
alternative matrix storage schemes 

For implementation of the iteration, it is seen thal if 
the function j, dcpciuls on x, (with i^y). then 
processor y must be informed by processor i on the 
current value of x\ To capture such data depend 
encics, wc form a directed graph (/ -■ [N, A), called 
the deperuivney j^ruph of the algorithm, with nodes 
-V -- {1, , p\ and with arcs A - ((/. y) i i / / and f 

dcjuMids on x,]. WV assume that for every are (/, /) in 
the dependeney graph there is a eommunicalion 
capability by means of which proccssiu / can relay 
information to processor /. W'c also assume thal 
messages arc received correctly within a liniie but 
otherwise arbitrary amount of time. Such communica¬ 
tion may be possible through a direct communication 
link joining processors i and y or it could consist of a 
mulli-hop path in a communication network The 
discussion that follows applies to both cases. 

An iteration in which all of the components of x are 
simultaneously updated ,p} in (2.1)], is 

sometimes called a Jacobi type iteration. In an 
alternative form, the comtxmcnls of ,i are updated 
one al a time, and the most recently computed values 
of the other comjxments are used The resulting 
iteration is often called an iteration of the 
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-AVaiW type and is descnbed maihcmaiicall^ by 

.1,(7 t + I L . 1, ,(/ ^ ] ). 

v(0-VlO). 

^'-1. P (i:) 

In a serial computing cnviionmcnt. liauss Seidel 
ileratioiis arc often prefer able As an example, 
consider the linear taMr where Ax b, and A 

has non negative elements and v(x*ctrai radius less 
than one. Then, the classical Stem Rosemberg 
theorem |sce e g Bertsekas and Tsnsiklis (IW^b, p 
I >211 stales thal both the Ciauss Seidel and (he 
iicrations converge at a geomernt rale to the unique 
hved point of /, however, in a serial setting where one 
Jacobi Iteration lakes as much as one (Jauss Seidel 
Kcralion. the rale of avnvergencc of the Ciauss Scidel 
iteration is always faster SurpnsingU. in a parallel 
selling this conclusion is reversed, as wc now describe 
in a V4>mewhai more general amicxt 

C onsider the sequence |t (0) generated hv ihe 
Jacohi Iteration 

\'\i ^ 1) - fixU!)], I 0. (2 }} 

and ihc sequence gcncr,iicd bv the (lauss 

Seidel ileialion (2 2). started from llic same initial 
mndition i((l) i^(()M r (0) The lollowing result is 

[uoM'd in Tsitsiklis gcnerali/ing an earlier 

result of Smart and White ( hJHK) 

PnipifMdon I Supfxise that / JP * .f(“ lias a unique 
lixcd point iV and is monotnne, thal is. it salislies 
Mil' Mvlili' V Then, if/(i ill) I ■ iiO), we have 

I * • T'(/>/l' r (M. i “ (I. 1, 
and if I (Of • / (\ (dl). we has e 

i"(/) * x'ipn ' I (I. 1, 

fhopositioii 1 establishes the taster (Parallel eonvei 
ceiue of tfie lacohi iteration for eerlain initial 
cnnditions, assuming rfiat a (iauss Seidel ileraiion 
lakes as much parallel time as p Jacobi iterations It 
has also been shown m Smart amt While ( hMHi thal if 
in addition to the assumptions of Proposition 2 1. / is 
iineai (and thus satisfies the assumptnms of the 
Stem RosenfKMg theorem), (he rate of eonvergence 
of the Jacohi iteration is faster than the rale of 
convergence of the (iauss Seidel iteration An 
extension of this result that a[iplies to iisynchronous 
Jacohi and (iauss Seidel ilcrations is also given m 
Bertsekas and Isilsiklis ( 

Ihe preceding comparison of Jacohi and (iauss 
Scidcl Iterations assumes thal a Jacohi ileralinn is 
executed m one lime step, and that the (iauvs-Seidcl 
iteration cannot be paralleli/cd (so thal a full update 

of all the compKincnis i,.x,. requires p lime 

steps) This IS the case when the nurnher of available 
prrxessors is p and the dc)K*ndency graph descnbmg 
the structure of the iteration is complete (every 
component dqxmds on every other component), so 
that no two components can be updated in parallel. A 
(iauss Seidel iteration can still converge fa.slcr, 
however, if It tan be paralleli/ed to the point where it 
requires the same number of time steps as the 



corresfxmding Jacobi iteration, this can hapfien if the 
number i>l avaihihle piixessors is less than p and the 
de|[>endcncy gtaph is suftkienily sparst\ as we now 
illustrate 

Consider the dependency graph of hg I A 
corresfMinding (iauss Setdel ilcration is desenbed bv 

\Ai ^ 1)i Tr)-i dM) 

K,{t 4 M- fdtdM 1). i.dO) 

I dr ♦ 1) -/d i ^ \), ‘dO) 

+ 1). »d0) 

and Its slim lure is shown in Pig. 2 We notice here 
thal v(/ > 1) and 14 ( 1 ^ 11 can lx* CMimputed in 
parallel In (lariiculat. a vhcc/?, lhat is. an ufKlatc of 
all four componenls, can fx performed m only three 
stages On the oihci hand, a diffeient ordering ol the 
components leads to an iteration ol the form 

»d/ r 1) : fdi,(r), idO) 

»dM i) ‘ /dt..(/), tdf), rdOi 
xAt 4 1)-. /dTdO. uif)) 
i .dr ( 1) fA\ dr + 1). I dO) 

which IS illustrated m Pig V Wc notice here that 
»df ^ 1). I dr > 1) and qir 4 1) can be computed in 
parallel, and a sweep requires only two stages 

[he above example mi>tivaies ific problem of 
ch<w>sing an ordering of the conrponents for which a 
sweep requires the leas! number of stages ITic 
solution of this problem, given m Hcrlse’kas and 
Isitsiklis (IMK^h, p 2d) IS as follows 

rr(»pi)sftion 2 Ihc following arc equivalent 

(i) There exists an ordering of the variables such 
that a sweep of the corresponding (iauss Seidel 
algorilhm can be [x-rformed in K parallel steps 

(ii) W'e can assign colors to (he nodes of the 
dejxridency grapfi so lhai at most K different colors 



Fio 2 The data dcfxndencics in a (ihuss Seidel iicralion 
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H(r V fhc (laiu dcpcndenucti in u (iUu^H-Scidel iteration 
for a different uprJaiing order 


updated in parallel, the corresponding rate of 
convergence mu&t alsr^ be taken into account. 

3 SYNCHRONIZAnON AND COMMUNIC ATION 
ISSUES 

We say that an execution of iteration (2.1) is 
synchronous if it can be described mathematically by 
the formula 


x.(f + 1) 


|/Ui(r).-1,(0) ifieF 


= |-^" .." ■ ( 3 . 1 ) 

otherwise. 


arc used and so that each subgraph obtained by 
re.stricting to the set of nodes with the same cr^lor has 
no directed cycles. 

A well known special case of the above proposition 
ari.scs when the dependency graph O’ is symmetric; 
that IS, the presence of an arc (/. y )c A also implies 
the presence of the arc (y, i). In this case there is no 
need to distingui.sh between directed and undirected 
cycles, and the coloring problem of Proposition 2 
reduces to coloring the nodes of the dependency 
graph so that no two neighboring nodes have the same 
color. 

Unfortunately, the coloring problem of Proposition 
2 is intractable (NP-hard). On the other hand, in 
several practical situations the dependency graph O' 
has a very simple structure and the coloring problem 
can be solved by inspection f urthermore, it can be 
shown that if the dependency graph is a tree or a 
two-dimensional grid, only fwo colors suffice, so a 
Gauss Seidel sweep can bi: done in two steps, with 
roughly half the components of t being ufxJated in 
parallel at each step. In this case, while with n 

proces.s<»rs the Jacobi method is as fast or fa.ster than 
Gauss Seidel, the reverse is true when using n/2 
processors (or more generally, any number of 

processors with which a (iaiiss Seidel step can he 

completed in the same lime as the Jacobi iteration) 

liven with unstructured dependency graphs, rea.son- 
ably g(K)d colorings can he found using simple 

heuristics; see Zenios and Uasken (IM8H) and Zenios 
and Miilvey (198H), for examples. Let us also point 
out that the parallelization of Ciauss Seidel methods 
by means tif coloring is very common in the context of 
the numerical solution of partial differential equa¬ 
tions; see, for example, Ortega and Voigt (1M85) and 
the references therein. 

A related approach for parallelizing Gauss-Seidel 
iterations, which is fairly easy to implement, is 
discussed in Barbosa (IM8b) and Barbosa and Gafni 
In this approach, a new sweep is allowed to 
start iHrforc the previous one has been completed and 
for this reason, one obtains, in general, somewhat 
greater parallelism than that obtained by the coloring 
approach 

We hnally note Ih it the order in which the variables 
arc updated in a Ciauss Seidel sweep may have a 
significant effect on the convergence rale of the 
iteration. ITius, completing a Gauss Seidel sweep in a 
minimum number of steps is not the only con.sidera 
tion in selecting the grouping of variables to be 


Here, / is an integer-valued variable used to index 
different iterations, not necessarily representing real 
time, and 7' is an infinite subset of the index set 
(U, 1, . , llius, T is the set of time indices at which 
X, is updated. With different choices of T one obtains 
different algorithms, including Jacobi and Gauss- 
Seidel type of methods. We will later contrast 
synchronous iterations with asynchronous iterations, 
where instead of the current component values x^(f), 
earlier value.s r^(/ - d) are u.sed in (3 1). with d being 
a possibly positive and unpredictable ‘ communication 
delay” thal depends fin i. } and / 

3.1 Synvhrof\izatu)n methods 

Synchronous execution is certainly possible if the 
processors have access to a global clock, and if 
messages can be reliably transmitted from one 
processor to another between two consecutive “ticks” 
of the clfick. Barring the existence of a global clock, 
synchronous execution can he still accomplished by 
using synchronization protocols called svrnhronizers. 
We refer the reader to Awerhuch for a 

comparative complexity analysis of a class of 
synchronizers and we continue with a brief discussion 
of three representative synchronization methods 
These methods will be described for the case of Jacobi 
type Iterations, hut they can be easily adapted for the 
case of Gauss- Seidel iterations as well. 

(u) (ilohal sym hronizatuni. Here the proce,ssors 
proceed to the (fl)sl iteration, also referred to as 
phase, only after every processor i has completed the 
flh iteration and has received the value of x,(r) from 
every j such that (;. /) e A Cilohal synchronization can 
be implemented by a variety of techniques, a simple 
one being the following: the processors are arranged 
as a spanning tree, with a particular priKcssor chosen 
to be the rixn of the tree. Once processor i has 
computed x,(f), has received the value of for 

every / such that {j, t) e A, and has received a phase 
termination message from all its “children” in the 
tree, it sends a phase termination message to its 
“'father” in the tree. Phase termination messages thus 
propagate towards the root. Once the root has 
received a phase termination message from all of its 
children, it knows that the current phase has been 
completed and sends a phase initiation message to its 
children, which is propagated along the spanning tree. 
Once a processor receives such a message it can 
prtK'ccd to the next phase. (See Fig. 4 for an 
illustration.) 

(/>) Local synchronization. Global synchronization 
can he seen to be rather wasteful in terms of the time 
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Ki(i 4 (llu.slralK>n of ihc global wnchronuaiion mcihod 


required per Ueration An ailernaiive is ro iilU>w^ ihe 
ith proecfisor to proceed with the ( / 4 I )st iteration as 
Mxm as it has received all fhc messages it needs 
Thus, procesMir i moves ahead on the basis of Ukii! 
information alone, obviating the need for propagating 
messages along a spanning tree 
It IS easily seen that the iterative computation can 
(inly priK'eed faster when local synchronization is 
employed Furthermore, this conclusion can also fx- 
reached even if u more efficient global synchronization 
melhixi were possible whereby all poHcssors start the 
if 4 list Iteration irnmediaielv after all messages 
generated by the /th iteralion have Ixen delivered 
(We refer to this hv[>olhetK;al and practically 
unachievable situation as the ideal gl«»bal synchroniza- 
tio.i ) lx*l us assume that the lime requirtvl for on* 
computation and the communication delays arc 
fKiunded above by a finite constant and arc fxiunded 
below by a pirsitive constant Fheri it is easily shown 
that the lime spent for a number K ot iterations under 
ideal global synchronization is at most a idnslant 
multiple of the correspnuJing time when local 
synchronization is employed 
The advantage of Unal synchronizalifni is binier 
seen if communication delays do not ofKV anv a priori 
bound. For example, let us assume that the 
communication delay of every message is an 
independent cxjxmcnlially distributed random van 
able with mean one Furthermore, suppose for 
simplicity, that each }>rixessor sends messages to 
exactly d other processfirs, where d is some constant 
(i e. the outdegree of each ninJe of the dependency 
graph IS equal to d) With global synchronization, the 
real time spent for one iteration is roughly equal to 
the maximum of dp independent exponential random 
variables and its expectation is, therefore, of the order 
of log (dp). Thus, the expected time needed for K 
Iterations is of the order of K log(pd) On the other 
hand, with local synchronizaiion, it turns out that the 
expected lime f(»r K iterations is of the order of 
logp -4 K\o^d [joint work with C If. Papadimitriou. 
sec Ben.sekds and Tsitsikhs (198%, p KM)]. If K is 
large, then IcKal synchronization is faster by a factor 
roughly equal to log (pd)/log d Its advantage is more 


pronounced if d is much smaller than p, m is the case 
in most practical applications. Jvome related analysis 
and experiments can lx found in DuNxs and Briii^s 

{m?) 

) \vm9iro«iZtjnori luii roilhai k Ibis methcHl, 
intrcHlumi by leWerson (1985), has been pnmariK 
applied to the simulation of discrete‘event systems It 
can itlso be viewed as a general purpose synchrom/ii 
tK>n methiHJ but it is likely to be* inferior to the 
preceding twv> meihcxis in ajTpliciitions involving 
Mvlution of systems of equations. ( (insider a situation 
where Ihe message r,(/) tiansrmttcd from siime 
piixessor / tt^ some other poKcsscn i is most likelv to 
take a fixed delimit value known to / In such a case, 
pKKesMH 1 may go ahead with tlie computation of 
x,(f ^ I) without waiting for the value of by 

making the assumption that will take the defaull 
value In case that a message tomc*s lalei which 
falsifies the assumption that i,(/) has the default value, 
then a rolltnuk <h'cuis; that is. (he computation of 
idt 4 11 IS invalkiaied and is performed once more, 
taking into account the coned value ol .idt) 
Furthermore, if a prixessoi has sent messages based 
on compiiliilions which are later invalidaled. it sends 
amtntirs ui^rs w hich ciincel (he eat her messages A 
reception of such an aniiniessage bv some other 
processoi k could invalidate some ot k's compulations 
and could trigger the tr;insmis'ion of further 
anlimcssages by k Fbis process has ihe (Hiienlial ol 
explosive generation of anlimcssages that could diain 
the available commuiacation resources On ibe other 
hand, il is ho|x*d that the numfH‘i ol messages and 
iintimessages would remain small in problems of 
practical interest. although insulficient analytical 
evidence is aviiilablc al present .Some probabilistic 
analyses of the tH’-rlormance of Ibis inelhod can be 
found in l.avenbeig rr al (19HV) and Mitra and 
Mitrani (19H4) 

.F2 Sinyje and rrmlitrKidv hroadi u\nn^ 

Regardless ol whciher the implementation is 
synchronous or not. it is necessary to exchange some 
information between the processors after each 
Iteralion Ihe mlerpiocessor communication lime can 
be sufisi.mtial when enmpared to the time devoted to 
compulalions. and it is impiorianl to (any out the 
message exchanges as eflicienlly as possible 'Miere are 
a number of generic communication problems that 
arise frequently in ueiativc and other algorithms We 
describe a tew such tasks related to message 
broadcasting 

In the first conimumcalion task, we want to send 
the same message from a given prrvcessor to every 
other priKcssor (wc tall this a vmg/r node hroadaist) 
In a generalized version of this problem, we want to 
do a single niKic broadtiisi simultaneously from all 
nodes (wc call this a mufimodt' hroadcaxt) A typical 
example where a mullmode broadcast is needed arises 
in the Iteration a -/(i) If we assume that (here 
IS a separate prexessor assigned to componcni 
I - 1, . . , p. and that the function / depends on all 
armponents e,. /= 1, . , p, then, at the end of an 

Iteration, there is a need for every prexessor to send 
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SINGLE NODE BROADCAST SINGLE NODE ACCUMULATION 




I’K# .V (a) A single nolle hroaiitasi uses u ircir ihai is riNjled ai a j^jven node (which is hikJc I in Ihc hgure). 
The lime nexi lo each link is the lime lhal transmission of ihe packet on the link begins (b) A single node 
accumulation problem involving summation of n scabirs a,, . (one per processor) at the given nmle 

(which IS node I in the figure) ITc lime next to each link is the lime at which transmission of the 
combined' packet on the link begins, assuming that the lime lor scalar addition is negligible relative to the 

time required for packet transmission 


the value of its component to every other processor, 
which IS a multmode broadcast. 

( learly, l(i solve the single node broadcast problem. 
It IS sufticient lo transmit the given node's message 
along a spanning tree rooted at the given node, that 
IS, a spanning tree of the network together with a 
direction on each link of the tree such that there is a 
unique path from the given node (called the ror;/) to 
every other node With an optimal choice of such a 
spanning tree, a single node broadcast takes 
(:')(r )“lime,1 where r is the diameter of the network, as 
shown in Fig. 5(ii). To solve the rnullinodc broadcast 
problem, we need to specify one spanning tree per 
rtH)t node. Ihe difticiilty here is lhal some links may 
belong to several spanning trees; this complicates the 
timing analysis, because several messages can arrive 
simultaneously at a node, and require transmission on 
the same link with a queueing delay resulting 

Tliere are two important communication problems 
that are dual to the single and multiniHle broadcasts, 
in the sense that the spanning iree(s) used to solve 
one problem can also be used lo solve the duiil in Ihe 
sume amouiii of communication lime In the first 
problem, called sinf^lr node m cumulation, we want lo 
send to a given node a message from every other 
node; we assume, however, that messages can he 
' eornbincd ’ for transmission on any communication 
link, with a “combined'’ transmission lime equal lo 
the transmission lime of a single message. This 
problem arises, for example, when we want lo form at 
a given node a .sum consisting of one term for each 


t The solution /i( v) B(g( y)). where v is a positive 
integer, means ihut for some c, fl. r, and yiT>(). wc 
have « ,lif(y)l h(y ) r. i jigf v )| for all v >„, 


node, as in an inner product calculation [see Fig. 
5(b)j, we can view addition of .scalars at a node 
as “combining ' the corresponding messages into a 
single message The second problem, which is dual 
lo a rnullinodc broadcast, is called mulunode 
accumulation, and involves a separate single node 
accumulation at each node It can be shown that a 
single node (or nuiltinode) accumulation problem can 
be solved m Ihc same time as a single node 
(respectively niultinode) broadcast problem, by 
realizing that an accumulation algorithm can be 
viewed as a broadcast algorithm running m reverse 
time, as illustrated in Fig. .S As shown m F'lg 4, 
global synchronization can be accomplished by a 
single node broadcast followed by a single node 
accumulation. 

Algorithms for solving the broadcast problems just 
described, together with other related communication 
problems, have been developed for several pnipular 
architectures (Nassimi and Sahni, 19H0; Saad and 
vShultz, 1987; McBryan and Van der V'elde, 1987; 
Ozveren. 19H7; Berlsekas et al , 19H9, Bertsekas and 
Tsilsiklis, 1989h; Johnsson and Fio. 1989). I'able 1 
gives the order of magnitude of the time needed to 
solve each of these problems using an optimal 
algorithm. The underlying assumption for the results 
of this table is that each message requires unit time for 
transmission on any link of the interconnection 
network, and that each proces.sor can transmit and 
receive a me.ssage simultaneously on all of its incident 
links S^Kcihc algorithms that attain these limes are 
given in Bertsekas rt ai (1989) and Bertsekas and 
Tsitsiklrs (1989b, Section 1.3.4). In most cases these 
algorithms are optimal in that they .solve the problem 
in the minimum possible number of time steps. Figure 
6 illustrates a multinode broadcast algorithm for a ring 
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(b) 

I i(i ^ (.0 A rin>: i>l f> n^niev h^vvir^- .ts link'v ihr (Mirs 1/ i ^ I) lor t 1, 2. . f> 1. imU (/>, 1) (h) A 

nuiliuiOLii* hioink-i'.i \mi .i mif’ \Aiih p noJes \k jH-rInriiieil in \[p l)/2) slaj^cs Inllows ai Mage 1. 

I ,uh no,It St ikK Its own p.kkt i lo iis t ltH kwist anti t nunicrtiiK kvtisc 

. (/’ 1 I ' tMth noiit St lui*' ii' Its tliKkwisi' nri^hUn Ihr paikci ncnviil (inni ils lOunlcrdiH kwnic 

iR'i^thlnu ai ific prt'Mtuis staku also. ,ii stages , U/' ?l'r|. each n<Hie mtiuJs io iis uvnnlereUnkwi.^ic 

nciehKu ilu* packet iteeivetl Irom ns tlmkwtsc rn i^'hlHn ai ihe previous siu|»e The lifjuri* illusirati's lh»s 

pioL'ess Im p 0 


wilh p prnccsstMs. which allaiiis the iiniiiinunt niinihei 
1)1 steps, 

I sing the results ol I able I. it is also slniwri in 
lierlsekas and Isii.siklis (l^^Knh) that it a hvpereuhe is 
used, I hen most of the hasie operations t»l niinu-rieal 
line«ii algebra, i e inner ()it)diKl. inatiix \eeior 
inuliipliLalion, matrix matrix mulliplKalion. power o( 
a iTKilrix, etc , can be executed m paiaUel in Ihe same 
order of lime as when eomriuinicalinn is mslaii 
laneous In some cases this i\ alsti possible wheit the 
(>rocessors are camnecled with a less (k)wcrful 
iiiterLonneLlion network sucit .is a square mesh I hus, 
communication afleels onlv the rnuliiplvmg constant' 
as opposed to tlte order of lime needed to cairv out 
these operalifins Nonetheless, with a large number of 
processors, the effect o( communication delays on 
linear algebra operations can be very substantial 

4 III KA I ION (OMfM I XI I Y 

We now try to assess the polenlial Kmelil from 
paraileliziiiron of the iteralion i /(a) In particular, 
we will esiimaie the order of growth of the required 
lime per iteration, as the dimension n increases Our 
analysis is geared towards large problems and the 
issue of speedup of iterative methexfs using a large 
number of processors We will make the following 


assuniplioris 

(a) All componeiils of a are ujxjalcd at each 
Iteration ( Pus corrcsfKmds to a Jaeohi iteration 
It a Ciauss Seidel ilcialion i.s usvii instead, the 
time per iteration cannot increase, since by 
updating only a subset of the componenis, the 
compulation per ilcralion will he reduced and the 
commumcation problem will be simplified liased 
on this, It can Ik seen that the order of required 
lime will fx: unaffected if m place of a Jacobi 
ilcralion, we perform a (iauss Seidel sweep with 


Vahi I I SnimoN iiMi s oi oroiMAi AI onm ihms I Ok nil 
IIN.OAIXaSI and Alll MOlAllON I'KOHIJMS OSINii A KlNti A 
lilNAMO HAI AMIO IKM A t/ OIMI .SJSIONAI MISII (WI MI TMI 
SAMI M fMHI K Ml r'HiM 1 SVORS AI riN(t I AI H OIMI NSlONl AND A 

nvPi Mr ( Ml wini/) PRor i ssoks f in riMi s r.ivi n lok nil 
Kisr. Ai.vj iiru.n irm a i ini am amkas 


Problem 

Rihr 

Tree 

Mesh 

Ilypcrcuhc 

Single node hroatlcasi 
(or single node 
aa umuliklion) 

«(p» 

B(logp) 


eduRP) 

Muitmodc broadcast 
(or multinode 
aixumulafiori) 

»ip) 

et/7) 


»(P/10RP) 
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a number of step^ whith fixed and independent 
of the dimension n .) 

(h) llicrc are n processors, each updating a single 
scalar cornponent of x at each iteration (One may 
wish to use fewei than n procewsors, say p, each 
updating an n/p-dimcnsional comfKincnt of x, m 
order to etonoini/e on cornmunicalion We argue 
later, however, that under our assumptions, 
choosing p n cannoi improve the order of time 
required [Ht iteration, although it may reduce this 
lime by a tonslani factor. In practice, of course, 
the numiHjr of available jiriKessors is often much 
less than ri, and it is interesting In consider 
optimal ulili/alion of a limited number of 
poH;eNsors in the conlexi of iterative methods. In 
this parser, however, we will not address this 
issue, prefermg to concenlrale on the potential 
and limitations of iterative computation using 
massively parallel machines with an abundant 
numlH.‘T of processors ) 

(c) hollowing the execution of their assigned fiortion 
of the Iteration, the priR-essors exchange the 
updated values of their cuin(xinents by means of a 
comiTiuniciilion algorilhni such as a rnullinode 
liroadcas! I'hc siihset|uent synchroni/alion takes 
negligible lime ( I'his can he justified by noting 
that local synclirom/ation can be accomplished as 
part of tfie communication algorithm and thus 
requires no additional time I urthermore, global 
synchroni/alion can he done by means of a single 
node broadcast followed by a single ruide 
accumulation I hus the time required for global 
synchroni/alioti grows with n no lasler than a 
iTUiltinode broadcast lime Iherefore, if the 
communication portion of the iteration is ilone by 
a multinode htoadeasl, the global synefironi/alioii 
lime can he ignored when estimating the order of 
required lime per iteration.) 

We estimate the lime per iteration as 

f ( I IMI’ f MIMM ' 

where /Vumi- fhe time to compute the updated 
components and /mm, is the lime to exchange 
the ujiilaled component values between the processors 
as necessary. If there is overlap of the computation 
and communication phases ilue to some form of 
pqxdining, the lime jxrr iteration will he smaller than 
f(HMi' ^ /mnh but Its order of growth with n will not 
change We consider several hyprilheses for 7, 
and 7 mnii. corresixmding to different types of 
compulation and communication hardware, and 
structures of the functions j\. In particular, we 
consuler the following cases, motivated primarily by 
the case where the system of equations x=/(x) is 
linear: 

Small IVoMr ( " BiU) One example lor this case is 
when the iteration functions / arc linear and 
corres(xmd tu a vciy .sparse syslem (the maximum 
node degree of the deiiendency graph is 0(1)) 


Another example is when the system solved is linear 
and dense, but each processor has vector processing 
capability allowing it to compute inner prtKJuets in 
0(1) time 

Medium Trtmv ( = 0(logn)). An example for this 
case is when the system solved is linear and dense, 
and each processor can compute an inner product in 
0(logn) time. It can be shown that this is possible if 
each priKessor is il.self a message-passing parallel 
pnKessor with logn diameter 

Larj^e ImMr 0('*)) An example for this case is 
when the system .solved is linear and dense, and each 
processor computes inner products serially in 0(n) 
time. 

Also the following arc considered for the 
communication time 7 mnh- 

Small 7mnh (=0(1)) An example for this case is 
when special very fast communication hardware is 
used, making the lime for the multinode broadcast 
negligible relative to 7, (,M^• relative to the 
communication software overhead at llie mes.sagc 
sources Another example is when the processors are 
connected by u network that matches the form of the 
dependency graph, so that all necessary communica¬ 
tion involves directly connected nodes bor example 
when solving partial differential equations, the 
dependency graph is often a grid resulting from 
discretization of physical space Tlien, with pri>cessors 
arranged in an appropriate grid, communication can 
be done very fast. 

Medium '7mnii- ( = 0(n/logn)). An example for this 
case is when the multinode broadcast is jxrtormed 
using a hypercube network (cf 1 able 1) 

l.ar^t’ /'mniv (“0(n)) An example for this case is 
when the mullinodc broadcast is performed using a 
ring network or a linear array (cf 1 able 1) 

l ahlc 2 gives the lime per iteration 7, umi 7mni, 
for the different combinations of cases. In the worst 
case, the time per iteration is 0(n). and this time is 
faster by a factor n than the lime needed to execute 
.serially the linear iteration i : ~ Aa b when the 
matrix A is fully dcn.se. In this case, the sfxredup is 
propi^irtional to the number of processors n and the 
benefit from parallelization is very substantial. This 
thought, however, must be tcm|xrred by the 
realization that the parallel solution time still increases 
at least linearly with n, unic.ss the number of iterations 
needed to solve the problem within practical accuracy 
decreases with n—an unlikely po.ssibility 


Iahii 2. Timi riK in ration v fix) ondf r a \ arihy or 
As.suMrnoNs for thf compi tamon timi pi r in ration 
7,OMP IHI COMMUNM AMON IIMI PLR III KAlTOIM /mnIi 

In Till (FITS ABOVF ITIF DlACiONAl , Mil ( (IMPOT A I ION IIMI IS 
THl HOTTU NI C K, ANO IN nil ( I l ls Bl I ()W THF DlAC.ONAl 
THF ( OMMIJNK ATION TIMF IS THF HOTTIJ-Nl C K 
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In the best case of Table 2, the time per iteration is 
bounded iircspectiveb of the dimension n. offering 
hope that wth speaal computing and ammunication 
hardware, some extremely large practical problems 
can be solved in reasonable lime 

Another interesting case, which is mn covered h\ 
Table 2. arises in connection with the linear iteration 
M Ax -f b. where A is an n x n fully dense matrix. It 
can be shown that this iteration can be executed in a 
hypercube nerwork o( n" processors in t^tlog n) rime 
(sec. for example, Bertsekas and Tsiisiklis (l9K9b)| 
While it IS hard to imagine at prcscnl hypcrcul>cs of n‘ 
pnMTCssiirs solving large nxn syslcms. this case 
provides a theoretical limn lor ihe iiinc per iteration 
tor unstructured linear svstems in message passing 
machines 

C onsider now the possibility of using p ^ n 
processors, each updating an n//; dimensional a»m- 
fxment of X The computation time [kt itcraliun will 
then increase by a factor n/p, so the quesnon arises 
whether it is possible to improve the order of growth 
ot the communication lime m the cases where /ms.h is 
the Iteration time bottleneck The cases of medium 
and large arc of principal interest here In these 
cases the corresponding times measured in message 
transmission time units are B(p/logp) and B(p), 
respectively. Because, however, each mevsiigc in 
volves n/p values, its transmission lime grows linearly 
with nip, so the corresfumding lime Imnh U*comes 
H(n/iogp| and res|Hrctively Thus (he order of 

lime per ileration is not improved hv choosing/>' n, 
al least under the hvfMilheses ot this section. 

S ASYNCMRONCK'S Ml KAIU)NS 

Asynchronous itcraiions have been introduced bv 
C'hazan and Mirankei (IStfiV) (under the name (huoiii 
rrlaxation) for the solution o( linear equations In an 
asynchronous implcmenialion of the iteration \ 

/(I). priKcssors are not required to wait to receive all 
messages generated during the prevntus ileration 
Rather, each proc;essor is allowed to keep iterating on 
Us own comixmcnt at its own pace If the curreni 
value of the component updated hv some other 
processor is not available, then some outdated value 
received al some time m the past is used instead 
l urthcrmore, processors are not required to trim 
municaic their results after each iteration but only 
once m a while. We alh>w some prtKcssors to compuic 
faster and execute moi: iterations than others, wc 
allow some processors to communicate more fre 
quently than others, and we allow the communication 
delays to be substantial and unpredictable W'c also 
allow the communication channels to deliver messages 
out of order i.c in a different order than the one they 
were transmitted 

There are several potential advantages that may be 
gamed from asynchronous execution [sec Kung (l‘>7h) 
for a related disrussion] 

(a) Reduction nf the synchronizatK^n penalty I herc 
IS no overhead mu h as die one assoctated with the 
global synchronization method. In particular, a 


prixTssor can proceed with the next iicriaiiion without 
waiting for all oihct processors to a^mplete the 
current iteration, and without waning h>r a synchronic 
/ation algivnihm to rxecuie Furthermoie. in certain 
cases, there are even advaniage^i over the Unal 
synchronizatii>fi methiKi as wc now iliscuss Suppose 
(hat an algorithm happens to be such thiii each 
iteratiim kavc> the value of x, unchanged With Uxal 
synch run I/a I ion. pim'rssor i must still send mcs.sages 
to every prefers,sor / with {i. f)€ A because proccsstir / 
will not otherwise poxsced to ihc next iteration. 
Consider now a somewhat more realistic case where 
(he algorithm is such that a typical iteration is very 
likely to leave i, unchanged ITien each priHcssku / 
with (i. ))i. A Will be often found in a siiuation where 
If waits for rather uninformative messages slating that 
the value of i, has not changed In an asynchronous 
execution, prixessoi / docs not wait tor messages from 
prvKcssor i and the progress of the iilgonlhm is likely 
to be fa.sicr A similar argument can be made for the 
ca.se where r, changes only slightlv Indwecn iterations. 
Notice that the situation is similiir to Ihc case of 
synchrorii/aiion via rollback, except (hat m an 
asynchronous algonthni prexessors do not roll back 
even if they iterate on the busts of outdated and later 
invalidated mformaiton 

(b) Ease of rcAtarttn^. Suppose (hat the proces.sors 
arc engaged in the solution ot an optinu/alion 
problem and that suddenly one of ihc parameters of 
the problem changes (Such a situation is common ami 
natural m the context of data networks ot in the 
quasislalic control of large scale systems ) In a 
synchronous execution, all priKessors should be 
informed, abort the eompiifaiion, and then leimtiale 
(in a synchronized manner I Ihe algorithm In an 
asynchronous implementation no such remitiiili/ation 
IS required Rathci. each pnxcssoi incorporates the 
new parameter value in its iterations us soon as it 
learns the new value, without waiting for all 
processors to become aware of the paiametcr change 
When all poxessors learn the new parameter value, 
the algorilhm becomes the correct (asynchronous) 
iteration 

(() Reduction of the effect of hottlenvi k\ Suppose 
that the computulional power of pnxessoi i suddenly 
dcicnoraies diustically In a synchronous execution 
the entire algorithm would In: slowed down In an 
a.synchron()us execution, however, only llie progress 
of X, and of the components strongly influenced by x, 
would be affected, the remaining components would 
still retain the capacity of making unhamperred 
progress Thus the effects of temporary malfunctions 
lend to be kxalized TTic same argument applies to 
the case where a particular communication channel is 
suddenly slowed down 

(d) (V/fiuergenre atcelrratton due to a (iauss Seidel 
effect. With a Ciauss Seidel execution, convergence 
often takes place with fewer updaie.s of each 
comfKincnt, the reason being that new information is 
incorporated faster in the update formulas, On the 
other hand (iauss Seidel itcraiions arc generally less 
parallclizabfe Asynchronous algorithms have the 
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potential of displaying a Gauss-Seidel effect because 
newest information is incorporated into the computa¬ 
tions as soon as it becomes available, while retaining 
maximal parallelism as in Jacobi-type algorithms. 

A major potential drawback of asynchronous 
algorithms is that they cannot be described mathe- 
maticaliy by the iteration x(r *f 1) =/(x(t)). llius, 
even if this iteration is convergent, the crirresponding 
asynchronous iteration could be divergent, and indeed 
this IS sometimes the case. Even if the convergence of 
the asynchronous iteration can be established, the 
corresponding analysis is often difficult. Nevertheless, 
there is a large number of results stating that certain 
classes of important algorithms retain their desirable 
amvergence properties in the face of asynchronism: 
they will be surveyed in Sections 6-8. Another 
difficulty relates to the fact that an asynchronous 
algorithm may have converged (within a desired 
accuracy) but the algorithm does not terminate 
because no prcKcssor is aware of this fad Wc address 
this issue in Section 

We now present our model of asynchronous 
compulation. Ixl the set X and the function / be as 
described in Section 2 Ixl / be an integer variable 
u.sed to index the events of interest in the computing 
system. Although t will be referred to as a time 
variable, it may have little relation with “real time”. 
I.et x,(0 be the value of x, residing in the memory of 
the ith processor at time /. We assume that there is a 
set of limes T at which x, is ufKlaied. To account for 
the fxjssibility that the /th proce.ssor may not have 
access to the most recent values of the components of 
X, wc assume that 

l)-/(x.(r;(0). Vre T, (.M) 

where r;(r) are times satisfying 

r;(r)- t, Vr M). 

At all times / i / ', v,(0 is left unchanged and 

.r,(t-f 1) - (.S.2) 

We assume that the algorithm is initiali/ed with some 
x(()) X 


TTie above mathematical descnption can be used as 
a model of asynchronous iterations executed by either 
a message-passing distributed system or a shared- 
memory parallel computer. For an illustration of the 
latter case, sec Fig. 7. 

The difference r-T/f) is equal to zero for a 
synchronous execution. The larger this difference is, 
the larger is the amount of asynchronism m the 
algorithm. Of course, for the algorithm to make any 
progress at all we should not allow r]{t) to remain 
forever small. Furthermore, no processor should be 
allowed to drop out of the computation and stop 
Iterating. For this reason, certain assumptions need to 
be imposed, llicre arc two differeni types of 
assumptions which we slate below. 

Assumption 1 (Total asynchronism). The sets T' are 
infinite and if {/*) is a sequence of elements of T 

which tends to infinity, then lim ^ for every j. 

Assumption 2. (Partial asynchronism) There exists a 
positive constant B such that; 

(a) For every l ^0 and every /, at least one of the 

elements of the set (r. / f I. . , f 4 - 1) belongs 

to r 

(b) There holds 

t - B ’ t, V/./, Vm. 7 ' (5..^) 

(c) There holds r^r) -- 1, for all / and t ( T‘ 

The conslant B of Assumption 2, to he calleil the 
asynchronism measure, bounds the amount hv which 
the information available to a processor can he 
outdated Notice that a Jacobi-type synchronous 
iteration is the special case of partial asynchronism m 
which B= 1. Notice also that Assumption |c) states 
that the information available to processor / regarding 
its own eomjxment is never outdated. Such an 
assumption is natural in most contexts, hut could he 
violated in certain types of shared memorv parallel 
computing systems if we allow more than one 
processor to update the same comptmeni of \ It turns 



Fii. 7 Illusiratioh of a eonq^oncnl u^aie m a shared memory mullipriKcssor. Here i , is viewed as being 
updated at time / - e 7 ‘). with r^(9) - 1, t;;(9) ^ 2, and rjjy) = 4 llie updated value of a > is cniered at 
the corresponding register at r ^ 1(1 Several component.s can he simultaneously in the process of being 
updated, and ihe values of tJ(0 can be unpredictable. 
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oui lhat if relax Assuinption 2(c), the convergeiKe 
of certain asynchronous algc^nthms is destroyed 
(Lubachevsky and Mitra, 19Ht>; Bertsekas and 
Tsmiklis. p 5U6 and p 517) Parts (a) and (b) 

of Assumption 2 arc typically satisfied in practice 
Asynchronous aigonihms can exhibit three diffei 
cn: types of behavior (other than guaranteed 
divergence). 

la) Convergence under total asvnchronism 
(b) Convergence under partial asynchronism, (or 
every value of but possible divergence under lotaMv 
asvnchronou.K execution 

(cl tunvergence under partial asynchronism if P is 
small enough, and possible divergence if H is large 
en<»ugh 

The mechanisms by which convergence is estab 
lishcd in each one o( the above three cases are 
lundamenlally different and we address them in the 
suhsct|uent ihrec sections, resjx’clivcly 

fy 1()IAI.1^ ASYNC HRONOUS AIOOKirHMS 
folally asynchronous convergence results have been 
obtainedt hy C'ha/an and Miiankcr (IW^) for linear 
iicraiions, Mielluu (l^T.Sa). Haudet (iy7H), [d I ara/i 
I1MS2), Micllou and Spiteri IU»iKS| tor contracting 
ilcrations. Micllou (U175b) and Hertsekas (1V82) for 
mi>rn)l()fU’ ileiations, and Hcrisekas (U^S^) (oi general 
ilcfiilions Related results can ht‘ also louiul in Uresm 
.Hul Dubois ( UJKb, IMHK. 1‘8XI) 1hc (ollowing general 
icsLilf, IS from Hertsekas (jdK.V) 

} I.cl A - || .\, c || .V?’' Sup|M)st‘ that 

r 'i It 

loi each If (I, .pj. ihcic exists a sequeno' 
A (A: )l of subsets A, such that 

(a) A’ lA -e I) c A2(/( ). for all A ' (I 

/• 

ibi The sets A (A) (I A,(A) have the pro|X‘riy 

. I 

fix I c A (A ^ I). tor all v f A' 

(cl I very limil [Mnnt ol a sequence (UA)| with the 
projH Ttv i(A I f \(k ) for all A. is a fixed point of / 

I hen, under Assumption I (total asynchronism), 
and if i(l)) i- Add), every limit p<mit of the sequence 
iUM) generated iiy the asvnchronous iteration 
(N 1) (5 2) IS a fixed point of /, 

Pnifff Wc show' by induction that lot each A - (), 
there is a lime such (U *l 

(a) t(r) c A'(A) for all r ^ f* 

(b) hv»r all i and if I' with r * , wc have 
x‘(M f X{k ). where 

U(/) -■ (x ,(r’,(r)), xd r'dO). * J rlfO)), Vre T 

|ln w’ords after some time, all s<iluhon estimates 
will be in AdA) and all estimates used in iteration 
f S I) will come from Af f A ) | 

- Aciually, some of these p.qx'rs only consider pariially 
asynchronous iicraiions. bvii their convergence results readily 
extend to cover the case of total iisynchrunism 


The induetton hypc>lKeM« u true for A «« 0, since ihc 
initial ei^timate is assumed to be in AdO). Assuming it 
IS true for a given A, we will show that there exists a 
lime #*., with the requited pmpcfiicx lor each 
i ® T . rt, let f be the first element of V such that 
f Then by amdition (b) in the sialement of the 
privpowljon, wtr have /{i'(fD)e -V(A + 1) and 

4 l) -/.(*'(^d)t A'(A 4 1) 

Similarly, for ^very fc 7“. f f‘. we have id^ "f l)^ 
A'dA -4 1) Between dements of P, idO docs not 
change Thus, 

idf)t A (A 4 1). Vr M' 4 I 

let r*‘^mHx(fd4l Then, using the liiftesian 
piiKluct structure of A (A) we have 

i(/)t AfA 4 1). Vr -r; 

hnally, since by Assumption 1, we have i|(f) as 
i . iiT‘, wc can chinrsc a lime Ihat is 

sufficiently large so that r;(r) i[ for all t, f and f t P 
with t * r*, I We then have. ,idT!(0)<^ A^A ^ I), for 
all rr /‘ with f > » and all y»l. , n. which 
nnplit s that 

id/) - (xdr'iiD). idr';(D)> . i«(T:(/)))f AdA 4 I) 

I he induction is complete. 0 ID 

Ihe key idea behind ProfHisition ) is that cventiially 
x(/) enters and stays in the set A(A |, furthermore, due 
to condition |b) in Proposition 5. it eventually moves 
into the next sci AdA4]) fhe most restrictive 
assumption in the pro|)os!lion is the requirement that 
each A (A) is the C artesian priHluct ol sets AjA), 
Successful application of Proposition } depends on the 
abililv In properly define the sets AdA) with the 
required properties This is possible for tw<i general 
classes td iterations which will be discus.scd shortly 

Notice that IVoposilion d makes no assumptions on 
the nature of the sets A',(A) for this reason, it can be 
applied to problems involving continuous variables, as 
well a.s discrete iicraiions involving finite valued 
variables Furthermore, the resiill extends in the 
obvious way to the case where each X,{k) is a subset 
of an infmitc-dimcnsional space (instead of being a 
subset of JP' j or to the case where / has multiple fixed 
points 

Interestingly enough, the sufficient conditions (or 
asynchronous convergence provided hy Proixisition T 
are also known to be necessary for two special crises 
fi) if n, - I for each / and the mapping / is linear 
((ha/.an and Mirankcr, 1W>), and (ii) if the set A is 
(mite fUrcsin and Dubois, 1990). 

Several authors have alMi studied asynchronous 
iterations with zero delays, that is, under Ihe 
assumption r^(/)= / for every tf;P see for example 
Robert et al (1975); Robert (1976, 19H7, 1988). Note 
that this IS a special case of our asynchronous mtKJel, 
but IS more general than the synchronous Jacobi and 
Gauss-Seidel ilcrations of Scctum 2, because the sets 
7' arc allowed In be arbitrary Cicneral necessary and 
sufficient cxmvcrgcnce conditions for the zero-delay 
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cHfic can be found in (1987) where it is shown 

that asynchronous convergence is guaranteed if and 
only if there exists a Lyapunov-type function which 
testifies to this. 

h i Maxuftum norm iontractions 

C onsider a norm on defined hy 

||x|| max ..- . (6.1) 

, w, 

where x, r is the ilh component of x, || • ||, is a 
norm on , and w, is a positive .scalar, for each i. 
SupfKisc that / has the following contraction property: 
there exists some n < [f), 1) such that 

\\fix)~x*\\ - a||x VxeX (6.2) 

where x* is a fixed point of /. (jiven a vector jtfO) e X 
with which the algorithm is initialized, let 

X,{k}^ (,r, r fr-1 ||x, - x:\\, - cr* ||.tr(()) - x^\\). 

It IS easily verified that these sets satisfy the conditions 
ol ProfKxsition 3 and convergence to Jt * follows. 

Iteration mappings / with the contraction property 
(6.2) are very common. We list a few examples; 

(a) l inear iterations of the form f{x)"Ax~^ h, 
where A is an n x n matrix such that f){\A\) * I Mere, 
\A\ IS the matrix whose entries are the absolute values 
of the coircsf)onding entries of A. and ff{\A\). the 
spectral radius of \A\, is the largest of the magnitudes 
of the eigenvalues of \A\ (C'hazan and Mirankcr, 
1969). This result follows from a corollary of the 
Perron hrohenius theorem that states that /i(|4|)< I 
if and only if A is a contraction mapping with respect 
to a weighted maximum norm of the form (6 1), for a 
suitable chtiice of the weights. As a special case, wc 
obtain totally asynchronous convergence of the 
iteration tt jtP for computing a row vector n 
consisting of the invariant probabilities of an 
irreducible, discrete-time, linite-state, Markov chain. 
Mere, /* is the transition probability matrix of the 
chain arul one of the components of ji is held fixed 
throughout the algorithm (Hertsekas and Tsitsiklis, 
19H9b) Anothci special case, the case of periodic 
asynchronous iterations, is considered in Donnelly 
(1971) Let us mention here that the condition 
p(|A|)' I IS not only sufficient but al.so necessary for 
totally asyiichroniHis convergence (C’hazan and Mir- 
anker, 1969) 

(b) Ciradient iterations of the form f{x)- x~ 

yVL(4). where y is a small positive stepsize 
parameter, h . Jl''* is a twice continuously 

differentiable cost function whose Hessian matrix is 
bounded and satishes the diagonal dominance 
condition 

X )| ■> ?;,/•(.») - ft. Vi, \/x e X. (6 .1) 

Hcie, fi is a tiosHive constant and .stands for 
(l?/■)/(J.V, Ji,) (Hertsekas. 1983; Bertsekas and 
rsitsiklis. 1989b) 

Fxarriple I. C tin.sider the iteration .x :=ji — yAjr, 


where A is the positive definite matrix given by 

1 4 r 1 1 ' 

1 14 ^ 1 

1 1 14^ 

and y. r arc positive constants. This iteration can be 
viewed as the gradient iteration j: = j - yVF(x) for 
minimizing the quadratic function ^’(x) = \x'Ax and is 
known to converge synchronously if the .stepsize y is 
sufficiently small. If c>L then the diagonal 
dominance condition of (6.3) holds and totally 
a.synchronous ainvergencc follow.s, when the .stepsize 
y IS suHiciently small. On the other hand, when 
{)< c < L the condition of (6.3) fails to hold for all 
y>0 In fact, m that case, it is easily shown that 
pill - yA\) > 1 for every y >0. and totally asynchro¬ 
nous convergence fails to hold, according to the 
necessary conditions quoted earlier. An illustrative 
sequence of events under which the algorithm 
diverges is the following. Suppose that the processors 
start with a common vector x(()) = (c. r, f) and that 
each processor executes a very large number 6, of 
updates of its own comp<3ncnt without informing the 
others. Then, in effect, processor 1 solves the 
equation 0 = (5A'7i9x,)(x,, r, c) “■ (1 4 r)x, 4 c 4 c. to 
obtain x,(ro) -> -'2r/(l 4 c), and the .same conclusion 
is obtained for the other processors as well. Assume 
now that the processors exchange their results at time 

and rcfHral the above described scenario. Wc will 
then obtain x,(2ri,) ~2r,(r(,)/(l 4 f) (-2)‘(7(1 4 

r )'. Such a sequence of events can be repealed ad 
m/initiwh and it is clear that the vector .i(/) will 
diverge if f < I. 

(c) The prtijcclion algorithm (as well as several 
other algorithms) for variational inequalities. Here, 

X = t\ X, c is a closed convex set, / ; A' is a 

I ' 1 

given function, and wc are looking for a vector x* e X 
such that 

(x - x*yf{.\*) H). V.xe A'. 

The projection algorithm is given by \ : = |x - yf (x)] ‘, 
where [ )' denotes orthogonal projection on the set 
X. Totally a.synchronous convergence to x* is 
obtained under the assumption that the mapping 
x^x~yt{x) is a maximum norm contraction 
mapping, and this is always the case if the Jacobian of 
/satisfies a diagonal dominance condition (Bertsekas 
and Tsitsiklis, 19H9h). Special cases of variational 
inequalities include constrained convex optimization, 
solution of systems of nonlinear equations, traffic 
equilibrium problems under a user-optimization 
principle, and Nash games. Let us point out here that 
an asynchronous algorithm for solving a traffic 
equilibrium problem can be viewed as a model of a 
traffic network in operation whereby individual users 
optimize their individual routes given the current 
condition of the network. It is natural to assume that 
such user-optimization takes place asynchronously 
Similarly, in a game theoretic context, we can think of 
a set of players who asynchronously adapt their 
strategies so as to improve their individual payoffs. 
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and an asynchronous ileraiion can he used as a mixlcl 
of such a situation. 

(d) Wavefonn relaxation methods for solving a 
sntem or ordinary differential equations under a weak 
a>upling assumpuon (Mitra, as well as for 

rwo-poini boundary value problems (Lang et a/., im, 
Spiien. 19M; Bensekas and Tsitsikiis, lW)h) 

Other studies have dealt with an asynchronous 
Newton algorithm (Bojanezyk, 19^U), an agreement 
problem (Li ami Basar. 1^)871. diagonally ck^mmant 
linear programming problems (Tseng, 1^)), and a 
\ancty of infinite-dimensionaJ problems such as 
nartial differential equations, and varuitional in 
equalities (Spilcri, 1MK4, l‘>86; Miellou and Spiteri, 
19H5, Anwar and El Tarazi, 198;^) 

In the case of maximum norm contraction mappings, 
there Hie some ctinvergencc rale estimates available 
which indicate that the asynchronous iteration 
converges faster than its synchronous counierf'iart, 
especially if the coupling Iwiwccn the dilfercni 
comptments of m is relatively weak Let us suppose 
that an update bv a pn.>cess4)r lakes one time unit and 
ihai the communication delays are always equal to /> 
lime units, where i) is a positive integer With a 
synchronous algonlhm. there is mu* iteration every 
/) t 1 time units and the “error ' IIaIi) - 1*11 can be 
N)undcd by where ( is some constant 

(depending on i(0)) and a is (he contraction factor of 
(b 2) Vk'C now consider an asynchronous execution 
whereby, at each lime step, an iteration is |X‘rformed 
hv each pnKcsM>r t and the result is immeduilcly 
tiansniitled to the other priKCs^irs I'hus the values of 
i (/^ i) which are used hv poKessor / arc always 
outdated by D lime units. C onccrning the function /, 
we assume that there exists some scalar fi such that 
0 - /> ' a and 

.v:iL 

max { a ||.i, - a^ max i (6.4) 

It IS seen that a small value of fi corresponds to a 
situation where the coupling iKlwecn different 
components of a is weak Under condition (6 4), the 
convergence rale estimate for the synchronous 
Iteration cannot be improved, hut the error 
liA(i)“ A*|| for the asynchronous iteration can be 
shown (Bcrlsckas and Isilsiklis, 19H9b) to be bounded 
above by (ft', where ( is some constant and /» is the 
positive solution of the equation p - max {a, lip 
It IS 'lot hard It) see that p' and the 

.isynchronous algonlhm converges faster 'Fhe ad 
vantage of the asynchronous algorithm is more 
pronounced when fi is very small (very weak coupling) 
in which case p approaches a The latter is the 
convergence rate that would have been obtained if 
there were no communication delays at all. Wc 
conclude that, for weakly coupled problems, asyn¬ 
chronous Iterations are slowed down very little by 
communication delays, m sharp contrast with their 
synchronou.s counterparts 


6.2 MmuHone nmppingjii 

C'oniiider a fuiwriion / : JF' iff* which is con- 

tmuixis. monotoiK (ihai is, if a v then f {t) ^ /( >')|. 

and has a unique fixed poini a* Furthermore, luksume 
that there exist vccfois u, v, such that /(w)^ 
/(lO i' li we lei /* be the a>mposition of k copies of 
/ and Jfi'(k)’* (a a / then Pro|>«xMiion 

3 ap|ihcs ttpd establishes totally asynchronous 
ainvergcncc Tlie afHive slated conditions on f arc 
saltvhed by the iteration mapping txincsponding to the 
siHxxsxive approximation (value deration) algorithm 
for discounted and ixrtain undiscounted infiniic 
hori/on dynamic progiamming problems (Bertsekas, 
19H2) 

An im|>orlani .special case is the asyiKhronous 
Bellinaii lord algorithm for the shoricsl path 
problem Ifcie wc arc given a directed graph 
a (\. A), with .V * (1. , n) and lor each arc 

(i, a weigh! representing its length T'he 

problem is to ciimpute the shortest distance i from 
every node i io node 1 We assume that every cycle 
not a)ntainiiig node 1 has positive length and that 
there exists at least one path from every ritide to ruxle 
1 Iheii, the shortest distances correspond to the 
unique fixed tx>int of the monotone mapping 
/ delined hv /,(i) ^ () and 

/(i ) - min (n., c ). / / I 

1>ie Bellman Foid algorithm consists of the iteiiilum 
i -■ f{x) and can In* shown to lonverge asynchro- 
mnisly (Tajibnapis. 1977, Hertsekas, 1982) We now 
compare the synchronous and the asynchronous 
versions W'c assume that Ivotii versions are iniliali/ed 
with A, - lor every / / I, which is the most eommon 
choice Ihe synchronous iie ration is known to 
converge after at most n iterations. However, 
assuming (hat Ihe comnuinication delays from 
proccssiir / to / are hxcJ to some constant and that 
the compulation time is negligible, it is easily shown 
that the asvncluonous iteration is guaranteed to 
Icimmalc earlier than the synchronous one. 

Notice that the number o( messages exchanged in 
the synchronous Heilman ford algorithm is at most 
n\ lliis IS fxcHuse there are at most n stages and at 
most n messages are Iransmilled by each priHrcsMU at 
each stage InlcrcMingly enough, with an asynchro¬ 
nous execution, and il the communication delays are 
allowed to lx* arbitrary, wnne simple exam()les (due to 
I:. M (iaini and H (r (iallager; sec Berfsekas and 
Isflsiklis. 19H9b) show that the number of messages 
exchanged until lerminalton could lx: cxfHmcntial in 
n, even if wc* reslncl prf>eessf)i t to iran.smit a message 
only when the value of a, changes. I'his could be a 
serious drawback but experience with the algorithm 
indicates that this worst case behavior rarely occurs 
and that the average number o( messages exchanged is 
polynomial in n It alst) turns out that the expected 
number r»f messages is polynomial in n under some 
rca.sonablc probabilisiic assumptions on the execution 
of the algorithm ( Isitsiklis and Siamoulis. IWI) 

A number of asynchronous convergence results 
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making essential use of monoionicity c^inditions are 
al.Mi available for relaxation and pnmal-dual algo¬ 
rithms for linear and nonlinear network flow 
problems (Fierlsekas, Bertsekas and Licksicin, 

19H8, Bensekas and PI Baz, IMH7, Bertsekas 
and (astanon, 1MH9. Pxperimcnls showing 

faster convergence for asynchronous over synchronous 
relaxation methods for assignment problems using a 
shared memory machine are given in Bertsekas and 
Castonon 

We finally note that, under the monoionicity 
assumptions of this subsection, the convergence rate 
of an asynchronous Iteration is guaranteed to be at 
least as good as the convergence rale of a 
corresponding synchronous iteration, under a fair 
comparison (Bertsekas and Tsilsiklis. 

7 PAK I IALI Y ASYN( IIHONOlAS AlXiC)KI I HMY I 

We now consider iterations satisfying the partial 
asynclironisrn Assumption 2. Since <»ld information is 
“purged ’ from the algorithm after at most H units, it 
IS natural to desenhe the “state ' of the algorithm at 
time f by the vector *;(/) f A'" defined by 

7(0-(ir(0. - 1).0/ “ /f+ 1)) 

We then notice that i(r r 1) can be determined |cf 
(S I) (5 3)| in terms of 7(0, m particular, knowledge 
ol x(r). (or T " t H is not needed. W'e iissurnc that 
the Iteration mapping / is continuous anti has a 
nonempty set A * c A‘ of (ixed points. Let /* be the 
set of all vectors A" of the ftirm - 

(i*. 1 *. , , i*). where x* belongs to A *. We 

present a sometimes useful cimvergence result, which 
employs a l.yapunov type function d defined on the 
set A'^'. 

rrof)f).sin{fn 4 (Bertsekas and Tsilsiklis, IMSMb) 
Suppose that there exist a jKisiiivc integer r* and a 
eontiinu)Us function d ^) with the ttdlowmg 

properties Lor every initialization 7(0)^/* ol the 
Iteration and any subsequent sequence of events 
(conforming to Assumption 2) we have d(7(r*)) 
f/(7(())) and d(z{\))^ f/(7(())) 1 hen every limit point 
of a .se(|uenee (7(r)) generated by the parriallv 
asynchronous iteration f.S.l) (SJ) belongs to /A 
f urthermore, if A' -- if the liinetion d is of the 
form d{z) - inf ||: 7*||. where |i || is some veenu 

. ■ t / * 

norm, and if the funetion / is of the form 
l (\ ) - Ax 4 h. where A is a n x matrix and h is a 
vector in then d(z{t)) converges to zero at the 
rale <q a geometric progression. 

For an interesting application of the above 
projHisition. consider a mapping f : .iff’'*--* of the 
form /(I) A* where A is an irreducible siiKhaslie 
matrix, and let n, - 1 lor each i. In the corresponding 
Iterative algorithm, each proce.ssor maintains and 
commumeates a value of a scalar variable a, and once 
in a while forms a convex combination of its own 
variable with tfu variables received from other 
processors according to the rule 



C learly, if the algorithm converges then, in the limit, 
the values possessed by different prtKessors are equal 
We will thus refer to the asynchronous iteration 
X — Ax as an agremien/ algorithm It can be shown 
that, under the assumption of partial asynchronism, 
the function d defined by 

d(7(r)) = max max i,(t) mm min xAr) (7.1) 

f , ft r , ft I 

has the priiperties assumed in Proptisition 4, provided 
that at least one of the diagonal entries of A is 
positive. In particular, if the processors initially 
disagree, the “maximum disagreement ’ (cf. (7.1)] is 
reduced by a ptisitive amount after at most lime 
units (Isilsiklis. 19K4). Proposition 4 applies and 
establishes geomeine convergence to agreement, 
furthermore, such partially asynchronous conver¬ 
gence is obtained no matter how big the value of the 
asynchronism measure B is, as long as B is finite 

llie following example (Bertsekas and Tsitsiklis, 
lMH9h) shows that the agreement algorithm need not 
converge totally asynchronously. 

lixamplt* 2 Suppose that 

1/2 1/2 

Merc, the synchronous iteration v(/Yl)^Ax(/) 
converges m a single step to the vector .i -(v, y). 
where v - (a i-t . )/2 ( onsider the following totally 
asynchronous scenario Lacli processor updates its 
value at each time step At certain limes r,. / , , , 

each processor (lansriiits its value which is received 
with zero delay and is inunedialclv ineorprirated into 
the compulations ol the other processor We then 




ri(M 

t (fi) 

A,(/ -t 

1) 


X 


1 


1) 

vdr* 1 

I \.(/) 

vAr + 

1 

-f ■ 

1 


(See } ig. S tor an illuslralion ) I hus, 

A,(/. .,)-(l/2)'‘ ■ (1 -(1/2)'*’ 

i,(6m)-( 1/2)'* ' (1 - (1/2)'* ' '‘)v,(fi)- 

Subtraelmg these two equations we obtain 

v,(A.,)|-(l -2(1/2)^-’ '*)|.v;(/j-A,(rJ| 
- (1 ■ |r;(fi) - v,(r.)|. 

where r* =2(1/2)'* ' '*, In particular, the disagree¬ 
ment Ii,(6 ) - vdr* )| keeps decreasing. On the other 
hand, eoiivcrgcnce to agreement is not guaranteed 

unless M (I - cO - b which is not necessarily the 

K \ 

case FAu example, if we chcxvse the differences 
14 ., to be large enough so that r* <k \ then we 

can use the fact II i \ - k ) > 1) to sec that 

A I 

convergence to agreement does not take place. 

Example 2 shows that failure to converge is po.ssible 
if part (b) of the partial asynchronism Assumption 2 
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(aMs til hold There alwi exist examples dcrrumslratiiig 
thai parts (a) and (c) of /\Nsunip(ion 2 are also 
necessary for convergence 

f xampic 2 illustrates hest the convergence mecha¬ 
nism in algorithms which converge parliallv asynchio- 
noiisly for every h. but not totally asynchronously 
The key idea is thal the distance from the sc*t of fixed 
p<iinls IS guaranteed to contract' once m a while 
However, the contraction factor depends on /? and 
approaches I as fi gets larger (In the context of 
I:x:implc 2. the contraction laclor is 1 i* which 
approaches 1 as - r* is mcieased to infinity ) As 
I'me goes to inhnity, the distance from the set of fixed 
(V,lints IS contracted an infinite numlxT of times hu( 
this guarantees convergence only il the contracliori 
factor IS hounded away from 1, which then 
necessitates a fimle hut otherwise arhitrarv hound on 
H 

Partially asynchronous convergence for every value 
of H has been established for st'veral variations and 
generali/ations of the agreement algorithm (Isitsikliv. 
1VH4; Hertsekas and I silsiklis. 1^8%). as well as for a 
variety of other problems: 

(a) The hcraiion .t ■ nT for the compulation of a 
row vector tt of invariant probabilities, associaled with 
an irreducible stcKhaslic matrix T with a non/ero 
diagonal entry (Luhachevsky and Mitra. IMHh) Tins 
result can he also obtained by lelling 

where tt* is a positive vector satisfying - jiP. and 
by verifying (hat the variables Ji, oficy the equations of 
the agreement algorithm (Hertsekas and IviiMklis. 
198%) 

(b) Relaxation algorithms involving nonexpans- 

ivc mappings with respect to the maximum norm 
(Tseng et al , H>90; Hertsekas and Tsiisiklis, 198%) 
Spc'cial cases include dual relaxation algorithms for 
strictly convex network flow problems and linear 
Iterations for the solution of linear equations of the 
form Ax - /), where A is an irreducible matnx 
satisfying the weak diagonal dominance condition 
^ for all I. 


(c) An asynchionous algorithm for load balancing 
in a computer network whereby highly loaded 
prtKcssors transfer fractions of then load to their 
lightly loaded neighbors, until the load of all 
processors Ivecomes the same (Bertsekav and Tsirs- 
iklis, 19K%) 

In all of the above cases, partially asynchronous 
convergence has Ix^cn proved li>r all values of fi, and 
examples are available which demonstrate that foliilly 
asynchronous convergence fails 

We close by mentioning a particular context in 
which ilic agreement algorithm could be of use. 

( onsider a set of prinessors who obtain a sequence of 
noisy observations and try to estimate certain 
parameters by means of some iterative metlnnl 'I1hs 
could fx‘ a stiH'hasiic gradient algontlmi (such as the 
ones arising in recursive system identification) or some 
kind of a Monte C arlo estimation algorithm All 
prixessors arc employed for the estimation of the 
same parameters but ihcir individual estimates are 
generally dillerenl because the noises corrupting their 
observations can be dillerenl WT* lei the prixessors 
communicate and combine ihcir individual estimates 
in order to average their individual noises, thereby 
reducing the error variance We thus let the 
prixcsMirs execute the agreement algorithm, trying to 
agree on a common estimate, while smiuliarieoiisly 
obtaining new obsc^rvations which they irudrp<»rale 
into their estimates Iherc are two opposing eflccis 
here the agreement algorithm lends to bring their 
estimates closer together, while new observations 
have the potential of increasing the difference of fheir 
cslimaics Under the partial asynchromsm assump¬ 
tion, the agreement algorithm tends to converge 
gcomclricaily On the other hand, in several stcxhaslic 
algorithms (such as the sKKhaMic approximation 
iteration 

x :®' r - - (Vf (r) -r w), 

where w represents observation noise) the slcpsizc 1/r 
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decrca<kcs lo zero as tinu! g<i>cs lo inhnily. Wc then 
have, usymplotically, a separation of time scales; the 
stochastic algorithm operates on a slower time scale 
and therefore the agreement algorithm can be 
approximated by an algorithm in which agreement is 
instantly established. It follows that the asynchronous 
nature ol the agreement algorithm cannot have any 
adverse effect on the convergence of the stochastic 
algorithm Rigorous results of this type can be found 
in rsitsiklis (1984). Isilsiklis t't at. (198f)); Rushner 
and Vm (J9H7a, b); Uerlsckas and 'Fsitsiklis (19H9b). 

H PARMAIJ.Y ASYNf IIRONOUS A1 (R )KI I HM.V fl 

Wc now turn lo the study of partially asynchronous 
iieralions lhat converge only when the stepsi/e is 
small We illustrate the behavior of such algorithms in 
terms of a prototypical example 

l.el A be an n x n positive definite symmetric 
matrix and let h be a vector in We crjnsider the 
asynchronous iteration * ;= r y(/lx ■ /)), where y is 
a small positive stepsize. We define a cost function 
/ by f{x)- 'x'/4x x‘h, and our iteration 

IS equivalent lo the gradient algorithm t:- i - 
y V/‘ (x) for minimizing /• I his algorithm is known lo 
converge synchronously provided that y is chosen 
small enough On the other hand, it was shown in 
I'xampic I that the gradient algorithm does not 
converge totally asynchronously furthermore, a 
careful examination of the argument in that example 
reveals that for every value of y there exists a H large 
enough such that the partially asynchronous gradient 
algorithm does nol converge. Nevertheless, if y is 
fixed lo a small value, and if H is not excessively large 
(we roughly need H “ ( /y. where ( is some constant 
determined by the structure of the matrix A), then the 
parliully asynctironous iteration turns out to be 
convergent An equivalent statement is lhat for every 
value t)f H there exists some y„ (I such that if 
d" y' y.i then the partially asynchrr)nous algorithm 
converges ( IsUsikli.s t7 ai, 1988; Berlsekas and 
Tsilsikhs, |989h). I'hc rationale behind such a result is 
the hRIowing, If the infoimalion available io 
processor i on ihe value of \, is ouUlaleil by at most H 
time units. Mien the difference between the value 
possessed by processor i and the true value 
x,(r) IS of the order of y/f. because each step taken by 
processor j is of the order of y. It follows (hat for y 
very small the errors caused by asynchronism become 
negligible and cannot destroy the convergence of the 
algorithm, 

riie above mentioned convergence result can be 
extended lo more general gradicnl-like algorithms for 
nonquadratic cost functions F. One only needs lo 
assume that the iteration is of the form i : ~ x ~ y.v(x ), 
where a(.\ ) is an update direction with the property 
s,(x)V,F(x) ^ K \V,F{\)\^, where K is a positive 
constant, together with a Lipschil/ continuity 
condition on ^F, and a boundedness assumption of 
the form ||v( r)|| - / ||Vf'(v)|| (Tsilsiklis et al.. 1986; 
Hertsekas and Tsilsiklis, 19H9b). Similar conclusions 
arc obtained tor gradient projection iterations for 
constrained convex optimi/atioii (Bertsekas and 


l.silsiklis, 1989b). 

An important application of asynchronous gradieni- 
likc optimization algorithms arises in the context of 
optimal quasistatic routing in data networks. In a 
common formulation of the routing problem one 
is faced with a convex nonlinear multicommodity 
network flow problem (Bertsekas and Gallager. 1987) 
that can be solved using gradient projection methods. 
It has been shown lhat these methods also converge 
partially a.synchronously. provided that a small 
enough stepsize is used (Tsitsiklis and Bertsekas. 
I9H6). Furthermore, .such methods can be naturally 
implemented on-line by having the prixessors in the 
network a.synchronously exchange information on the 
current traffic conditions in the system and perform 
updates trying to reduce the measure of congestion 
being optimized. An important property of such an 
asynchronous algorithm is that it adapts to changes in 
the problem being solved (such as changes on the 
amount of traffic to he routed through the network) 
without a need for aborting and restarting (he 
algorithm. Some further analysis of the asynchronous 
routing algorithm can be found in Tsai (1986, 1989) 
and Tsai c( al. (1986). 


9 f fiKMINA IION OF ASYNC HRONOUS 
irFHATlONS 

In practice, iterative algorithms are executed only 
for a finite number of iterations, until .some 
termination condition is satisfied, in the case of 
asynchronous iterations, the problem of determining 
whether termination conditions are satisfied is rather 
difficult because each prixessor possesses only partial 
information on the progress of the algorithm. 

Wc now introduce one possible approach for 
handling the termination problem tor asynchronous 
Iieralions. In this approach, the problem is decom¬ 
posed into two parts; 

(a) An asynchronous iterative algorithm is modified 
so that It terminates in finite time. 

(b) A special procedure is used to delect termination 
in finite lime after it has occured. 

In order lo handle the termination problem, wc 
have to be a little more specific about the model of 
inlerprcK'essor communication. While the general 
model of asynchronous iterations introduced in 
Section can be used for both shared memory and 
message-pa.ssing parallel architectures, we adopt here 
a more explicit message-passing model. In particular, 
wc a.s.sume that each processor j sends messages with 
the value of x, lo every other prcKxsssor r. PrcKCSsor i 
keeps a buffer with the most recently received value of 
X,. We denote the value in this buffer at time / by 
x:J(^)- This value was transmitted by processor j at 
some earlier time r|(r) and therefore x',(/) = x,(tX 0) 
We also assume the following. 

Asxumption 3. (a) If r e T' and x,(r-f 1) ^X;(t). then 
processor i will eventually send a message to every 
other processor. 

(b) If a processor i has sent a message with the 
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value of xXO u> some other pnxessor /, then 
pnxessor i will send a ncw» message to processor / only 
after the value of x, changes (due to an update hv 
prixessor i ). 

(c) Messages arc received in the onkr that they are 
transinittcd. 

(d) Each prtKcssor sends at least one message to 
every other processor. 

Assumption 3(d) is only needed to get the algorithm 
started. Assumption 3(h) is crucial and has the 
following consequences If the value of ilO settles ti» 
vjme final value, then there will he some time i* after 
which no messages will he sent Furthermore, all 
messages transmitted hefore r* will eventually reach 
iheir destinations and the algorithm w'lll eventually 
reach a quiescent state where none of the vanahles i, 
changes and no message is m iran.sit Wc can then sa> 
that the algorithm has terminated 

More formally, we view termination as equivalent 
to the following two properties 

(i) No message is in transit 

(ill An update by some piAKxssor / causes no change 
m the value of x, 

Property (ii) is a collection of Uxal termination 
conditions. There arc several algorithms lo? iermma 
lion detection when a termination condition can he 
decomposed as afvive (I)ijkslra and Scludien. 
Beilsckijs and Isilsiklis. IMSMh) Ihus termination 
detection causes no essential difficulties, under the 
assumption that the asynchronous algorithm tcrmin 
ales in finite time 

We now turn lo the mure diflicult problem ot 
converting a convergent asynchronous iterative 
algorithm into a finitely terminaling one If wc were 
dealing with the synchronous iteration 1) “ 

/( r(f)). It would be natural to terminate the algorithm 
when the conditmn !ii(r + I) A(r)!|“: r is satisfied, 
where f is a small positive constant reflect mg the 
desired accuracy of solution, and where || || is a 
suilahle norm This suggests the following approach 
for the context of asynchronous iterations (nven the 
iteration mapping / and the accuracy parameter r. we 
define a new iteration mapping g \ * ^ A' by letting 

/(.i) lf|||(x')~xj c. 

X,. otherwise 

Wc will henceforth assume (hat the pnxessors are 
cxecLfing the asynchronous iteration .x:-g(x) Tlie 
key question is whether this new iteration is 
guaranteed to terminate in finite time One could 
argue as follows. Assuming (hat the onginal iteration 
X =/fx:) is guaranteed lo converge, the changes in the 
vector X will eventually Ixicomc arbitrarily small, in 
which case wc will have g(x)“x and the iteration 
x; = g(x) will terminate. Unfortunately, this argument 
is fallacious, as demonstrated by the following 
example. 


Example 3. Consider the function f - 


defined hy 




/:(»' ) A;/ 


/I 


ifx,i-«/2. 

if i:< c/2, 


It IS deaf that the asyitchronoas iteiiition 
converges to i* w (0 p) m particular, .t * is iipdated 
according to x , and tends to rero, thus, ii 

cveniually becomes smaller than c /2 Fventually 
prcK'ciysor 1 reaives a value of x . smallei than f /2 and 
a subsequciil ufxlate by the same procemii sets i , lo 
zero 

l et us mm auisider the iitriilion i w*gi(x) If the 
algorithm is mmali/cd with i l>etwecn c/2 and c, 
then the value ot X; will nevei change, and pioeesMvr 1 
will keep cxmiung the nonconvergent iteration 
X, ;- - X, llius, the asynchronous iteration x «g(x) 
IS not guiuaniced lo terminate 


llie remainder of this section is ilcvoled lo the 
denvHiion of conditions under which the iteration 
X -g(x) IS guaruntcerl to irrmmate We introduce 
Mime notation let / lx* a subset of the .set { U . p) 
o( all poHcssors For each m /. lei there be given 
r,ome value i A', W\* consider the asynchronous 

Iteration i •■ /'"(i). which is the same as the 
ilcraiion t ■ f[\ ) except that any eomponeni x,. with 
1 r /. IS set lo the value Formallv, ^he mapping /'" 

IS defined by letting ”(x ) /(i). if r #/, and 

i;"(x) fU if i t / 


/VopoM/ion (Berlsckas and Isitsiklis, l^K9a) IvCt 
Assumption } hold .Suppose that (or any la 
(I. .p) and lor any choice of N, m /. the 

asynchronous itenilion x /''V») is guaranteed lo 
converge fhen. the asynchronous iicrulion x ®e(x) 
(enniriaics m (mile lime 

PnHtf ( inisider the asynchronous itcnition x 
I el / be the sel of all mdiees / lor which the variable 
i,(M changes only a finite number of times ITir each 
I ( /, let be I he limiting value of xdt) Since / maps 
A' into iivtdf, so docs g It follows that f/ c A', for each 
I f or each t f I, processor i sends a positive but finite 
number of messages | Assumptions 3(d) and (b)) By 
Assumption 3(a), the last message sent by prinressiir i 
carne.s the value If, and by Assumption 3(c) this is also 
the last message received by any olher prexessor. 
llius, for all t large enough, and lor all j, wc will have 
rift) - x3T,(M) - f^. Thus, the iteration x :« g(x) 
eventually becomes idcnitcal with the iteration 
X ^ "(x ) and therefore converges. This implies that 

the diftcrence x,(r 4 1) - x,(0 converges to zero for 
any t f I. On the other hand, because of the definition 
of the mapping f(, the difference x^i! ^ I) ~x,(r) is 
either zert>, or its magnitude is bounded below by 
€ >0 It follows that x,(t 4 I) - x,(t) eventually sctUcs 
lo /e:ro, for every / I / I1iis shows that i c / for every 
lil, we thus obtain a contradiction unless 
i I.p}, which proves the desired result. O F O. 

Wc now identify certain cases in which the main 
assumption in Proposition S is guaranteed to hold. We 
consider first the case of monotone itcratiom and wc 
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aMume thal the ilcralion mapping/has rhe properties 
intr(xluced in Section 6.2, For any / and {0, \ie !), 
the mapping inherits all of the properties of /. 
except that is not guaranteed to have a unique 
fixed point If this latter property can be independ¬ 
ently verilied, then the asynchronous iteration 
X f' ^{x) is guaranteed to converge, and Proposition 
^ applies. Let us simply say here that this property can 
be indeed verified lor several interesting problems. 

IvCt us now consider the case where / satires the 
contraction condition ||/(j ) - r *11 r o ||j:--jr*|| of 
(6.2), Unfortunately, it is not necessarily true that the 
mappings f'^ also satisfy the same contraction 
condition. In fact, the mappings arc not even 
guaranteed to have a fixed point. Let us strengthen 
the contraction condition of (6.2) and a.ssume that 

ll/tx) -/( v)|| - O \\x - v||. Vx, >’ f (9.1) 

where || ■ || is the weighted maximum norm of (6.1) 
and n c [0, 1). We have /' "( r) - /"V v) - ff, ” = 0 

for all i e A Thus, 

Wf'XO- /■'■"( v)ll - niax * Uix)-f.(v)\l 
max ■ ll/Xr ) -“/d.v)||. 

' Vi', 

- Wfix) -fiv)\\ • n ||x - y||, 

Hence, the mappings f'** inheril the contraction 
properly (9 1). As discussed m Section 6. this 
property guarantees asynchronous convergence and 
therefore Proposition S applies again 

We conclude that the modification a :"" g(.r) of the 
asynchronous iteration x:- /(v) is often, but not 
always, guaranteed to terminate in hmlc time It is an 
interesting research question to devise economical 
termination procedures (or the iteration v - fix) that 
arc always guaranteed to work The snapshot 
algorithm id (/handy and Lamport (19H.S) [see 
(Bertsekas and Tsitsiklis, I9K9, Section H 2)| seems to 
he one option. 

10 (ONt I USIONS 

Iteiativf algorithms are easy to parallelize and can 
he executed synchronously even in inherently 
asynchronous compuling systems. Furthermore, for 
the regular communication networks associated with 
several common parallel architectures, the com¬ 
munication requirements of iterative algorithms arc 
not severe enough to preclude the possibility of 
massive parallelizalion anti speedup of the compula¬ 
tion Iterative algorithms can also he executed 
asynchronously, often without losing the desirable 
convergence properties of their synchronous counter¬ 
parts. although the mechanisms that affect conver¬ 
gence can he quite different for different types of 
algorithms. Such asynchronous execution may offer 
substantial advantages in a variety of contexts. 

At present, there is very strong evidence suggesting 
that asynchronous iterations converge faster than their 
synchronous counterparts. However, this evidence is 
principally based on analysis and simulations. There is 
only a small number of related experimental works 
using shared memory machines. Tliese works support 


the conclusions of the analysis but more testing with a 
broader variety of computer architectures is needed to 
provide a comprehensive picture of the practical 
behavior of asynchronous iterations. Furthermore, the 
proper implementation of asynchronous algorithms in 
real parallel machines can be quite challenging and 
more experience is needed in this area. Finally, much 
remains to be done to enlarge the already substantial 
class of problems for which asynchronous algonthms 
can be correctly applied. 
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A Frequency-domain Estimator for Use in 
Adaptive Control Systems* 

RICHARD O 1.AMAIRF4. l-FNA VALAVANHil. MK'HAHl ATI!ANSI 

and CrUNTFR SIlrlNIit 

A robust esrimution lechnufue, tiex'eloped for adaptive control systems, 
finds both a parametrized model and a correspondinf; frequency-domain 
error bounding function. 

Ke) Words Adaplivc coniroi, idciuitic^iinh: licqucruv dotiHiin. cshiiulum, puiamcici 
iransftr funcii^ms; robusi 


AbiKirafI—This pafXT prcscnis a (rcqucTRA-ilomain cviiimiior 
ihai can idcniify U>lh a par.iincin/cd noniifial miHkl fd a 
plant as well as a Ircqucncy domain U>iiiidin^ limiimn on 
(he miKlcling error avsiKialcd with this nominal riuKlcl ITns 
cslim.itoT, which wc call a rohusi cMimaioi, can Ix' used in 
conainction wiifi \ rohiisl control law rcdcsipn al^ronthni to 
form a rohuM ada(>livc controller 


1 INIRODI tqU)N AM) MOIIX ATION 
Ihi rsf 01 feedback conlrol in systems having 
larp,e amounts of uncerlaiiuy requires llie use of 
al^itnthms that learn or adapt m an on-line 
situation A control system that is designed using 
only ii priori knowledge results in a relatively 
low liandwidlh closed-U>op system so as to 
guarantee stable operation m the face of large 
uncertainly. An adaptive conlrol algorithm, 
which can identify the plant on-line, thereby 
decreasing the amount of uncertamlv, can yield 
a closed-loop system that has a higher bandwidth 
and thus better performance than a non-adaptive 
algorithm There are many problems with the 
adaptive conlrol algorithms that have been 
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developed i(v dale. In particular, most adaptive 
conti jl algorithms are not robust to unrm>dclcd 
dynamics and an unmeasurable disturbance, 
particularly in the absence of a [X*rsistently- 
exciiing input signal. 

In this section, we wall motivate the robust 
estimation problem l>y (irsl discussing the 
adapiive conlrol problem, in general, and then 
presenting a perspective on the robust adapiive 
control problem l urther. we justify the choice 
of an infrequent adaptation strategy before 
discussing the mam (ocus of the pajxr, the 
development of a robust estimator 

StuhiJiiY of aduptn^e conlrol alf^orithrm 

I'hc use ot adaptive conlrol yields systems that 
are nonlinear and lime-varying 'I*hus, the 
stability of these systems depends on the inputs 
and disturbances, as well as the plant (including 
any unmodeled dynamics) and the compensator 
However, the stability properties of a linear 
lime-invariant (ITI) feedback system depend 
only on the plant and eompcmsalor, not the 
inputs and disturbances Because of this tact, we 
lake the point of view that it is desirable to make 
the system ^as T FI as [>os,sible’' 

Fhe preceding argument can be used to justify 
an infrequent conlrol law redesign strategy. It is 
envisioned that a discrele-timc estimator will he 
used to continually update the fiequcncy-domain 
estimate of the plant as long as there is useful 
information in the input/output data of the 
plant 'Hic plant is in a closed loop that is 
controlled by a discrcic-limc compensator that is 
only infrequently updated (redesigned). It can 
he shown that if the comptrnsator is redesigned 
sufficiently infrequently, then (he ITI stability of 
the ‘‘frozen"' system at every point in time 
guarantees the exponential stability of the 
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time-varying system. In this way, the control 
system hmks nearly LTl and consequently is 
more robust to disturbances than a highly 
nonlinear adaptive controller. It is emphasized 
here that a robust adaptive controller that slowly 
learns and produces successively better LTI 
compensators is Ihc end product envisioned in 
this paper. However, the paper aims to develop 
only the estimation part of this robust adaptive 
controller and docs not provide prew^fs concern¬ 
ing the research issue of adaptive control system 
performance (i.e. whether or not the resulting 
compensators are better for control) On the 
other end of the adaptive control spectrum are 
algorithms that quickly adapt to a changing 
system. As mentioned earlier, these types of 
controllers have poor robustness properties in 
that they are highly sensitive to unmodeled 
dynamics and unmeasurable disturbances, par¬ 
ticularly in the absence of persistent excitation. 

A perspective on the robust adaptive control 
problem 

With the siilution of the adaptive control 
problem for the ideal case—that is, when there 
arc no unmodeled dynamics nor unmeasurable 
disturbances—the problem of robustness has 
become a focus of current research. Recently, a 
new perspective on the robust adaptive control 
problem has appeared in the literature (Good¬ 
win et ai, 1985a). Briefly, a robit\'t adaptive 
contriyller is viewed as a combination of a robust 
estimator and a robust control law. This is an 
appealing point of view. For example, if the 
robust estimator is not getting any useful 
information and consequently, is not able to 
improve on the current knowledge of the plant, 
then the adaptation aspect of the algorithm can 
be disabled and the adaptive controller reduces 
to a robust control law; that is, in a situation 
where the adaptive algorithm is not learning, the 
adaptive controller becomes simply the best 
robust LTI control law that one could design 
based only on a priori information and any 
additional information learned since the algo¬ 
rithm began. 

Brief statement of the robust estimation pnfblcm 

The main focus of this paper is the 
development of a robust estimator for use in an 
adaptive controller. In non-adaplivc robust 
control, the designer must first obtain a nominal 
model along with some measure of its goodness. 
A practical measure of goodness is a bounding 
function on the magnitude of the modeling 
errors in the frequency-domain. Since non- 
adaptive robust control requires these steps, the 
same steps must implicitly, or explicitly, be 


present in a robust adaptive control scheme, the 
difference being that the .steps are carried out 
on-line rather than off-line. Thus, we a.ssume 
that our robust estimator must supply (1) a 
nominal plant model and (2) a frequency-domain 
bounding function on the magnitude of the 
modeling uncertainty between the true plant and 
this nominal model. So, the robust estimator 
musi provide an estimale of the parameters for 
the structure of the nominal model, as well as a 
frequency-domain uncertainty bounding function 
corresponding to this nominal model. As will be 
clarified later, the robust estimator requires an a 
priori bound on the unstructured uncertainty 
associated with the structured nominal model of 
the plant. It is the goal of the robust estimator to 
reduce the structured uncertainty and to bound 
the total uncertainty, which is composed of br)th 
structured and unstructured uncertainty. 

Given the information of 1 and 2 above, 
several robust control-law design methodologies 
could be used, including the LQG/LTR design 
methodology (Athans, 1986). The envisioned 
adaptive control system is illustrated in Fig. 1. In 
this paper, we will use a discrete-time model of a 
sampled-data control system. 

The robust estimator presented in this paper 
differs from most other estimators in that it 
provides guarantees concerning the current 
estimate of the nominal model of the plant. This 
requirement is essential if the estimator is to be 
used in a robust adaptive control situation. If the 
estimator cannot provide guarantees about the 
model it provides to the control-law redesign 
algorithm, then the redesign algorithm cannot 
guarantee stability of the closed-loop system. We 
will use a deterministic framework throughout 
the paper, since guarantees of stability are 
sought. 

Related literature 

Recently, there has been growing interest in 
the use of frequency-domain methods for the 

Pl^pi Dislurtjancf? 

(including unrnodo'Rd 
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estimation of modeling uncertainty in the 
context of robust adaptive control Thi$ work 
has its rtK>ts in the area ol transfer functum 
estimation. For an insightful discussum of 
transfer function estimation, bras distribution 
and many references, see Ljung (1^X7) Kosut 
1M87) has developed an approach hn 
adaptive uncertainty modeling and on-line 
robust control design. In this work, the 
least-squares nicihml is used to estimate the 
parametric model and a standard spectral 
estimator is used on the residual outpui error 
resulting in a crude bound on the unmodelcd 
dynamics and disturbance spectrum In Kosut 
a parameter ve/ estimator is devclojx'd 
which provides a scl of parameter values, and 
hence, a measure ot parameter estimation 
accuracy. These results are similar to iluise 
reported in Morrison and Walker ( Both 

our work and Kosut s make use of the 
[reijiicncy-domain eslimadon work of l.jiing 
( 1^87). Ljung analyzed the properties oi 

ihe emf)incal transfer funenon estimatr 
(I ILL), which IS cornpuled using the Lourier 
transforms of finite length mput/oulput data of 
the plant. In Ljung (1^87), a Lonslanl hound on 
the effects ol using finile-lcngih data to compute 
the 1! I LL is developed, (or strictly stable plants 
Lhis work provided ihc hackground lor our 
development in Section 4 1 ol a lirne-varving 
ircquency-domam error l»ouiuling funtiion that 
IS computed using the Ol’Is o! the plant input 
s!gnal 

In addition to the above work. Parker and 
Bilmead (1^87a,h) have developed a promising 
method lor estimating mput/oulput spectra using 
Kalman liltermg techniques, instead of discrete 
laiurier transforms They also present a lech 
mque tor appro.ximalmg the resulting Iranslcr 
function estimate with a high-ordcr finite 
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impulse response (FIR) filter In Parker and 
Bilmead (lMK7b). a bound on the 1/ norm of the 
model error is devclo|>ed Unfortunately, this 
bound discs not appear to be cxvmpuUibIc on line 
and Its dors not provide any frequency s|>ecific 
information about the model error 
The primary ci>ntnbuiitvn of the work 
described m our paper is itic development of 
bounds on the frequent y domain estimation 
error. These Ixuinds can tx* computed on-line (at 
great computiitional expense m some cases) 
thereby enabling the on line design of a robust 
control law We have not yet lx*en able to prove 
that the robust estimaioi descnbixl m this piij>rr 
yields a nominal model that converges to the 
true plant However, the performance of the 
robust estimator has been mvesiigaled. m a 
ck>sed-li>op adaptive ctmirol conlexl. through 
simulaiion (e g. see Seetuvn 8) Based on tmr 
simulation results, we believe that the robust 
estimator show s promise compared with cut tent 
adaptive control schemes Ihc wiirk that is 
di ‘Scribed m this paper was originally |ne,senled 
in I.aMaire (l^^K7) and I aMaue rf ai (1M87) 

: MAiril MAlKAl rwi I IMINAKII S 
In this scclion, we will present the notation 
and definitions that will be used in the paper, as 
well as some resuhs and iheorcins that will be 
useful later on Wc denote a discrete time signal 
by i|/i) i(m 7 ) where i(r) denotes the sampled 
continuous lime signal and where n is an integer 
and 7 the sampling period W'e denote the 
r-liansform and Ihc discrcle-limc lourier 
transform (D'LFT) of x\n\ by X(:) and ), 

respectively (see Oppcnheim et al., 1MK3) 
Further, we denote the A point discrete Fourier 
transform (DF^I) of the A pomi sequence x\n], 
n-i), , ;V 1, by /Vviu;*) where ru* ' 

(A/A')ui, lor k “ ().A 1 and where ■ 

2.7// IS the sampling Irequency. Since we will 
no( always be winking wiih A point sequences 
lhal begin at I), wc define ihe following version 
of the DI'I for a sequence of A points ending 
with time index n 

(or k--U. .A' 1, (2,1) 

where 

- c ^ ’ (2,2) 

Signal processing theorems 

In this subsection, we will develop results lhal 
can he used to bound the effects of using 
finite-length data to compute frequency-domain 
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quantities. In the later parts of this paper, the 
frequency-domain estimate of a stable, causal, 
transfer function will be computed based 

on the /V-point DFTs of the transfer function's 
input and output signals. We will now state a 
theorem that b<')unds the error in the frequency 
domain between this DFT derived frequency- 
domain estimate and the true transfer function. 

Theorem 1. Vxi y\m\-h\m\^ u\m\, where/i[mj 
i.s an infinite-length, causal, impulse response 
with all its poles in the open unit disk. We 
denote the DTFT of h\m\ by //(e*‘"^), and the 
DFTs of the /V-points of u[m] and y[m| ending 
with time index n, by U'l^Wk) and 
respectively. Then, 

Y%{io,) = + E'Uoh). 

for k = 0 _ A'-l. (2.3) 

where the di.scrcic function i.s given by 

r I 

for k^i) . /V-l. (2.4) 

and where is defined in equation (2.2). 

Proof. See Appendix. 

Remark I. Ihc function E%((i)^) is the error in 
the frequency domain, at time index n, due to 
the use of finite-length data. That is, if the 
DTFTs (based on inhnile-Icngth data) of u[m] 
and y|m| were used in equation (2.3) instead of 
the DFTs (based on finite-length data), then 
there would be no error term £^( 0 ;^) Note that 
the function is the error in the 

frequency domain between the DFT derived 
frequency-domain estimate of //(e'"'*^) and the 
true transfer function /^/(e'"’*'). 

It will later be u.seful to be able to find a 
magnitude bounding function on £’^((U;i,). The 
following theorem provides such a bounding 
function by using only a finite summation of the 
DFT differences and therefore can be imple¬ 
mented in practice. 

Theorem 2. Under the assumptions of Theorem 
I we find that given some finite integer Af, the 
magnitude of E'l^{u)h) is bounded for each k as 
follows, 

M \ 

1 

+ |hl/)]|. for/:=0./V-l, (2.5) 

ft M 

where = sup lulmll. 


Proof, See Appendix. 

.1 ROBUST ESTIMATOR PROBLEM STATEMENT 
In this section, we first list the assumptions 
required by the robust estimator and then we 
stale the robust estimation problem. Consider 
the system of Fig. 1 where the discrete-time 
plant Gi^{z) has an input u[fi] and an output 
y[n] that is corrupted by an additive output 
disturbance d[n]. 

(Al) Plant assumptions 
We assume a structure for the nominal model 
of ^nd a magnitude bounding function 

on the unstructured uncertainty. Tliat is, we 
assume that 

G,™.(2) = G(z, Ml + <!>u(z)) (3.1) 

where G(z, 6>,i) is a nominal model, b^iz) 
denotes the unstructured uncertainty of the 
plant, is a vector of plant parameters and we 
assume 

B(z) 

(Al.l) C(z, 0„)= J , (3.2) 

A(z) 

where the polynomials B(z) and .4(2) arc 

fl(z) = fr,^''"'-"'' + f>,z''"'~'"'" + • • • + h.n,z 

(3.3) 

A(z) = 1 -fl,2 ' - m,, 

(3.4) 

and where the parameter vector is 

(fi) = l«i • ■ • On, f>„ hi - ■ ■ (3.5) 

(A1.2) 6„ 6 0, where 0 is a known bounded .set. 

(3.6) 

(A1.3) V(u. (3.7) 

(A1.4) Vfu. (3.8) 

da) 

(A1.5) G„uc(2) and G(z, (f,,) have all their poles 
in the open unit disk, for all e 0. 

(A1.6) A coarse bounding function on the 
magnitude of the impulse response of the true 
plant, denoted by g.rud'^lr is known such that 

l^lruehll (3.9) 

where r, is a positive integer, and 
0<p, < 1 (i.e, all the poles of girue['*] are in the 
open unit disk), and r, are known for 
i = 1, - . . , /o- giniel'*] is assumed to be causal. 

(A1.7) Zero initial conditions. 
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Thus, our a priori assumptions are that we 
know m, and n,, the degrees of fl( 2 ) and A( 2 ), 
respectively, and the bounding functions 
and Further, we assume that 

the parameter vector is in some known 
bounded set 0 which is only a coarse, and hence 
large, a priori estimate of the parameter space. 
While there are many ways of characterizing the 
high-frequency unmodeled dynamics of a plant, 
the description of A1.3 has been shown to have 
practical utility and has been used extensively in 
the robust control field. 

(A2) Disiurbarwe assumption 
We assume that the iV-[x)int DR of the 
disturbance signal t/[n). whose DFT is denoted 
by salisfics 

)l ” D^(iOi )- for k 0.iV - I, Vn. 

(.TIO) 

(A3) Input sii^nal assumption 
We assume that the input signal is 

bounded and that we know where 

Vfi. (3.11) 

Remark 2. The discrete-time sysiem of Fig I 
represents a sampled-dala control sysiem, While 
the above plant assumptions (Al) have been 
presented for a discrete-time system, similar 
assumptions can be staled for a continuous-lime 
piant and then used lo saiisfv ihe above 
discrete-time assumptions. Fhis process, includ¬ 
ing the derivation ol a discrete-time unstructured 
uncertainty bound from a hound on the 
continuous-time unstructured uncertamiv. is 
treated in LaMaire (1^87). 

Remark 3. Fia.sed on input/oulput measure¬ 
ments alone we cannot determine a unique 
for Ihc nominal model because of the unstruc¬ 
tured uncertainty. I’hat is, if we assume the 
structure of Al l above and assume only that 
e S where 

S = ((H*-) i Vw}. (3,12) 

then we can define a smallest set 

-Gfz, f^)ll (\,(z)land (-.13) 

in which lies. Thus, e 0* c: 0 where only 
0 is known a priori. Note that, in general, 0* 
will be a point only when A„(e^''^) = 0 for all a). 

Preparation for problem statement 
We rewrite the true discrete-time plant of 
equation (3.1) as 

OV^.(z) = G(2. 0)ll + A.Jz.d)l (3.14) 


where again G(r, d) is the nominal model using 
an estimate d of the parameter vector tfo in the 
structure of Assumption Al.l, and 
denotes the modeling error due to both 
structured and unstructured uncertainty. That is, 
since a prion we only know that () € 0, where f) 
is not necessarily in 0V there is structured 
uncertainty asscK'iatcd with this choice of () as 
well as the ever present unstructured 
uncertainty. 

Problem siaiemeni 

The robust estimator must provide: 

(1) a parameter estimate f), and hence a 
nominal model G(z, f)), 

(2) a corres[Kmding bounding function, 
A"„(c*"'^ such that 

f))|< A:ae‘“'', ()). Vm. (3. IS) 

That is, al a given lime index n we want to 
generate a new nominal model fifz. (where () 
IS the parameter estimate at time index n) along 
with a corresponding bounding function 
A;Uc^"'^ f)) in the frequency domain indicating 
how good Ihe current nominal iiukIcI is. Given 1 
and 2 above and a compensalor, we can use 
discrete-iimc versions of the slubilily-robuslness 
tests of Lehlomaki et al. (1^84) to guarantee 
stability in the face of bounded modeling 

unccrlainly. 

The goal of the robust estimator is to find a (i 
in 0* and to have A;'„(e*"'^ A) approach 

A^(e’'"'^). llie viewpoint taken here is that the 
unstructured uncertainty A„(c^"'M is the best wc 
can do given the structure of our lumunal model, 
riius, even though A”y(e'''''. 0) can conceivably 
become smaller than our a priori assumed hound 
A„(e''"^) wc will not let this occur and will 

instead view the function A,,(e''"V) as the 
desirable lower bound of the function 

A:,(e'-'. 0 ). 

Ihe problem that we have described m this 
subsection will be referred to as the robust 
estimation problem. An algorithm that salisfics 
this problem will be referred to as a robust 
estimator since it provides a nominal model of 
the plant as well as a guaranteed frequency- 
domain bounding function on the accuracy of 
this nominal model. 

Outline of problem solution 

Wc will develop a solution to the robust 
estimation problem staled above. First, in 
Section 4, we will develop a method for 
computing a frequency-domain estimate of the 
true plant along with a bounding function on the 
additive error in the frequency domain. Then, in 
Section 5, the frequency-domain estimate of 



3() 


R. O. LaMaire et al. 


Using equations (5.2) and (5.7-8) wc can write 

/>(G(e''■'‘^ 6»„)). (5.9) 

In summary, wc have shown how knowledge 
of Ihe complex values of the 

(N/2) ^ 1 frequencies oj^, . . . , w^yv/ 2 ) can be 
used lo write N -^2 linear equations in the 
parameters. In the ideal situation where one 
could exactly find filo) for k = 

(N/2), the matrix equation (5.9) will 
have a solution. That is, given the matrices P 
and Q, we could solve for the true parameter 
vector using any m of the linear equations, 
where again m is the dimension of the parameter 
vector However, in practice we will only 
have our cumulative frequency-domain estimate 
with which to estimate the para¬ 
meters. If we use Gcum^^r(u 4 ) instead of 
C(e*"'*', fy,)) in equations (5.7-8), then the 
equation 

= (5.io) 

will not, in general, have a solution. Equation 
(5.10) is in the form of the standard least-squares 
problem, which is di.scu.sscd in Strang (1980). 

We will choose the parameter estimate 0 
as the vector that minimizes the frequency 
weighted norm of the error vector, 

^^(f^?u.n/./v(oij)« - c^(f;:'.„,/.)v(04)). (5.11) 

We define, with reference to equations (5.7, 
5.8), the diagonal frequency weighting matrix 

W=diag[/(w„) ■ ■ ■/(<«,/v, 2 ))/(Wo) • • ■/( ^^(/V/2))| 

(5.12) 

where /(•) is the frequency weighting function. 
The parameter estimate that minimizes the 
Euclidean norm of the error vector 

w(T(g:Uv,/v(^^^a))^^ ~ Q(crLn.f.M'h))) (5-13) 

is given by the well-known result 

0 = (P^W^WP) ^P^W'WQ (5.14) 


equation (5.14) minimizes 


Nn 

2 ^(w*) M(e'“‘^)C:„„, ,v<w*) - fl(e"“-0P 

MO. 

= I Aw*)|/l(e*‘“‘^)|^ 

k =0 

^cum/.v(t^A) j (5.15) 

where A(z) and B{z) are as defined in equations 
(3.3, 3.4). From equation (5.15) we see that if we 
want our parameter estimation method to be a 
least-squares fit in the frequency-domain, then 
we want to choose a weighting function that is 
one over the magnitude of the denominator of 
the nominal model. Alternatively, we could 
choose the following weighting function 


/(w*) 


1 

i.4(e"-oi £::u„./.yv(w*) ’ 


(5.16) 


which provides a better fit between the nominal 
model and the frequency-domain estimate in the 
frequency ranges where the uncertainty is the 
smallest. Of course, we do not know what the 
denominator of the nominal model really is, so 
one can only approximately choo.se this fre¬ 
quency weighting function. 

Due to the complexities (e g. equation 4.16) 
of how the cumulative frequency-domain estim¬ 
ate is generated from the 

input/output data, we have not been able to 
prove that the parameter estimator developed in 
this section yields an estimated nominal model 
that approaches the true plant. Some insight 
concerning excitation conditions under which the 
frequency-domain estimate C/ls{(x),,), which is 
closely related to G”„,„yjv(n^), approaches the 
true plant can be gained from the results of pure 
transfer function estimation as described in 
Ljung (1985, 1987). The simulations of Section 8 
demonstrate the performance of the parameter 
estimator in a closed-loop system. 


where the P and Q matrices in this equation 
depend on the values of the estimate 
^^ajniA/v(f^^) Note that if P is not of full-rank 
then we cannot solve for 0 using equation (5.14). 
In practice, the a priori parameter estimates 
could be u.sed. This situation can arise when 
there is insufficient excitation for the parameters 
to be identified. Since this insufficient excitation 
case would result in a large frequency-domain 
error bounding function (at least at some 
frequencies) it is unlikely that the control-law 
would be updated. 

To gain insight as to what weighting function 
to ch(X>sc, we notice that the estimate yielded by 


6 COMPUTING A FREQUENCY DOMAIN 
UNCERTAINTY BOUNDING FUNCTION 

In this section, we discuss the computation 
of a frequency-domain uncertainty bounding 
function for the nominal model G(e^'‘**^, 9). 
Specifically, we will compute a magnitude 
bounding function, A"„(e^‘''"^ 9), on 9) 

at the frequency points for ^ = 0, . . . , 
N-1. 

6.1. Basic methodology 

The nominal model at time index n is obtained 
by using the nominal model structure and the 
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current parameter vector estimate 6 yielded by 
the parameter estimator described in Section 5. 
Thus, we can compute the value of the nominal 
mtidel C(e"‘'*^ for * = 0, . , , . ;V - 1. Now. 
using the triangle inequality, we find that at lime 
index n, and for frequency lo^, 

|(;(e'‘"‘- G,„„(e’‘'“')| s ICfe'”’*', 

- ('"um/ v (ou )l + 'U*)' e’“'‘' )| (6.1) 

and using equations (4.14, 4.15). 


|(;(e'“•^ - G.,„,(e'“"' )| :< iGfe""*', d) 

~ tUj )| + (b-2) 

We now can find a bound on A,u(e’'"‘', (9). 
Rewriting equation (3.14), 

f))(i + A.je’"’*', d)), 

for Ic = 0.A - 1. (6.3) 


So. rearranging yields 


<\„(e-'‘', fi) = 


(b.4) 


bounding function on the modeling uncertainty 
|d,.,(c'“' . ^)|. Ilial is. at the frequency point lu, 
the bound A"Jc""‘'. d) may be very tight, 
however, at an adjacent frequency point oi*., 
the bound Ar„(c’"‘‘ ''. ^) may be very ptKir. In 
LaMairc (1W7). it is shown how- the assumptions 
of Section 3 can be used to find a derivative 
bounding function V",(c'"'') satisfying 


dt^Jc'*"*'. d) 
d«i 


v:„(c"-^). viu. 


(6,7) 


If is analytic, then it is shown (laMaire, 
mi) that 

l«3.„(c'‘“', «)|s=|/)..,(e-'*', 6)1 

+ (ill - HI* )T1 ,((!'*. . i) (fi H) 

and 

l^.,(c"'". 6)1 l^„le.f))| 

f (ni*,, - w)T"„ ,(oj*. ^o ^,,) (6,9) 

for (if e (o)*, (tfi ^,) where 


Thus, using equation (6 2), wc find the bounding 
function 

|^„(e"''‘'. 6)1-' A:',.(e""‘', 6), (6.5) 

where 

A'Je""*', 6) = 

6) ■yyuni/ sf‘‘V 

. .yyy.;;? 7 yy. • 

for A -O.A- I (6.6) 

and where wc have included a superscript n after 
the to denote the fact that this bound on 
|<^,,,(e'^ f))! depends on the time index n, since 
£7t.n./ v(uu) and also H depend on 
n 

In summary, we have shown how to compuie 
a discrete function A^'y(e’'''"^ 6) that bounds the 
net effect of structured and unstructured 
uncertainty of the current nominal model 
(^(e'"'*^ 6) relative to the true plant, at the 
frequencies ru,,. . . , , We used the nomi¬ 

nal model structure of A 1.1. the current 
paraiTijter estimate 6\ and the cumulative 
frequency-domain estimate C7”u,n/ n(u^*) i*nd 
corresponding cumulative frequency-domain er¬ 
ror bounding function fc”um//v(‘^4)- which were 
developed in Section 4. 

6.2. A smoothed uncertainty houndinf^ function 
In this subsection, we discuss the computation 
of a smoothed, magnitude bounding function on 
This development is motivated by the 
observation that, depending upon the spectrum 
of the input signal, one may have a very jagged 


V",,(w*, 0 )j,,) ■:r sup (T",(c’'''')). (6.10) 

rofr(ro*. u»t , 11 

I rom these equations we see that it may be 
possible to obtain a tighter bound on 
fMI lhan A:Ue"“^', f)), by using the 
bound at an adjacent frequency point, 
A”„(c'"'‘ 0) or 0), along with the 

.smoothness information of 

6.3. Houndinf^ inter-sarnple variations 

In this brief subsection, we discuss the 
computation of a safety factor that must l>e 
added to the discrete bounding function 
A''„(e^"''^ ()) to account for inter-sample vari¬ 
ations lihimalely, the uncertainty bounding 
function at discrete frequency pttinls will be used 
in stability-robustness tests to design a new 
robust compensator. These stability-robustness 
tests arc meant to be used with continuous 
functions of frequency. Since the actual com¬ 
putations will be pt!rformcd with an uncertainty 
bounding function that is a discrete function of 
frequency, we must add the aforementioned 
.safety factor to the di.screlc function to acamnl 
for the worst possible peaks that may occur 
between frequency samples In LaMaire 
(1987), it is .shown how equations (6.8, 6.9) can 
be used to choose this additive safety factor in 
such a way that the largest inter-sample 
variations lie below a line drawn between the 
value.s of the final uncertainty bounding function 
(including the safety factor) at two adjacent 
frequency samples. 
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7 nME-DOMAlN PARAMETER ES11MA710N AN 
ALIERNAT1VE 

[n this section, we briefly describe an 
alternative method to that of Section 5 for 
generating the parameter estimate & defining the 
nominal model Gfz, d). Jn LaMairc (1987), a 
time-domain parameter estimator was developed 
that adjusts the parameter estimates selectively 
depending upon the usefulness Of the 
inpul/output data. 7'his time-domain estimator is 
a combination of the modified least-squares 
algorithm that was developed by Goodwin et at. 
(19H5b, 1986) and the bounding mechanism of 
Theorem A.2 in the appendix. Gewdwin et al.'s 
modified least-squares algorithm is made robust 
through the use of a time-varying dead-zone. It 
is shown in LaMaire (1987) how Theorem A.2 
can be used to bound the time-domain effects of 
high-frequency unmodelcd dynamics and an 
unmeasurable disturbance given the assumptions 
of the robust estimator (i.c. the frequency- 
domain bound on the unmodcled dynamics and 
the bound on the disturbance DFI) and the 
on-line computed DE^Is of the input signal. 
Unfortunately, our simulations revealed that the 
robust lime-domain parameter estimator de¬ 
scribed in this section did not perform well due 
to the conservatism of the resulting time-domain 
bound on the unmodeled dynamics and distur¬ 
bance effects. I'he parameter estimator was 
“turned-off’’ by the time-varying dead-zone in 
many situations where a standard least-squares 
algorithm was able to continue yielding accurate 
parameter estimates, ( onsequently, we chose to 
use the frequency-domain method of vScction 3 
to determine parameter estimates tor the 
nominal model of the robust estimator. 


8 SIMULATION EXAMPLES 
In this section, we will present several 
simulation examples to illustrate the behavior of 
the robust estimator. First, in Subsection 8.1 we 
consider a simple first-order plant in an 
open-loop disturbance-free situation. This ex¬ 
ample gives insight into the basic frequency- 
domain bounding methodology and .serves to 
illustrate the different types of behavior that 
arise for two types of input signals. In Subsection 
8.2, wc will describe a high-order plant model 
and its associated adaptive control system. The 
simulation results for this high-order example, 
which are presented in Subsection 8.3, demons¬ 
trate that if the input signal is rich, then the 
robust estimator does lead to improved closed- 
l(K)p performance. 


8.1. Basic frequency-domain bounding 
illustration 

The z-transform and impulse response of the 
discrete-time first-order plant that wc consider in 
this subsection are given by 

//(z)= and (8.1) 

z -/? 

h[n] = gp\ (8.2) 

respectively, where r = 0.46651, p = 0.53349 and 
g = r/p = 0.87446. This discrete-time example 
corresponds to the zero-order hold equivalent 
(with a sampling period of 7r/5 sec) of a 
unity-gain continuous-time plant that has a pole 
at Iradsec '. For this simple illustrative 

example we assume that wc know a priori the 
exact impulse response bounding function. For 
this case we are examining the performance of 
the frequency-domain bounding methodology of 
equation (4.6) with g\=g and p\-p, and for 
design choices M = 10 and = 50. So, using 
equations (4.6), (4.11) with = and the 

algorithm of equation (4.16) we can compute the 
bounding function £cum/ v(n>A). In addition, for 
comparison, we compute the magnitude of the 
actual cumulative frequency-domain error func¬ 
tion |/-Jum/,/v( )l ~ K^iumr v( ~ * )|- 

These frequency-domain functions are shown for 
two different cases of input signal, both of which 
satisfy 1. In Fig. 3, wc show the result of 

using a unity amplitude sine-wave, sin(2.Tn/5) 
for n at time index 111. C learly, at the 
sine-wave frequency of 2 rad see ' the actual 
error and the bound are both reduced to near 
zero. Note that the initial transient that the plant 
experiences yields useful information at many 
frequencies other than just that of the sine wave. 
For frequencies lower than 2 rad sec ', the error 
bound is relatively tight. The opposite peaks at 
4 rad sec ‘ are due to the fact that in equation 
(4.6) the phase cancellations that occur in the 
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actual frequency-domain error function of 
equation (2.4) are ignored and instead all terms 
arc summed. In Fig. 4, wc show the actual error 
and the bound using a unity-magnitude square- 
wave input with a fundamental frequency of 
0.3 rad sec \ We see that equation (4.6) yields a 
right bound since for this square-wave case the 
summation terms in equation (2 4) are nearly in 
phase. (In this example, the last term in 
equation (4.6) was only 0.07H ) As expected, the 
frequency ranges where good identification 
occurs correspond to the frequency ranges where 
the input signal has its energy, namely the 
square-wave's fundamental frequency and its 
harmonics. 


h 2 Closed-loop example description. 

In this subsection, we will describe the com|>o- 
nenls of the closed-loop adaptive control system 
of Fig. 2. These components are described so 
that we can examine the clo.sed-loop perfor¬ 
mance of the robust estimator. 


Plant 

Consider the continuous-time nominal plant 
model given by the transfer function 


‘■'-(’ir '• 


\ : <«3) 

.y -f 2i^u)„s 4 fi);, 


For f = 0.2 and = 2 rad sec ' and adding 
some second-order unmodeled dynamics, we 
obtain 
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23(K) 

4 3()is 4 2500 


(8,4) 


for the continuous-time (rue plant. Computing 
the zero-order hold equivalent of the nominal 
and true plants for a sampling period of ;r/25 sec 
yields 

, 0.621892- 0.56211 

Gz)=-^- (8.5) 

2^- 1.844582 4 0.90436 ^ 


and 

G|rur(* ) ” 

' - 0.65109r 4 0.1278.^2 

2^ - 2.135622'4 1.464262' - 0.305732 4 0. (120849 

( 8 . 6 ) 

respectively. 

In our simulations, the conlinuous-timc 
parameter space is formed by letting C vary 
betwen 0.2 and 0.8 and vary between I and 
2 rad sec * subject to (he constraint that 
^f4i„ 5:0.4 sec ‘ in the continuous-time nominal 
model, llien, to generate the discrete-time 
parameter space B of Assumption A12. a dense 
grid in f and lu,, is formed and the zero-order 
hold equivalent of the nominal model is 
computed for each l, - <()„ pair. In the 
simulations, all of the intermediate parameter 
vectors for the discrete-lime nominal model are 
rounded to the nearest (>oint in the resulting grid 
of discrete-time parameters. It was found 
empirically, that for all Oc B. the discrete-time 
impulse response of the true plant was bounded 
by 0.75 ().95'\ for // > I. 

Disturhance signal 

The output disturbance d{n\ in Fig. 2 is 
generated by passing a pseudo-random signal 
through a low-pass filter and then clipping the 
filter output such that the magnitude of (he 
resulting signal is bounded by 0.01. The 
pseudo-random signal is uncorrelated in time 
and has a Gaussian probability distribution with 
zero mean and a standard deviation of 0.(KI75. 
The low-pass filler is given by 

0.0528812' 

-.....-.- (8.7) 

1. (>47992 4 0.70087 

In this example, the disturbance signal is 
bounded in order for us to he able to determine 
a bound on Dsiu)^). Note that the disturbance 
signal has most of its energy in the same low 
frequency range that the magnitude of the plant 
is large (i.c. o) 2 rad sec '). 


Reference signal 

The reference r|n) in Fig, 2 is given by 


r[n] 


~ , if sin (-- (fi modulo : 

10 '2(K)0 W 

|.7(! I" "’"•‘“I" 


0, 

(«.«) 

' 0, 


for n ^ 0. This periodic reference signal is a rich 
square-wave like signal whose frequency in- 
crea.ses from zero fi.e. a step) to half of the 
Nyquist frequency (25 rad sec ') during a cycle 
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of l(Ki() samples. The reference signal was 
chosen to be rich so as to demonstrate the ability 
of the frequency-domain estimator to accurately 
identify a partially unknown plant and thus 
provide useful information to a control-law 
redesign algorithm. The use of a less rich, more 
bandlimited reference signal will re.sull in good 
on-line identification only in the frequency range 
in which the input signal to the phni has 
significant energy. This might or might not lead 
to improvided closed-loop performance depend¬ 
ing upon the relative location of the frequency 
range where the a priori uncertainty is large. 

Control-law redesign alf^orithm 
In Fig. 2 we use the compensator A'(z) given 
by 

K(z, «) = C; '(z, f)).--- 
Z ~ 1 

where 



where () is the estimate yielded by the 
frequency-domain parameter estimator of Sec¬ 
tion 5. The above control-law attempts to cancel 
out the nominal plant dynamics and yield a 
discrete-time integrator for the loop transfer 
function. In equation (8.9), the choice of the 
gain constant r of the compensator is based on 
the continuous uncertainty bounding function 
A,^(e''"', ^). A value for Jt, in equation (8.9), 
can be determined using the discrete bounding 
function f)) and an appropriate addi¬ 

tive safety factor as was discussed in Subsection 
6.3. 

The above control-law cannot be used for 
general plants since, as is shown in LaMaire 
(1987), it is only guaranteed to yield a robustly 
stable closed-loop system for nominal plants that 
have a relative degree of one or less. It is 
presented only so that the closed-loop perfor¬ 
mance of the robust estimator can be demon¬ 
strated. In the simulation examples that are 
described in Subsection 8.3 the compensator is 
updated every 1(K) samples or every 12.6 sec. 
That is, the current parameter estimates and 
uncertainty bounding function are used “infre¬ 
quently” to design a new compensator. 

Probing signal strategy 

When the plant input signal is not rich, the 
robust estimator does not improve its estimates 


c - 


1 /-I /l 

-(—4 - . if jr >0 

2 ^ X y X xf 


(8.9) 


1 , 


x^i) 


and consequently, the control-law is not 
updated. If we want to enchance identification, 
that is, enable our robust estimator to reduce the 
frequency-domain uncertainty, we can add a 
probing signal in the closed-loop system (see Fig. 
2 ). 

In Fig. 2, the probing signal is generated by a 
weighted sum of sinusoids with randomly chosen 
phases gp*. 

= IKv(w*)|C0s(^-j;^ + <p*j, 

for n=0,...,N-\. (8.10) 

We choose not to excite the system at high 
frequencies since we will then be exciting the 
unmodeled dynamics of the plant. We also do 
not excite the plant at w = 0 since we already 
know the D.C. gain of the true plant in our 
example. The following weights IV^fru*)! for 
equation (8.10) are used in the simulation of 
Subsection 8.3 

= /•(]+ ^^0 

+ 1 inf {|G(e^^"‘'. «)|} 

( 8 . 11 ) 

where we set the design parameter y to 10, c is 
the current compensator gain constant from 
equation (8.9), c, = 0.47 is a design parameter 
that is chosen to be the target value for the 
compensator gain, and = 0.29 is the last 
term (the remainder summation term) in 
equation 4.4. The second multiplicand in 
equation (8.11) accounts for the fact that the 
probing signal in Fig. 2 passes through the 
transfer function G^,^^iz)K(z, 6)^' before 
it reaches the input of the plant. Thus, the 
probing signal must be appropriately pre¬ 
emphasized to overcome this rejection by the 
closed-loop system. The third multiplicand in 
equation (8.11) gives the approximate shape of 
the magnitude of the desired input signal DFT 
This term was developed using 
equations 4.4, 4.11 and 6.6 (assuming 

and 0) and 

by noting that the following equality must be 
satisfied in order for the compensator gain c to 
achieve its target value c,: 

A;,(e'‘^*^ e)< ^ -hi , V(U,. (8.12) 

f'r 

While the development of this probing signal 
algorithm is admittedly ad hoc, it does illustrate 
the possibility of using the evolving knowledge 
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of the uncertainty in the system lo synthesize a 
tailored probing signal to reduce the remaining 
uncertainty. 

8.3. Closed-loop simuiations 

In this subsection, we present the simulation 
results for the closed-loop adaptive control 
system of Fig. 2 that was described in Subsection 
8.2. In our simulations, we use a DFT length N 
of 1000 points and a value of 20() for M in 
equation (4.4). [The fact that our choice of DFT 
length corresponds to the periodicity of the 
reference signal aids in the identification 
procedure since it helps reduce the differences in 
the shifted DFTs of the plant input signal in 
equation (4.4).] In addition, in Fig. 2, wc assume 
that at the plant input there is a saturating 
actuator which constrains the input signal to lie 
between ~1 and +1 (i.e. - 1). 

We examine the performance of the adaptive 
control system of Fig 2 for two ca.ses, one 
without and one with the probing signal. For 
initial values, in both simulations, wc set the 
cumulative frequency-domain estimate lo the 
frequency response of the nominal model for 
; = ().8 and w^^lradsec and set the 
corresponding cumulative frequency-domain er¬ 
ror bounding function lo (he best bounding 
function that can be found using only a priori 
knowledge of the plant. Ihus, we start the 
Ircqucncy-domain bounding method with param 
cter values that arc very far from the true values 
of £ =0.2 and a)„ = 2 rad sec ‘ 

No probing signal case 

In this simulation, we rely solely on the 
reference signal r\n\ for excitation of the plant. 
In Fig. 5, we show at lime index 25(X) (314.2 .sec) 
the cumulative error bounding function 
^^cunxf and, for comparison, the magnitude 

of the actual cumulative frequency-domain 
error function IF'U,/ )l = K'umr " 
The effect of the disturbance is 


umf. ^ 



Fio. 5 Cumulative error vt )1 *^*1 tx3ur>a 

for n = 2500, no probing signal case. 



''aV' 

Tirnt Indt* 

Flu b lime histories of parnmeief estimates for no pntbiiig 

signal case 

evident in the frequency range from 0 lo 
2.5 rad see ’. At higher frequencies, wc can still 
.see visages of the smtHilh a priori bounding 
function that was used to initialize the 
frequency-domain bounding method. In Fig. 6. 
we show the continuous-time parameters (hut 
correspond lo the nearest point in the grid of 
discrcie-iimc parameters that was described in 
Subsection 8.2. This conliiuious-iimc parameter 
interpretation allows us lo sec how well the 
frequency-domain estimator is identifying the 
plant as a function of time. Starting from the 
initial values of C ” d.H and ==■ I rad see 
which results from our a priori choice of (he 
cumulative frequency-domain e.stimate, the pa¬ 
rameters eventually leiich their correct values of 
C = 0.2 and (o„ = 2 rad .sec ' at lime index 2200 
(276.5 sec). While the frequency-domain Ixiund- 
ing methodology is continually in operation, the 
frequency-domain parameter estimator of Sec¬ 
tion 5 is only used at the control-law redesign 
limes which occur every 1(X) samples (12.6 .sec). 
7'his infrequent parameter updating accounts for 
the movement of the parameter estimates in 
jumps in Fig. 6. In order to sec how well the 
robust estimator i.s performing as part of the 
adaptive control system, in Fig. 7 we show for 
the closed-loop system the nominal continuous- 
lime bandwidth. We define this bandwidth 



iiX/.' 'VXj ?V.X; 

Time lnde>. 


Fio. 7. Time history of contjnuou.s-time bandwidth for no 
probing signal case 
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measure to be ( "1/7 ) In (1 - c) where T is the 
sampling period of it/25 sec and c is the gain 
constant of the compensator K{z) that was 
described previously. Note that if the inverted 
plant model in equation (8.9) were to exactly 
cancel the true plant, then the closed-kxip 
transfer function of the system of Fig. 2 would 
be c/(z " 1 f c), which has a stable pole at 1 " c 
for 0<c<l. Thus, Fig. 7 is simply a time 
history of the continuous-time pole correspond¬ 
ing to the discrete-time pole of the closed-loop 
nominal system. Comparing Figs 6 and 7, we sec 
that as the robust estimator reduces the 
structured plant uncertainty, the compensator 
gain can be increased resulting in a nominal 
closed-loop bandwidth of about 2.5 rad sec ' at 
time index 25(K) (314.2 sec). Most of this 
improvement occurs rather late in the simulation 
after the second KXK) point cycle of the reference 
signal. To speed up this process in the next 
simulation we add the probing signal. 

Probing signal case 

In Figs 8-10 we show the analogous figures to 
those of the previous example, for the case of 
using both the reference signal and the probing 
signal algorithm that were described in Subsec¬ 
tion 8.2. In this simulation the probing signal 
weights Vr^(o)k) were computed at time 0 and 
then recomputed at time index KKM) (125.7 sec) 
based on the current information. At time index 
IKK) (138.2sec) the probing signal was disabled 
when the nominal closed-loop bandwidth ex¬ 
ceeded our target value of 5 rad sec Compar- 
ng Figs 5 and 8 and noting the difference in 
scales, we see how the presence of the probing 
signal, which is concentrated between 0 and 
12.5 rad sec has greatly reduced the 
requency-domain estimation error. From Figs 6 
md 9, we see that the robust estimator can 
dentify the parameters much more quickly in 
he probing signal ca.sc than when the probing 
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Fig. 9. Time histones of parameter esiimaies for probing 
signal ca.se. 
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Fig. 10. rime history of continuous-time bandwidth lor 
probing signal case. 


signal was not present. In addition, comparing 
Figs 7 and 10, this improvement in identification 
speed is also reflected in an improved nominal 
closed-loop bandwidth. Note that al time index 
1100 (138.2 sec) a nominal closed-loop band¬ 
width of about 6 rad sec ‘ is achieved. After the 
probing signal is disabled, the system goes on to 
further reduce the frequency-domain uncertainly 
resulting in an increase of the compensator gain 
c to almost one (i.e. a deadbeat controller for 
the nominal plant). While the probing signal has 
improved the performance of the identification 
process and ultimately the closed-loop system, 
its presence also significantly degrades the 
command-following performance of the closed- 
loop system. 

Comments 

Several other simulation examples that had 
different values of nominal plant parameters 
were studied in order to more fully understand 
the performance of the robust estimator. The 
detailed results of these simulations are pre¬ 
sented in LaMaire (1987). The primary conclu¬ 
sion drawn from our simulations was that a 
robust adaptive control system that uses the 
robust estimator can increase the closed-loop 
bandwidth and hence, improve the performance 
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of a system, under the right excitation 
conditions. Since a range of cases were 
considered, several different types of behavior 
were observ'ed. In some situations, the reference 
signal provided sufficient excitation for the 
robust estimator to identify the plant well, 
resulting in the achievement of the target 
closed-loop bandwidth. However, in other 
identification cases (i.e. in cases where the initial 
compensator was chosen such that frequencies in 
the range of the target closed-loop bandwidth 
were greatly attenuated resulting in little 
excitation of the plant at these frequencies), the 
reference signal itself had to be supplemented by 
the aforementioned probing signal i'(n) in order 
for the robust estimator to be able to identify the 
plant well enough to increase the closed-loop 
bandwidth. Thus, in a closed-loop context, it was 
oiir experience that given excitation at the 
proper frequencies, the robust estimator was 
able to yield an improved nominal plant model 
and uncertainty bound so that the robust 
control-law redesign algorithm could increase 
the bandwidth of the closed-loop system 

y ( UNC LUDINCi REMARKS 

In this paper, we presented a new estimation 
(identification) methodology that can be used in 
a robust adaptive controller to provide stability- 
robustness guarantees. The key feature of the 
robust estimator is the frequency-domain boun 
ding function on the modeling uncertainty. Our 
simulation results revealed that the use of the 
robust estimator can yield improved closed-loop 
performance, that is, increased bandwidth as 
compared with the best LTl compensator that 
could have been designed (for a given design 
method) using only priori knowledge of the 
plant. In some situations, the plant input signal 
IS not rich enough to allow identification. In 
these cases, one can chose to cither use the best 
a prion control-law or introduce an external 
probing signal to enhance identification. As a 
final remark, we note that while the robust 
estimator provides guarantees that no other 
methodology can, the price of these guarantees 
is the large computational load of the frequency- 
domain calculations described in Section 4. 
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APPENDIX DLKIVAITON Ol SIGNAL 
PRO( I SSIN(; T HEOREMS 

In this appendix, we provide prools loi Theoieins I and 2. 
Further, we sratc and prove two additional Iheoicins, (he lust 
of which can be used to compute a lime domain bound on 
the output of a linear system by using the DIT of the input 
of the system This result is rclerred to in Seilion 7 ol the 
paper 

Proof oj Theorem 1 W'e know that 

.. //(e’'"^'KTc'‘"^'). for k (I. . /V 1, 

(A.I) 

where and V(e’'"*^) and the DLFls of u|n) and 

yin), respectively Since 

V(C"'’*')= X V|^1W'‘C+ Vv'«'.) 

n\ - ^ 

+ ^ vlmuve’. lor ,M-\. 

m *' fi ‘ 1 

(A.2) 
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and a similar eapression holds lor ), we can wriie 

x{ '2. i -ImllVirl 

m—*s^l * 

-Tx rimin'" + i rimin'"!. 

' m *-• » m “ n * i ‘ 

for *=0. N-\. (A.3) 

ll can he shown lhal 

Y rimin'" “ M'>|( "s ‘timin'"! 

in« '» ' m * T* ^ 

r i Miimj x" “imin'"- Y «imin'"|. 

for A-n.JV-1, (a.4) 

So, 

//(e'““'j 2 ulmlM'*™- 2 rimin'" 

-iMpin'l Y Mimin'"I. 

/J - I ’ in -ri rV » 1 ^ 

for A=0_ /V-l. (A.5) 

Similarly, 

A/(e'‘“') V ii(m|W'*r- i rlmlW'*'" 

m '*.■ nil m >. A t I 

= -i>'i/’mj i Mimiw'irl. 

I ‘rn~A ,r s I > 

for k=-0. (A.6) 

Using equations (2,3). (A.3) and (A.5, A.6) wc find that 

i fi[/iin"| Y Mimin'" 

/I I ' m *. PI .V /III 

- t Mimin'"! 

PH «PI /j ♦ I ' 

= i/iipin'’| ^ Mimin'" 

/I — I ^ pn A A' /J I I 

- i; M|min"'!. 

PPI - A /V I 1 I 

for it-0./V-1. (A.7) 


Equation (2.4) now follows using the dchnition of equation 
(2.1) OE.D. 


fVoo/ oj Theorem 2 Using the triangle inequality and 
equations (2 4) and (A.7) we find 

M I 

1 i^IpIi it/v 


+ S I^IpII 


S Mimin'" 

I A' /I I I 


^ MlmHVt" 

. n . I 


for A=0.yV-1. (A,8) 


Since! 2 Mimin'"- t M(mllVjr 

A /»+! 

PI A PI 

X l“|mll+ 2 I“(m||s2u„.p (A.9) 

m •* A A /P + I Pil ■> A /» 4 1 

wc ctjnclude that equation (2.5) is true Q.E.D 
Corollary I. Under the assumptions of Theorem 2, 
|£;U<m»)K2m„„ Xa’IMpII. for*=0 - N - 1. (A.IO) 


Proof. Choose Af = 1 in Theorem 2. This corollary is closely 
related to Theorem 2 1 in Ljung (1987). 

The following theorems arc useful for computing the 
maximum output signal of a transfer function for which wc 
have a magnitude bounding function in the frequency 
domain. 

Theorem A.\. Let yffn) =/i[fn| • u|m|, where h\m] is an 
infinite-length, causal, impulse response with all its poles in 
the open unit disk. We denote the DTFT of h[m] by 
//(c^*^*^). 'and the DFT of the fV-points of u[m] ending with 
lime index n, by C^w*) Then 

r|n|= ^ 2'«(c"‘’‘^)l/J^arJW^*’' + p|nl, (A ll) 

^ *-U 

where 

S fi[f^l(w[n - p 1 - ii[n - (p modulo yV)|). (A.12) 

Remark A.\ The signal c[n| is the error due to the fact that 
the impulse response h\n] is of infinite length. We note from 
equation (A. 12) that if h[p] ~ 0 for p ^ A/, then c|n| = 0, Vn. 

Proof. Sec LaMaire (19K7). 

Wc want to be able to find a magnitude bounding function 
on y|n|. The following theorem provides such a bounding 
function by using the results of llicorem A.I. 

Theorem A.I. Under the assumptions of Ihcorcm A.I we 
find that, for a real-valued impulse respoosse h\n\ and a 
real-valued signal u\n], the magnitude of yin] is bounded at 
each n as follows: 

, i 1 

N [ 

+ I«(c'“<>"’)^||t/;yaj,^^,)|| + 2u„„ 2 I^IpII. (A13) 

} /I A 

where 

Mm.» = sup|M|m||. (A.14) 

m 


and where we have assumed that N is even. An alternate 
form of the theorem can easily be proven for the case of an 
odd value of N. 

Proof See UMairc (1987). 
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Enhancement of Fixed Controllers via 
Adaptive-Q Disturbance Estimate Feedback* 

T T TAYi and I B MOORE* 

Robust and adaptive control techniques are blended to enhance one another 
in what is termed an adapfive-O scheme. 

Key Words Adaptive control, adaptive systems, disiurhamc rcjeelion. least squares cstimaiion. 
rolHi.sl conirol; optimal aintrol 


Abstract—A direct adaptive cunirt)! scheme is proptised. 
termed an Adaplive-() scheme, which has the properiv that 
It can. if considered desirable, limit ils .searches to the space 
of all stabilizing linear propwr controllers lor a nominal linear 
plant, llic adaptive controller feeds back disturbance 
estimates via a filter with operator Q It augments any fixed 
linear stabilizing controller, viewed as a minimum variance 
disturbance decoupling controller, lor the nominal plant For 
a nominal plant, the adiiptivc-(^ augmentations evanesce, but 
when the plant is other than the nominal one. the adaptive'(,> 
scheme seeks to minimize the elTect of disturbances and thus 
to improve the performance over that of the fixed controller 
rhe proposed adaptive-disturbance estimate feedback 
(DFF) controllers cun be simple to implement even lor high 
order multivariable plants with high order fixed controllers, 
and have the .significance that they .seek lo enhance 
performance of standard controller designs in the face of 
plant perturbations or uncertainties, rather than supplant oi 
compete with them, Pruir knowledge aliout the frequency 
band of plant uncertainty is readily mcorptirated into the 
adaptive design scheme 


1 IN I KODl'C riON 

ADAiMivf (DN^ KOi I r RS fof .siniplc prDcessc.s urc 
well studied, and indeed under certain idealized 
conditions are known lo he globally convergent 
(Goodwin et aL. 1980; Narenda et ui, 1980; 
Moore, 1985). When applied in many situations 
which are less than ideal, they have at best local 
convergence properties (Kosut and Anderson, 
1984). In current adaptive control research, 
there is a move away from seeking 'universar’ 
schemes for application to any conirol situation 
lo more limited objectives within restricted 
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cla.sM‘s t>f control applichlions. An area which 
offers sco^x* lor achieving significant practical 
results is the blending of adaptive techniques 
with lobust or optimal fixed ccmirollcr design 
(see for example Moore et ai, 1982). The idea is 
lo exploit the strength of fixed offline 
robusl/optimal controller design for complex 
systems and the capability of adaptive techniques 
to give on-line performance enhancement in the 
face of plan! perturbations or uncertainlies. 

In earlier studies (Ghakravarty and Moore, 
1986). t)ne of the authors demonstrated that 
simple adaptive pt)lc assignment or linear 
quadratic Gaussian schemes could be applied to 
enhance the stability and |xrfornvance properties 
of a high order multivariable robust/optimal 
(frequency shaped linear quadratic Gaussian) 
off-line conlrollei design The blending of the 
on-line and off line techniques is based on 
engineering insights of the particular problem. 
The success of the blending technique in 
Chakravariy and Moore (1986) depends on the 
fact that (he plant uncertainties are reslricled to 
a narrow frequency band and have a low order 
representation, 1’he question arises as to the 
potential of blending off-line and on-line control 
techniques in more general situations. One 
objective in a blending procedure is for the 
on-line and off-line designs to work towards 
cither the same performance objective, or to 
complementary objectives. In the former case, 
.should the plant be the nominal one, the 
adaptive scheme should be tuned so that it does 
not provide any additional control asymp¬ 
totically. An example of complementary objec¬ 
tives is that the off-line design be robust and the 
on-line design enhance performance, even for 
the nominal plant case. 

In this paper, we propose a novel class of 
adaptive disturbance estimate feedback (DEF) 
controller. The objective is to blend on-line 
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adaptive control techniques with off-line de¬ 
signed controllers so as to enhance the 
performance of the latter. The understandable 
fear of any fixed robust controller designer is 
that in superimposing adaptive loops, the 
adaptations based on crude calculations could 
dominate and destroy the control action of the 
carefully designed off-line controller. To limit 
the adaptive control actions when indicated, we 
impose the following requirements for the 
adaptive loop in the first instance. 

(i) When the plant is the nominal one, 
there is no adaptive control action, at least 
asymptotically. 

(ii) The adaptive scheme seeks to minimize 
the same disturbance rejection criterion that the 
off-line design minimizes for the nominal plant. 

(ii) The adaptive .scheme searches only over 
the class of stabilizing proper controllers for the 
nominal plant, when so instructed. 

In Section 2, any off-line designed stabilizing 
proper linear controller for a nominal linear 
plant is viewed as a minimum variance controller 
for some disturbance rejection index. As well, the 
class of all stabilizing proper controllers for the 
nominal plant is defined in terms of this 
perturbed stabilizing controller. The results in 
this section are developed for the multivariable 
case since they do not significantly increase the 
complexity of the presentation. In Section 3, the 
objectives of an on-line adaptive scheme for 
enhancing on-line performance are set out, and 
specific proposals are made for implementation. 
Here the results are presented for the scalar case 
only, noting that the ideas have potential for 
dealing with the multivariable case. Certain basic 
properties of the proposed blending of on-line 
and off-line controller design are studied in 
Section 4 with more properties studied in 
subsequent work. Simulation examples are 
studied in Section 5, including ones which make 
connections to earlier work. Conclusions are 
drawn in Section 6. 

2 . (ONTROLLER mtiORY 

In'this section, background controller theory is 
organized to set up the motivation for the 
adaptive schemes of subsequent sections. We 
consider in turn plant descriptions, stabilizing 
controllers, the class of all stabilizing proper 
controllers, performance indices, inverse prob¬ 
lems and disturbance rejection controllers for 
perturbed plants. 

Plant description 

Consider a plant with nominal state space 
description 

4 Hu*, y* = Cx* 4- Du* (2.1) 


and transfer function 

C;,,(z) = C(z/“A)'H-ED 


A : B 

.’c i'bJT 


eR 


p 


( 2 . 2 ) 


where Hp denotes the class of rational proper 
transfer functions, and [ Jy denotes a transfer 
function as defined in (2.2) using block 
partitioning. Consider also coprime factoriza¬ 
tions 


Go = ^oMo ' = Afo Mo. No, Mo e HH* 

(2.3) 


where RH^ denotes the class of all asymptot¬ 
ically stable rational proper transfer functions. 
Suitable selections are given below in (2.7). 


Stabilizing proper controllers 

Consider proper stabilizing controllers for Go 
as /C G Rp (rational proper transfer functions) 
[see Fig. 1], where the closed loop system is well 
posed in that AC Go, Go AC 6 R^p (the class of 
strictly proper rational transfer functions). Thus 



/ , 


exists and belongs to A^H". 


(2.4) 


Consider also coprime factorizations for some 
stabilizing controller ACo as 

/Co=DoFo* = ^r, ‘(7o;f/o. K., KeRir (2.5) 


which satisfy the double Bezout equation 


K, 

-u„ 

M,, t/„1 




-N. 


-K vj 





H, 




/ 



.N„ 

V',,. 

■ -N, 

J' 

‘ _0 

l\ 


( 2 . 6 ) 


Two factorizations 

For some stabilizing constant state feedback 
gain F for (2.1) and some stabilizing constant 
output injections //, AL for (2.1), we consider 
two alternative factorizations satisfying (2.3)- 


Plonl 


Proper G^iz) 


ConIroUer 


Proper 


Fig. 1. Nominal plant and controller. 







That the first factorizations in (2.7) satisfy (2.6) 
IS known [see Moore et al, (l^M)) for 
generalizations and its references). That the 
second factorizations satisfy (2.6) is shown in the 
Appendix with proofs following a similar pattern 
as that for the first factorizations Notice that the 
first factorizations have an implicit requirement 
that E Wnp whereas the second requires that 

f;oe/?,p(D = 0). 

Class of all stabilizing proper C(}n(r()llers 
This class can be characterized (Moore et ai, 
1990) in terms of an arbitrary Q e. RW under 
(2.3), (2.5) and (2.6) as 

K = UV \ NuQ 

= y -' 0, 0 = V = ^ y/v„. 

(2.K) 

Note also that (2.K) can be written via (2.6) as 
K = K,^V,^Q{I^V,^N,Q) 'VT' (2.9) 


(The inverses exist trivially when either <i or 
) 

More generally the following result is readily 
established 

Lemma 1 Part (r). With R^, stabilizing 
and y.j defined in (2.10) the transfer 
function relating n ™ to 

of Fig. 2h is as follows 

o] .V,;” 

0 / 0 f / C>1\>1 /] (212) 

.Si "/J L 11 . 

which is affine in (7. Moreover the system of l ig. 

2 with (/„, 7,,. (J having sttibili/ahle and 
detectable realization is internally (asyrnplo- 
lically) stable if and only if Q is (asymptotically) 
stable Further W e WH* if and only if e WH'. 
I*art (rr), Should (/,,, 7,, be stabilizable and 
delectable realizations as in Part (i), but Q be 
some causal time-varying operator, then W 
generalizes as a causal time-varying operator. 



Fig 2- Class of all slabilizing tonirollcrs 
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Moreover, a necessary and sufficient condition 
for W to be a bounded-input, bounded-output 
operator is that Q be bounded-input, bounded- 
output. 

Proof. Sec Appendix. 

Remarks. This lemma is a natural generalization 
of earlier results for single loop time-invariant 
systems. It tells us that in implementing a control 
system as in Fig. 2, the operator Q can be any 
adaptive loop (for example), and as long as Q is 
causal bounded-input, bounded-output, then 
bounded-input, bounded-output stability of the 
system of Fig. 2 is maintained. 

For the factorizations (2.7), it is immediate 
that 



A-^ BF+HC + HDF 

-H (B + HD 


F 

0 / 


-(CFDF) 

/ -D 

[A-^BF+ALC+BFLC 

-(AL + BFL) 


F+FLC i 

~FL 

L 

-c i 

1 


(2.13) 

and the class of all stabilizing controllers can be 
organized as in Fig. 3. 


Performance index 

As a performance index associated with G, let 
us consider minimization of a disturbance 
response. Consider the plant Gq augmented as 
P £Rp with P 22 = Go. Thus with Z-transform 
relationships, ignoring initial conditions, 
consider 


e(z)^\Pu{z) P, 2 ( 2 )ir»v(z)' 

.>’(z)J LP2 ,(z) P22(z)JLm(z). 

P 22 = G(, e Pp. 


(2.14) 


Here is an unknown disturbance input, and 
is a reference or disturbance response, fre¬ 
quently including terms involving and x^. 
[The case when is a known (reference) input, 
or has such components is studied in a 
companion paper (Tay and Moore, 1990).] 

Now with feedback controllers K applied to 
the plant Go so that u(z) = K{z)y{z) then (2.14) 
can be reorganized (refer to Fig. 4) as 

e{z) = F^{z)w{z), F^ = P,,-^ PuK{I- G,,Kr^P^ 
e{z) = Fq{z)w{z), Fq=Tu^ TixQTji (affine in Q) 

(2.15) 


where the second formulation follows from 
structuring K in terms of some /Co,7o and 
Q e RH"^ as in (2.8)-(2.1]), and re-organizing Ff^ 
of Fig. 4a as Fq of Fig. 4b. Tliis re-organizing 



Slate Estimator 



Fui 3. n»ss of all stabili/ing controllers based on slate esiimate feedback design. 
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Fig. 4, Disturbance rejection controller. 


eads to the following expression for T (note that 
= 0). 

_ /^tl "*■ ~ Gd^o) P\:Mi\ 

0 I 

(2.16) 

..emma 2. 

/Co € /?p stabilizes P (with P.: = C7„) (2.17) 
f and only if 

/CoE Kp stabilizes C7o and T e R\i \ (2.18) 

viorcover, under these conditions and with 
JeRW 

t\,^T,,€RYr (2.1^) 

Voo/‘ See Appendix. 


emma 3. Consider the case of a plant C7 (not 
he nominal plant G,)) and in particular consider 
he scheme of Fig. 4 under (2.16) with the 
ugmented plant P(G)-P i^f (2 14) save that 
^2 “ G (true plant) instead of G,,. Then the 
rrangement is as in Fig. f) with 


Pu^PMI-GK,,)'P2^ 

Vo'(/-G/:o) 

- AnO) ‘Fo ‘ 

V„\l-GK„) GV:,'-V„'N,>. 


( 2 . 20 ) 



Fig. 5. Non-nominal plant case. 


and 

e(z) = 4- Pj.MiCHl), 

r(z) = Aif„y(i)- .V«M(7) 

= P,.!♦'(’) + P|,ty,,r(r) + 

j(i) = 


Proof See Appendix. 

A minimum variance disturliancc rejection 
task is as follows 

IK^'x'Ih.IIj “ min ll|^c>l.pllj (2.22a) 

Mtthiluinn A' • W M * 

where denotes the strictly pro[>er part. Let 
us denote optimal K, Q as K*, Q^. When 
and e R^^, the equivalent minimum variance 
task is as follows, 

min EleieJ, /:Ik^==(). /:|h';»v*1/ 

ainhilivitifi A 

(2.22b) 


Example 1 Consider a sliK'haslic version of the 
plant (2.1) in innovation representation form as 

4 f = Axa -f Bu/^ 4 r Wf,, y* - C xi ^ Ky 


Consider also a standard linear quadratic (IJJG) 
index 


/ioG = ^^|^S (Ui |P.u, I +4:,'C,Jr,)|. 

R, > 0. Q .•? 


Now define 



0 

(J 

0 

R\'^ 

0 

A 

r 

B 

/ 

(1 

0 

0 

0 

Q'r 

0 

0 

(1 

( 

1 

0 


0 . 


With the factorizations of (2 7b), then /jj = 0. 
r., = / and 



0 

Rl'^F 

-R'/'EL 

r:'^ 


0 

A + HE 

-{A + BF)L 

B 


/ 

0 1 


.|0j. 

[0 


0 
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0 
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/ 

0 


With the above definitions, E'jA 

and it is straightforward to see that the above 

LOG controller design task is equivalent to the 

disturbance rejection optimization (2.22) under 

(2.15). 


Example 2. Qrnsider the following plant de¬ 
scription based on ARMAX (input/output) 
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scalar variable models 


arc that T defined in (2.16) satisfy 


A(z)y(z) = B(z)u(z) + C'(z)w(z) 


T(P)€RH^. (2.23) 


where A(z) = I + a,z ' + ■■■ +a„z^''. B(z) = 
h,z ' + ■■• + h„z C{z) = 1 + C|Z ' + • • • + 
c ,2 " and (j„ — B(z)/A{z) € 


" (J ■ 


"z 

C(z) 


B{z) 

A(z) 


A(z) 


C(z) B(z) 


I A{z) A(z) J 

An optimal one-horizon nominal controller 
for (2.16) designed according to the LO index 
(one horizon) 

i,.o = f:{yL,+R.ul) R.>o 
is given as follows |10] 


\A(z)-C(z)\ 


B{z) + h] 'R, (z 


Suitable factorizations for G„ and /C„ are then 
given as follows 

N„= B(z)/C{z), M„ = A{z)IC{z) 

U- n z)|z 

‘‘ zB(z) + ^ 

zBiz)^h,'RMz)- 


With these factorizations, then fii ^ 0, Tji-l 
and 





I 


Nu J 
0 


Sufficient conditions on P are that for arbitrary 
Pi 2 , Pj] satisfying Pi 2 Mi}. then 

P\\~ ! ~ P\ 2 My^(j^)P 2 \. Moreover, this P [which 
satisfies (2.23)] achieves e(z) = iv(z). 

Proof. Sec Appendix. 


Remark. Notice that a P selection satisfying 
(2.23) may not lead to meaningful disturbance 
rejection indices, Take for example the case 
when Pj 2 = 0 and Pn = 0. Here irrespec¬ 

tive of /Co It clearly makes sense to proceed 
with an index (2.22) that has meaning in an 
“engineering” sense. 


Disturbance estimation 

In order to minimize the effect of an unknown 
disturbance signal, it is reasonable to first 
estimate the disturbance, or at least its 
innovations, and then to feed back (somehow) 
such an estimate into the control signal. Of 
course, if a component or linear combination of 
the disturbance has no effect on the disturbance 
response, then there is no point in estimating 
this component. 

Lemma 5. Consider the disturbance rejection 
controllers of Fig. 4 with (2.16), (2.23) holding. 
Sufficient conditions for to be reconstructed 
from r* by stable transfer functions are that 

Pj/ (left inverse) exists, 77/ = P 2 V ^ RH'". 

(2.24) 


Remark. It is noted that the selection of P{G) to 
realize a particular disturbance response for a 
particular plant C and controller K is not 
unique. We will present subsequently other 
selections of P(G). 


Thus, ignoring initial conditions, under (2.24), 

r(z) = T 2 Az)w{zf w(z) = 77/ ( 2 )r(z). (2.25) 

For the case Pyi = Mo ', then e(z) = h'(z) = r(z) 
(refer to Fig. 4). 


The inverse problem of optimal disturbuFice 
rejection 

It is known that not all stabilizing controllers 
are optimal in an LO sense, as above, but for the 
more general index (2.22), we claim the 
following. 

Lemma 4. Any stabilizing controller /C^, e for 
is optimal in that with K ~ 
lilpAKplh.? [see also (2.15a)] is minimized over all 
stabilizing K for some P e R^ with Py. = Go and 
/Co stabilizing P. Likewise, for the same P, 
IIIP 0 WIU 2 [see also (2,15b)] is minimized over 
Q € RW with Q = 0. Necessary conditions on P 


Proof. See Appendix. 


Remarks. The sufficient condition (2.32) is the 
simplest to work with. Others can he generated, 
for example, with y»v(z)e/?H'' where Y 
(2.32) can be replaced by 



w(z) 



This condition could be useful to apply when 
w(z) is a deterministic signal, as a constant bias, 
or a finite sum of sinusoids of known period. 
Another sufficient condition is that for some W 
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such that {721 Wj e AH’" then 

(72, 0(7) = 17;. lV|-'r( 2 ) 

where w* is interpreted as being generated from 
a signal u* driving a system with transfer 
function W. Tliis condition could be useful when 
Tn is non-minimum phase and is viewed as 
ihe innovations of w*. and W is all pass. 

Disturbance rejection confro//er/or perturbed 
plant 

Given that K„e is an optimal disturbance 
rejection controller for P ^ R^ with P.. = G,,. 
then the disturbance response vector <’( 7 ) is 
minimized in an /.j sense over all bv 

the value 0 = 0. Con.sider now the case ot a 
plant G e /?p, not the nominal one, but with the 
same di-Sturbance rejection index as above. l,ei 
us consider an optimization over a restricted 
dimensional stabilizing proper 0,., parametrized 
in terms of 6, a finite dimensional vcctoi 
(matrix). 

With 7^.,, P, 2 . P?i appropriately selected and 
= G (not G'n), consider the minimization task, 
in obvious notation 

min lll/yJ/'fG), A:„||,,,|i.. (2.2fi) 

Of course such an optimization, even with 
affine in Q, is known to be difficult to carry out 
oft line with known (i, and is iiTipf)ssiblc with (i 
unknown. There may well be local minima which 
cause problems. We do not present any 
characterization of performance improvement 
for such an optimization since this appears too 
formidable a task. Suffice to say that the more 
restrictions placed on Qn, Ihe less is the 
potential for improvement, although it is known 
that Ihe dimension on Q for optimum improve¬ 
ment is ^2n - 1 where n is the order of G,,. 

In the next section, wc seek an on-line 
optimization procedure with this objective (3 2b) 
in mind. Also, given that G is unknown, the 
selection of Z^i.. Z^i examples (i) and 

(li) would lead to unknown P\ 2 ^ 
therefore, a nonnieasurable disturbance re¬ 
sponse e*. However, if the disturbance response, 
G is based on some measurable system signal 
such as the output weighted LOG scheme, wc 
have a simple feasible formulation. Details arc 
provided in the next section. On the other hand 
if the disturbance response is not based on a 
measurable system signal, P will have to be 
estimated on-line. Wc will only consider here the 
case when w, u are scalar to avoid parametriza- 
tion uniqueness issues, complex formulations 
and the like which arise in dealing with the 
multivariable case. We define Qa in terms of a 


scalar Q under (2.24) as follows; 


Q,U) 


l 4 ' + 



rt'.On. Al. 


(2.27) 


3 ADAFlIVr DISniRHANCr LSIIMAIT 
FILDBAC K (Dl l ) 

In this section, wc introduce a direct adaptive 
DLF control scheme to tK*rform on-line 
optimization of disturbance rejection indices, 
Ihc adaptive loop feeds back disturbance 
estimates. It augments an existing controller 
interpreted as an optimal disturbance rejection 
controller. Attention is restricted to scalar 
variable nominal plants. although many of the 
concepts carry over in the multivariable case. 
The point m our derivations where we 
specifically require scalar plants is highlighted. 

Gonsidcr .S4)mc plant with /-transform func¬ 
tion a e. Z^p with a nominal representation 
G'oe Z^p and inputs outputs y* as in (2.1) and 
(2.2). C'onsider also some slabili/ing controller 
design A,, tZ^p (or G'^. Our objective is to 
enhance this controller by appropriate pre¬ 
processing of signals and introduction of an 
adaptive loop. Wc proceed by stages. 

Ko interpreted as a disturhanee rejection 
controller 

Perhaps the controller A'o known to be 
optimal for some known augmented plant Z’with 
P:. ~ m a disturbance rejection sense defined 
in Section 2 If P is unknown a priori, then wc 
propose to select a P according to Lemma 3 such 
(hat (2.31) is satisfied. Then A„ is optimal for 
this P, according to Ixmma 3. Other ways of 
selecting P to satisfy different control objectives 
are presented later in the section and are 
investigated in greater detail in a companion 
paper (Moore and Tay, NH9a). 


First sta^e of preprocewinf* 

Ixi us augment the contnillcr to yield 
Z„t Z?p as in (2 10) based on factorizations of G'„, 
Ko from (2.3) and (2.5). Two cases are of 
interest. The lirsl is when we arc free to 
construct the augmented controller 7,,. Such 
augmentations do not introduce additional 
dynamics if A,, is a slate estimate feedback 
design Otherwise, the order of 7o least that 
of the plant. This introduces an additional 
control variable sy and measurement variable r* 
as in Fig. 2a. Ignoring initial conditions, we have 
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Notice that Ji, is not uniquely defined since the 
factorizations of Go, K„ are not unique. 

The second case is where K(, is already 
constructed so that we cannot access its states. 
The a>ntrol variable and measurement 
variable r^, ignoring initial conditions, are then 
written as 

r(z) = Vn'{z)y(z) - V„\z)No(z)s{z) 

= M„y(z) - K,u(z) 
u(z) = K„(z)y(z) + K,; '(z)j(2). 
s(z) = Q(z)r(z). 

In this second implementation, there is an 
implied requirement that K(, be stable, and 
therefore K,, ' is stable. If is unstable, we 
will end up with an internal instability problem 
which is not associated with the first case where 
/o is implemented as one block. This means both 
Ko(z)y(z) and K„‘(z).y(z) may be unbounded 
though u(z) = Ki)(z)y(z)V^^\z)s{z) may be 
bounded. 

Our propo.sed adaptive scheme is depicted in 
Fig. 6. In Fig. 6a, the 7,) block is implemented as 
a single block and in Fig. 6b, the block is 



Fig. 6. Adaptive scheme —a useful specialization is when 


augmented without accessing its states. So far, 
we have discussed blocks P and /q [ot /Co] in 
feedback with the various signals e^, Ma, y^, 
We now move on to a description of the 
Q, block. 

Adaptive Q 4 loop 

With Qff parametrized as in (2.27), consider a 
feedback controller Qf, with signals jt* as 
follows 

54 -f QCxkSk~ \ ^ ^nk^k - n 

= $i)krk + ^ur* I + ■ ■ • + „ (3.1) 

and parameters (time-varying in general) 

^k — \^\k ' ■ ^nk ■ ’ ^mk\' (3-2) 

The construction of and selection of 0 * via a 
least squares algorithm arc considered sub¬ 
sequently. Lemma 1 tells us that with Q 
(possibly time varying) bounded-input, bounded- 
output, then when G = Go, the closed loop 
system is bounded-inpul, bounded-output stable, 
For the special case when C?* is a moving 
average filter, 

^k ^ ^Uk^k ^ \ k^k \ ‘ ’ (^mk^k - m' >_ 

$k ~ [$Uk (^\k ■ ■ iXnk] 

then with G = Go the closed loop system is 
readily seen to be asymptotically stable under 
the mild restriction that arc bounded for all i. 

Second stage of preproc essing 

Ignoring initial conditions, introduce stable 
prefillers F, 2 Afn as in Fig. 5, to yield signals u. 
^k via 

~ ~ ^ 12MoJ\, ^k~^\2^n^k- (3-4) 

Before proceeding to complete the formula¬ 
tion of the adaptive algorithm we present a 
preliminary result. 

Lemma 6 . Consider the scheme of Fig. 5 under 
(2.20), (2.21) save that Q is replaced by the 
time-varying operator Qk as defined above. 
Then, in operator notation, 

e* = -PiiVV* + [PnUu + PijMuQkVk 

= ^k + P^2M»Qkrk. (3.5) 

Moreover, with defined obviously in terms 
of 0,. 021 ■ ■ - . ® and ek/», the correspond¬ 

ing disturbance response, then again in operator 
notation, 

~ 4“ [/21 Uo T Pn^oOk/tiVk 

= Ca T P\2^[)Qkififk' (3.6) 

Furthermore, in the scalar plant case when Q^/h 
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is scalar, (3.6) can be conveniently written as 
<Pk = [(^*-1 “ C*-i) • ■ ■ (c*-„ - Ck-J (3.7) 

^k — l in]. 

Proof. The proof of (3.5) and (3.6) is a trivial 
generalization of Lemma 3. The derivation of 
(3.7) is as follows. Let ft' = (a, . . . 0 ^^. . . 

Noting that j*-, 7 « = j*_,. for i i i, we have 

^*/»= - ■ • - 

+ + ■ ■■(3.8) 

This gives 

Ckitt = C* + . ~Pi2Mth'lk n. 

.„,]ft 

and noting that PuKySk-, = e, for 

; 2 1, (3.7) follows. 

Remark (1). That are affine in ft is a 

by-product of the fact that fy is affine in Q. This 
property is crucial to conveniently applying any 
optimization of 6, off-line or on-line. The lemma 
forms the foundation of our adaptive algorithm 
which selects ft* to minimize an Li norm on e*,„. 
(2) With stabilizing, then the effect of initial 
conditions decays asymptotically and it is 
reasonable to ignore the effect of initial con¬ 
ditions. 

Third i'(age of preprocessing 
It may be that there is a priori information 
about the frequency band of plant perturbations 
or controller non-robustness. It then makes 
sense to adapt Q only within such filter bands. 
This suggests that the residual r be preproces.sed 
by a band-pass filter to yield filtered estimates 
to be used in place of r in the adaptive scheme. 
Further details on this are not explored in this 
paper. 

Least squares ft selection 
The off-line minimization task (2.26) (with 
F(j e /?,p) when translated into the time domain 
is the least squares minimization 

min £[cic*l. (3.9a) 

.Stabilizing B 

For on-line least squares, the appropriate index 

IS 

min £[ei/^;t/fil- (3-^h) 

stabilizing 9 

This optimization leads to parameters 6* to be 
applied in the adaptive loop (3.1) and (3.2). 
Given this objective, the associated least squares 


algorithm to use is as follows: 

^k = ^k > + f\ikfkk 1. . = C* - t'kf>k 1 

= - A ,()*!/+ 

suitably initialized 

I K I " sa i) ■ ' (e* rt A M «) 

Ca "'Sa itJ> ^*A a ” Ca “ 
or 

^A ^ </ a as in (3.7). (3.10) 

Should C^(f>A)f£H\ then 0,, may be 
projected into a stability domain in that 
C^(f)A)e £H‘ holds. Reselling to zero is one 
method to achieve this. Other methods involve 
reduction of the step size appropriately. Such 
projection is not necessary when is' u moving 
average and f^A i^ in a lx)unded domain. Another 
advantage of working with FIR (>a i^ that fast 
least squares schemes with good numerical 
properties can be applied. Details arc omitted 
here, 

The adaptive DhF ( ontrallcr 
The organization ol the adaptive DBF 
controller is depicted in Fig. 6 Observe that 
once the prcfiltciing is in place, the adaptation 
of (^A via a standard least squares scheme. In 
implementing the adaplivc-C> scheme. Remark 
(4) following Theorem 1 should be noted 

Selection of P,p independent of Cj 

From the algorithm of (3.10), and updating 
the adaptive loop (3 1), (.3.2), it is observed that 
the formulation requires the implementation of 
/^,j together with the measurability of Ca. It is 
usual to have Ca derived by appropriate filtering 
of Ua, Va such as c'a ■' yi] However selections 
such as those given in Bxample (1) or (2) in the 
known nominal plant case will lead to 
involving the nominal plant G„. In the case, as 
here, when the plant is (V / f/u, such selections 
of 1^2 terms of the unknown (T This is 

not useful (or our purposes. Here wc exploit the 
fact that the pair P,,, arc not uniquely 
defined for a particular ei expressed in terms of 
ma and >*. Taking an arbitrary full column rank 
> selection independent of G, although leading 
to complex formulations for P^, appears 
reasonable. Of course, for different Py7 there will 
be diflcrcnt regression vector filtering. These 
observations, wc believe arc crucial to the 
success of our approach. 

We propose the following two selections of 
Pu 
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In the framework of Section 2. with c* = 
H(z)w^, we have from (2.14), 

= e* - /’i.-M* 

= \H(z)- PnK{Q,){I - OTCfOJj-'P^.K- 

(3.11) 

For the case e* = [«*>*], then a reasonable 
choice is as follows; 

/^n = 

I " I 

t(;- (,*■(0,OTIC).)) '/’jJ’ 



Although /^ii. implicitly in (3.13) or explicitly in 
(3.14), is non-linear and lime-varying, it does 
nol invalidate the derivation of Sections 2 and 3 
since the derivations are carried through with 
as a separate additional term. Note here 
that Ti, is not implemented in the adaptive 
algorithm and, in general, knowledge of its form 
as given by (3.14) is not required. Another 
interesting selection of is 

Pu = Ma'^ (3.13) 

Note that, for this selection of the 

implemented fillers of Fig, 6a, b arc simplified. 


4 ANAI.YSIS 

In this .section, we study certain robustness 
results for the nominal controller with (non- 
adaplive) DEF controllers and stability/ conver¬ 
gence properties for the adaptive DEF 
controllers. 


Rohustness of DEF controllers 


Theorem 1. Suppose /C„ is stabilizing for the 
plant G„ with factorizations (2.3)--(2.6). Define 
corresponding factorizations for CVi associated 
with the controller /Ci,, which does not 
necessarily stabilize (7,. Thus G^ = N^M^^ = 
*/V, where N|, , /V,, M, are not necessarily 

stable or coprime. Denote the class of all 
stabilizing controllers for Ci„ characterized in 
terms of Q as in (2.8), (2.^) as K{Q). Define 
S ~ - Gi)Mo, a frequency 

shaped version of (Go - G,). Then the necessary 
and sufficient conditions for K(Q) to internally 
stabilize both Go, G| with well-|X)sed control 
loops arc that a stable proper Q stabilizes S, or 
equivalently. 



-Q 

/ 


I 

exists and belongs to RH^\ 


QeRH\ (4.1) 


Moreover, a sufficient condition is 

\\Q\\<\\Sr\ QeRir. ( 4 . 2 ) 


Proof. Consider the stabilization of C, by 
K(Q), and focus on the relevant version of (2.4) 
in that K is replaced by K{Q) and G,, by G,. 
Straightforward manipulations using definitions 
(2.5) and (2.8) and the Bezout identity (2.6) give 
(see also Tay er ai, 1989) 


I 

-G, 


ri' 



0 
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-Oil 
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via (2.8) 
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0 M, 

K -ar'r / -Q 

-Si, Af, 
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via (2.6), (2.8) 
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via (2.5) 
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0. 
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X 
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-Q 
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.-5 

1 _ 




::]1 


via (2.8) 


1 -K,, 

- 1 

J. 

M,, (/„ 

/ -Q 

.-G„ / - 


• A'o 

-S 1 . 


(4.3) 


Sufficiency of the theorem is immediate. 
Equation (4.3) can be rewritten via (2.6) as 


/ -Q 

- 1 

-u„ 

-5 / . 


--No Mo - 


|[4 


-K{Q) 

I 

r Afn -Go 
L-No Vo 





/ J . 


and necessity is established. Applying the small 
gain theorem (Desoer and Vidyasagar, 1975), 
(/-5e)''e/?H* if ||5e||<l, giving the 
sufficient condition (4.2) as claimed. AAA 


Remark 3. To complement the theorem, we 
note from Vidyasagar (1985) the parity 
interlacing requirement for simultaneous stabi¬ 
lization: Denote the non-minimum phase zeros, 
including those at infinity, of S in 
increasing order of magnitude as a,, 02 ,... , 
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Then S is stabilizable by a stable compensator. 
Q, if the number of poles between any adjacent 
non-minimum phase zeros, (a,, is even. 

Remark 4. It turns out that if K(i)) is 
implemented as a feedback \oop consisting of 
and Q, then there is no additional requirement 
for stability. Details will be given in a 
subsequent paper. The message however is 
clear, namely that in implementing the adaptive 
Q schemes. K(Q^) can he implemented either as 
one block, or as a 7,, block with an external 
feedback loop 

Stability of the adaptive DEF controller 

It is shown in Rohrs et at. (19HS) that 
unmodelled dynamics or even small bounded 
disturbances can cause many adaplive control 
algorithms to go unstable However, it is also 
shown in Chen and Guo (19HS), Krcsissclmcir 
and Anderson (19H6) and loannou and Tsakalis 
(19S6) that appropriate simple modifications lu 
precautions are all that are needed to ensure 
robust stability. Such modilications are not 
discussed further in the present paper. I ikewise 
a complete stability analysis is beyond the scope 
of this paper. 

We stress that the proposed adaptive scheme 
is not presented as a globally stable scheme in 
the sense of the relatively simple arrangement as 
presented in Chen and Guo (19KK), Kresisseh 
meir and Anderson (19S6) and loannou and 
Tsakalis (1986). At most, local stability is 
claimed as for the schemes therein, when some 
of their assumptions are relaxed. Rather, the 
scheme proposed is presented as one rational 
approach for adaptive augmentation cd existing 
robust fixed controllers aimed to enliancc the 
performance of such controllers Ihe limited 
objective is to improve performance for plants in 
the neighborhood of the nominal plant used in 
the robust fixed controller design. It must be 
admitted that, although the prime engineering 
objective is to enhance performance at the 
margins of acceptability of the robust design; 
ironically, this is the case least subject to 
analysis, being usually outside a region for which 
even local stability results can be guaranteed 

Convergence results for adaptive DFt controller 

The adaptive DEF controller is constructed 
with the objective of evanescing for the case 
when the plant is the nominal one and the 
controller has optimal performance and enhanc¬ 
ing p)erformance otherwise. Does it achieve 
these objectives? We present convergence 
results based on the assumption that for small 
perturbations of the nominal model, the 


closed-kK>p adaptive conliollcr with \\Q\\ 
suitably cemstrained is stabilizing. Tbis assump¬ 
tion enables us to use the ODE approach in our 
analysis. 

Nominal plant c ase 

Theorem 2 Pan (i) Consider the adaptive DEF 
controller of Sections 2 and 3 applied to a 
nominal plant G„ If converges to some value 
6 * with ()*^eR\i\ then the DEF controller 
is stabilizing for (.i^) and optimum in the 
minimum variance sense of (3.9), or. equiv¬ 
alently. the disturbance rejection sense of 
(2.22b) Moreover, when K (if-0) is a 
unique optimum disturbance re)cetion control* 
ler. then if i)^ converges, it converges to 0* —0 

Part (li) With plant disturbance such that is 
pcr.sisienily exciting for each fixed Q, in that 
ElvA IK of the least squares 

algorithm converges almost surely and asymp 
lotic optimality is achieved as in Part (i). 

Proof Part (0« The first result Is immediate since 
the DEF controller is stabilizing for all fixed if 
with c R\\\ Now since (f^ is a least squares 
estimate, it mimmi/cs the index k ’1'^ ||c;* 
(f’(f\\\‘ for all A. With iC converging to 0*. and 
closed loop stability guaranlecd since R\W 
then as this least squares index 

approaches the index /: ||u* 6'f/’ r 

(I his IS a well known asynipiolic ergodicily 
result,) consequently, if* optimizes the index 
(3,6). Moreover, when K^^ is a unique optimum 
controller, there is a contradiction unless (f* - 0, 
since K(if) is uniquely parametrized in terms of 
if. 

Proof Part (n) First observe that for *1rozen'* 
if. (j k -■ di\IOif. due to the fact that e* is affine 
in Q C onscqucntly, the least squares algorithm 
is a standard recursive prediction error (RPE) 
algorithm, with associated ordinary differential 
equation (ODE) 

Rr-difr) fC 

Its Lyapunov function is V(ff)- 
\l2E\e[e,\ ^A) with V(if)-= dV!d(^ and 
-f'{ifj)R,f Under excitation of so 

that R >i). then the convergence of V ensures 
that iK the ODE globally converges to the set 
{if \f((f) - Since the theory lor Ihe class of 
all stabilizing controllers reviewed in Section 2. 
tells us that the dosed kxip system for all is 
projected into a stability domain, the ODE 
theory of Ljung (1977) now tells us that d*, itself 


AIT(; 
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a)nverges. Tlie results ui Part (i) apply to ensure 
asymptotic optimality. 

Remark. The key convergence condition above 
is that each frozen 0 be persistently 

exciting. Such can be achieved when w* is 
sufficiently rich as when its innovations are white 
with a variance bounded below and is 
reachable from see Moore (191i7) and 

Green and M(K)re (1987) for details. Sufficient 
conditions are that r* = ~ be full rank 

(this is also necessary), and that ()(z) is minimal 
in that there are no pole/zcro cancellations. This 
latter condition on Q can be by-passed by a mild 
modification to the least squares algorithm to 
ensure that ' >/c b/ for some ‘\smair’ A >0. 
Then in (4.3), R - G - R ^ dl and R > 0, 
irrespective of excitation of 

Non'nominal plant 

In the previous section. Lemma 6 was u.scd to 
generate the adaptive algorithm. The algorithm 
justified as a least squares scheme for the 
nominal case is in fact a recursive prediction 
error (RPE) scheme for plants (Aj^G,,) other 
than the nominal one. This is summarized as 
follows. 

Lemma 7. The adaptive DEF controller of 
Sections 2 and 3 applied to any plant G is a 
recursive prediction error algorithm (RPE) in 
that 

•J)* = (iz . 

(4.5) 


asymptotically stable, then the projection into 
II^aII ^ is not required. This projection is after 
all a projection into a stability domain. Of 
course for some arbitrary plant G, there is no 
way of checking on line whether lies in a 
stability domain, and thus the theorem is useful 
only when C is in the neighborhood of Go. Of 
course, as subsequent simulations show, the 
DEF/RPE scheme may converge even when the 
conservative conditions of the above theorem 
are violated, but precise converence results for 
these cases are not yet available. 

Observe that there is no positive real 
condition on the plant noise as in extended least 
squares algorithms. Here, the RPE algorithm 
‘"substitutes" a projection into a stability domain 
condition for B, which is automatic when Q is 
forced to be stable as when (7 is a moving 
average operator. 

S SIMULATION RESULTS 

Here simulations of the adaptive-^ controller 
are presented to illustrate their performance 
enhancement capabilities. 

[Example (3). Enhancement of an LOG 
Controller. 

Consider a nominal plant (2.11) parametrized 
as 

a=ioi, 


Consider that the controller K(B) with = 0 is 
an optimal stabilizing disturbance rejection 
controller for a nominal plant G„, and is also 
stabilizing for the actual plant G. Consider that 
the parameter update equations (3.10) initialized 
by W,) = 0 are modified by stepsize reductions to 
ensure that ||f)j| < d for d suitably small. Then 
the DEF/RPt" scheme is globally convergent to 
the optimal (off-line) prediction error controller 
set {(f\ ||fr||<i^}. 


Proof. That is dependent on d,. 

1)2 . ^k ] can be observed from (3.4) since 

u* is generated from B up to Bj^ y. From (3.7), 
(4.5) which is the defining property of an RPE 
scheme follows. The rest of the Lemma follows 
from standard properties of an RPE scheme with 
projection into a stability domain. 

Remark 5. The selection of a value of 6 can 
be guided by Theorem L Should be such 
that, for each k, the clo.sed loop system is 


with unstable poles at z —l.5±jl.() and a 
non-minimum phase zero at z = l.l. Consider 
the perturbed plant 




r 2.8 1 

«.=[ ‘ 1 

L-2.% 0. 

' 1 - 13 J 


r 2S11 


01, 

(5.2) 


which has unstable poles at 2 = 1.6± jl.O and a 
non-minimum phase zero at z = -1.3. Consider 
also a second perturbed plant 



which has unstable poles at z = 1.8± jl.5 and a 
non-minimum phase zero at z = -1.5. An LQG 
controller is designed based on the index (2.22) 
with Qc = Cl)Cy) and f?, =0.2704. The factoriza¬ 
tion of (2.7b) is used to construct ^ia (2.13). 
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TABLt 1 



Nominal 

plant 

Plant 

PUni (li) 

Kx)o 

nominal coniroUcr 

3 W 

S.449 

unstable 

Lor. nominal 

controUer and an 
adapted 3-term Q 

4.U0 

4 CM)5 

9 M9 

L 

controller 

.3.99 

3,6'^ 1 

7 809 


The nominal controller stabilizes the first 
perturbed plant model with closed [oop cMgcn- 
values of 0.513 ± jO.3672 and --().531K ± j0AM78. 
It however fails to stabilize the second plant 
model. The closed loop eigenvalues are 
-0.6955 ± jO.78, 0.5048 and 0.0350. 

Applying the DEF adaptive controller of 
Sections 2 and 3 discussed in Example (i) with a 
three-term scalar moving average (MA) 
adapted on-line, Table 1 summarizes the results 
for simulation of 5(XX) sample points when \\\ is a 
white noise, zero mean sequence of variance 
one. 

In both simulations, the performance is shown 
to have improved with an adapted For plant 
(ii), besides an improvement in performance, the 
scheme enhanced the overall robuslne.ss of the 
controller. Figure 7 shows plots of the plant 
output, input and estimates of fl The estimates 
converge after about 40 samples and /c,, logethei 
with the augmentation Q,,, stabilizes the plant 

Example 4. Enhancement of a onc-hori/on l.O 
controller. 

The one-horizon LO controller is a suboptimal 
scheme in relation to an infinite LO controller. 


3000 




Tim€ Somplcs 

Fig. 7. Simulation example (i). plant (n) 1 Plan! outpui. 
centre: Plant input, bottom: Parameter e.siimaics of Q 


Its performance can be enhanced by an on-itne 
adapiivc-C> algorithm developed in relation to 
Example (2) of earlier sections. Simulations on 
the nominal plant and index of Example i3) 
show that the infinite horizon index improves 
from 5.18 for the optimal onc-hon/on LO 
controUcr to 4.48 when augmented wah the 
adaptive controller. 

P ( C)N('I LSION.S 

A disturbance estimate feedback (DEE*) 
adaptive-^ control scheme using least squares 
parameter updates is described. Ihe adaptations 
constitute a recursive prediction error (RPE) 
scheme and inherit (he stability pri»pertics of 
such. 13ic scheme can, if required, limit its 
search to the space of all stabili/.ing linear pro|>er 
controllers for a nominal linear plant model of 
the actual plant Such schemes are conservative 
and can he viewed as seeking on-line a robust 
conirollcf fiu the nominal plant. The scheme 
mimmi/es the effect of disturbances based on the 
same performance criterion as that of the design 
f(>r the nominal fixed controller, thereby 
improving the performance over that of the fixed 
controller and yci preserving the original 
objective of the fixed controller design. The 
adaptive loop evanesces when the plant is the 
nominal one and the fixed controller optimal, 
bill otherwise serves to improve ihe fixed 
controller, Simulalinn results verify the 
effectiveness ol the adaptive scheme Lor the 
more ladieal versions ol the DLL scheme, the 
adaptations need nol limit themselves to being 
stabilizing lor Ihe nominal plant while adapting 
riien the potential for stabilizing a wider class of 
plants exists, but such a pv>iential would need to 
be carefully explored before appticalion 

Related research is to apply the techniques of 
this paper to adaptive two degree-oLfreedom 
tracking schemes as in f ay and Moore (IV^XI), 
and also to the situatiivn where the robust fixed 
controller of this paper is also adaptive, leading 
to an adaptive scheme which combines the 
advantages of indirect and direct adaptive 
control |sce also an adaptive frequency shaped 
Kalman Filter for improved performance in 
unknown colored noise environments (Moore 
and Lay. 19K9b)l Simuialion studies support the 
power of these approaches 

Atkntt^K’lriJffvmen! \Uis wcirlt um p;irhully sup|xprlc‘il by 
DS'K^i Aiisltiilia untl 

Kl.fTRI Ni I S 

AndcrMjn. H f) O . J H Monre ;inil K M Mciwkcs (1978) 

Model iipproKimalions viii predielion error ideniilicalion 

Autnmufica. 14, MS U22. 

( hakravarlv. A i»nd .1 B M(M>fe Aircrafl Muller 
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yhe second equality follows from a co-ordinate basis change, 
and the third by removal of unconiroltable and unobservable 
modes The venheation ol (2.6a) foihrws likewise 


Proof of l.emma 2 I l-rom Fig 2b, the rcdalionship between 
t and u IS given by 



A,. 4 

C>V;, 


I 

I) 



Q 


and 12 12) follows 

Since VV is affme in C.7 'vdh the eocfficicnts uivolMiig A^^ 
belonging to WIT via (2 lllb), then (J f fi]\' implies 
VV' c WH’ Nolicc also ihai (.y f WIT implies that M\. $ /VH’ 
and thus W ^ H\]' Ihus r H\\' implies (J c /VM' Now. 
it IS kmmn that internal (asvmpioln. ) slabililv ol ihe system 
of Fig 2 under delectabiliiy ami slabili/abiliiv ol its l>loeks 
i(m>T IS equivalent to all the iransler funelton between 
Ihe 14 , ami c, being (asymplotieallv) stable Thus mtermil 
stiibiiily (under ihe lemma comliiion) is equivalent to W 
Ix’ing (asymplotieallv) stable As m the earlier reasoning, 
internal siabililv holds il and onlv il is (asvrnpioiically) 
slable The pan (i) results ol ihe lemma aie now esiablished 
I ikewise, since A,, are boumled-input, bounded (niipui 
operalors under part (ii) assumplions, ihe fi.iri (ii) results 
follow 


Proipf (fj l.tortrnu 2 For Ihe schemes ol f ig 4 with K Ai,. 

0. internal siahililv is equivalent to the lollowing 
ecuulition on mpiit/oulpul Iransler luiKimns 

Since Vj,. f( /^ll' are copnrne. and V,,. R\\'. then 

f n|f HW 

(A4) 

MJ\:r R\\ i R\\ 

and (A -S) IS cquivalenl to (2 31 I Ihe lemma results are now 
immediate 



/Vr>o/o/ l.rmmu ^ Writing 


r4:) 

M'( 2 ) 

/'((/) 

n 12) 


V(2) 

U(2) 

^(2)1 “ 

v( 2 ) 


and noting 



/((/I 


H (2 I 

siz\ ' 


(A.3) 


straightforward aigcbraie manipulations generalize T of 
(2 16) to /((») of (2 20) when P is gcncrali/cd to P{(i\ 
Define copnrne facton/ations for (r a.s (> ^ M ‘A 

such that with the factorizations ol A,, as in (2 3). the double 
Bezout identity of (2 6) is satisfied Here M. M, Si e 
only if A’o stabilizes (/ Now 

r(i) = 7‘,i(;)»’(r) + r,,(0)e(/ “ 'r.^iowiz) 

(A f.) 
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Subsmuiing for tr,m, (2 >,i) ami appivm* the 

icfcntity. 
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r(c) - 1/’,, + 4 f, SIQ 
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Continuous-time Generalized Predictive 
Control (CGPC)* 

H Dt^MIRC lOCil Ut and V J CiAWHIROPn 

The well known arnJ vurrvA.v/u/ liiM refe rinu* (ienem/izeil f Wilu five 
Controller ((jPC ) tv rederived tn u ionhntious-ttfnc yefun^ It ia slujwn ihut 
the resulting algorithm htis all the power and fleidnUty i\f the (i/X , H ir^iowf 
having the drawbacks of the dLscrete-time forniulation. 

Key WaitK Adjpuvc toDjrol. tiuiinW sysicin dcvij^n. opunuil cumiul. piedKh^i toniiol, mtII luiun^ 
rcgulakirN 


Abstract A continuous urnc \crsion nl the di>Lfcic tinu 
(fcncrali/cd Predictive ( onuollei is prescnicil I hr 
continuous lime lorrnulaiion arises tioni 4 I mooun* nf iwso 
kinds of aniiloj;Y hclv^ecn cvnumuous and discrete time 
systems: a phwuul analog,) and an aiicrbruu analn^'v 
I mphaMS IS placcil on the diflciefucs aitsin^ Unni .i 
continuous-time formulation and the lelative mctits ot a 
continuous and a discrete-iiine approjuh are k'lven Althi»u>:h 
mainly concerned with the design algonthin itseli the papei 
also indicates how a self tunin|: vet sum tan he unplerncntcd 
Illustrative sinuilalions are ^iven 


I IN IKOin ( I ION 

In Khc I NT vr AKs, long-range prcdiciivc ccnUrol 
(l.RFK) has alinicied much ailcntion as an 
underlying design method lor sell-tuning con 
trollers (Richalet et ai. 1M7S; (utler and 
Ramaker, de Keyscr and van ( auwen- 

berghe, IMHl, Ydstie, mA: fVicrka, IW4; 

Mosca et ai , 1984; dc Keyser vt al., 19H8; ( larke 
and Zhang, 1987; Clarke et a/ , 1987, I clic and 
Zarrop. 1987). This is due to its supcrH)i 
robustness compared to some other sell tuning 
control methods such as (jMV and Pole- 
placement; it owes this good robustness property 
to the minimization i>f a multi-step cost lunction 
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The mcthvHi can l>c sumnutri/cd as follows 

1 Predut the system out|nil over a riingc of 
luture limes 

2. Assuming that the future scipotni is known, 
choose a sei ol lutiiie controls which 
mimmi/e the future errors between the pre- 
dicled luiure out[)ui and the fuitne sei|>i>int 
7v Tse (he first clemeni n(f) as a current input 
and repeal the whole procedure at the next 
lime instant, that is, u\c a receding hon/on 
strategy 

All of the above aigtnilhms were developed m 
a discreie-lmie context In contrast, we profwvse 
a method develofxd in a contuiuous-iirne 
context In particular, a (onfinuotn time 
analogue of the discrete ftmr (rPC’ ((icnerah/ed 
Predictive C ontrol) proposed by (larke ef ul 
(1987) IS developiMi; henee the name: 

( ontinuous lime (ienerali/ed IVedietive ( ontfol 
(( (iP( ) 

As will he shown, (lie ( (il*( has projHTlies 
similar to those of the discrete lime (iPC , albeit 
with a continuous time mlerprcialion It has 
similar design parameters which have similar 
effects Ihe control weighting is not essential ftu 
the control of non-minimum phase systems. It 
can easily handle ctimplex systems, such as at the 
same time opcm-loop unstable, non-minimum 
phase and higher order It can control lime delay 
systems without any problem. 

1 he paper is organized as follows I'hc CGPC' 
algorithm is introduced in Section 2 Section 3 
examines the resulting closed-IcKip system in 
detail In Section 4, the rflfccls of (XiPC 
parameters on the closed-lcHip system res|>onsc 
are discussed An illustrative simulation study is 
given in Section 5 and Section 6 concludes the 
paper 
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2 I)( Vf l.OPMt NT or I MF ( (iP( ALCKiRJ I HM 
2 1. System descnpnon 

rhe following slriclly proper single-input 
single-output system is used in the development 
of the algorithm. 

fUs) ((s) 

^ ( 2 . 1 . 1 ) 
A{s) /l(.v) 

where >Uv), B{s) and (’(v) are polynomials in 
the Laplace operator v, V'(.v), f7(.v) and V(s) are 
the system output, control input and disturbance 
input respectively. 

No special assumptions are placed on the 
disturbance l/(\) and thus the polynomial C(.v) 
will be considered as a design polynomial having 
all Its roots in the left-half v plane. The degree of 
n.v) depends on the characteristics of the 
disturbances. In many cases, the disturbance 
component oi the system is such that we would 
not wish to differentiate it; this can be modelled 
by choosing deg (( ( v)) deg(/1(.v)) - I An 
even worse case occurs when we would not wish 
even to use the system output directly; this can 
be modelled by choosing deg (('(.v))- 
deg(/l(,v)). In the sequel it will be assumed that 
deg((’(.v))-deg(A(.v)) 1. 

Note that equation 2 1.1 does not include any 
time delay explicitly. However, the time delay 
can be approximately incorporated into the A 
and B polynomials by using a suitable ap¬ 
proximation such as the Fade approximation 
(Marshall, 1M7M; (iawthrop, I9K7; de Sou/a et 
ai, DKS). Iherefore, systems with time delay 
can also be modelled (approximately) by the 
same equation. In other words, instead of a 
system with lime delay we can consider a 
higher-order system without lime delay; this is 
the approach used here. 


2.2. Derivative emulation 
The notion of emulator was first introduced in 
(iawlhrop (ldK6) to describe the dynamic 
systems which emulate unreali/able operations 
I'xamples of such unrealizable operations in 
control systems design include: taking deriva¬ 
tives of the i>utput, cancelling non-minimum 
phase zeros and removing time delay by an 
inverse delay (prediction). Control systems 
which have an emulator in the feedback loop will 
be called ' Emulator Based Control ' (EBC), It 
can be shown (CLiwthrop, 1986, 1987) that the 
EBC corresponds to the discrete time GMV 
(Generalized Minimum Variance) method 
(Clarke and Gawthrop, 1975, 1979). More 
details ol emulators and EBC can be found 
elsewhere (Gawthrop, 1987); here, we will only 


consider the emulation of output derivatives 
relevant to the paper. 

Taking the derivative (with respect to time) of 
a signal in lime domain corresponds to 
multiplication by s in the l^place domain 
(assuming zero initial conditions). Thus the A:th 
derivative of the system output can be written in 
the Laplace domain as 


y;(-s) = i*y'(v) = --y-y + '“7-7 ) 

A{s) A{s} 

( 2 . 2 . 1 ) 

and the .v*-multiplied disturbance transfer 
function decomposed into two parts as 


wheret 


s'C(s) E,{s) 

- = El (.S ) -f" - 

A(\) A{s) 

deg (/\ ) = deg (/t) - 1 
deg (/:* ) = k 1. 


( 2 . 2 . 2 ) 


The transfer function FJA represents the strictly 
proper part of s^'C'/A and the improper 
remainder. 

Using identity (2.2.2) Ta(v) may be written as 
the sum of an emulated value Ta'(.v) and the 
corresponding error E*(s) 

v;(v)- K;(-v) 4 e :( s ) (2.2.3) 

where 

V7(v)-'-^r/(.v)+S'(.v) (2.2.4) 

A A 

and 

T:(.v)-T;V'(v). (2-2.5) 


Equation (2.2.4) cannot be implemented as C(.v) 
IS unknown. But from the system equation 
( 2 - 1 . 1 ) 

/I B 

V (.v)- . )'(>) -^.f/(.v). (2.2.6) 


Suhstiluting equation (2.2.6) into equation 
(2.2.4) and using identity (2.2.2) the followng 
expression lor the emulated value of the kih 
derivative of the output arises. 

E,B /•, 

V;(.v)--*r Uis)^ ^ Vis). (2.2.7) 


Notice that the relative order of E^BIC is p - k, 
where p is the relative order of the system. For 
this term to be realisable, k p. The transfer 
function F,,/C is proper. 

The equations leading to equation (2.2.7) are 
algebraically equivalent to those leading to a 
discrete-time A:-stcp ahead predictor, but the 
interpretation is different. 


t In the rcsl of rhe pafyer. the argument of the polynomials 
will be dropped where there is no amhiguity 
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2.3. Output predii lion 

As iis name implies, predictive control is 
based on the prediction of the future output 
The GPC is based on a rannf of tutu re (Hiipui 
predictions. Thh is in contrast to the other 
controllers based on output prediction, such as 
MV and GMV. in which a predtciitm for only 
one value of prediction time is needed llius the 
predictor within the CGPC is designed as a 
function of a variable lime I init> the tuiurc so 
that by varying 7 a range of output picdictioi s 
can be obtained. 

As discussed by Aslrdm (1^J7()) (he denvaOon 
of a discrete-time predictor is siraightlorward 
due to the direct correspondence between the 
senes expansion of a discrete-time transfer 
function and the associated impulse res|>tHisc In 
other words, the discicte-nme iransiorm vanahle 
z correspemds to a forward time shift, In 
continuous-limc, Ihe task oi ilesigmng a 
predictor is less obvious One prissible approach 
IS to make use of the lad that the current 
derivatives of a conlinuous-iimc signal implv the 
future development of that signal In other 
words, if the output derivatives ol a conlimuniN 
function at lime / are known, it is possible t(^ 
predict the future values This / ahead predicloi 
is approxiniuled by a truncated Maclaunn senis 
us follows. ! 

\ I ' 

V(f + T) v(M > X »<U) i: ' ' > 

I ^ 

where 

,/*>•(( 4 7 ) (/ 'IM ^ 

!\\ predictor order. 

An appropriate value tot .V, is ilisensscil in 
Section 43; hut. roughlv speaking, the laigci / 
the larger \ should he (or a good pred.eiu.n 
As slated above, the derivatives ol ilie rurieuf 
system output (at time i] are needed m picdiei 
the future output. However, taking deiivatives ot 
the system output is not leasible hetaiist o noise 
amplification. The solution t,> tins prohicm ,s to 
replace the output derivatives in equation (.. ) 

bv their emulated values As discussed in lae 

previous subsection, d >;(.) ; 

Lulaled value o( y.U) n is given hs equa.ion 


.A funcuon fU, can he 

[x.inl („ by Us ,Uh,uI tlul (x-uu II 

:: af;:;::::;’: r’r-r a^s, .u.np .be. .,.e,,, .e 

ungin) and doing ihc expansion m 11 


(2 : 7» in the Uplttcc tkamain ilie term huHIC 
m equation (2 2 is not a jm>|Kr tian.slcr 
(unction (or k (> ITtis term can (>e decom- 
poseel. using fxvlvnomuil long ilivision, into twn 
parts 

4^’^ (2 T.3) 

( < 

wheic ti, ( IS strictly projKi, //* is 
rcmumdci i^dvnomial and 

vlcg i//J "• A p 

deg {( 'u) ' ft * 
n 


Ihc emulator equaliim (2 2 7) becomes 

T;(M //*( (Vl + / '(.V) I I' V (.V» (2 .V4) 

Notice ihat the emulator equation has two parts: 
one part can be rcali/cd by using proper iransici 
lunclnms, (he other pan CrinmU I-sing this lad, 
equation (2 .V4| can l>e lewnllcn a 


whe re 


>:(') //*/'(>) ♦ >"b0 3 M 


VVlv) '"V(M (2.VO 


IS the rcali/able part 

In the time domain, the cniiilalor cquatnm 
(2 VM becomes 

\ ;(/) h,u 1 vl'(f) (2. V7) 

where h, is a row veeloi and eonlains Ihe 
eoeHitienls of Ihe //. polynomial and u is a 
column vector which eonlains the input deriva¬ 
tives Indeed the elements ol h, are the system 
Maikov paiameleis 

(/‘uK) 

(2 3.K) 


u li<(t|u,l/|- M. „<')!'. u.in 


By substituting equation (2 3 7) into equation 
(2 ^ 1). and rearranging in a matrix lorm, Ihc 
((il)owiiig expression (or the / ahead predietor 
arises 


where 


V 'If 4 / ) - lv,/7u + Tv Y" 

I /■'■I 


Tv 


1 7 


S ',! J 
v'Ool' 


(2.34) 


(2 .3 10) 


(2.3.11) 


v - hiovdo - • 

and H IS the {.V, + 1) / {N, - p > D cocttieienls 
matrix o( the jvolynomials //,. When fi ^ \ . ihc 
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matrix H is given as follows 



where ihe /i* v are the Markov parameters of the 
open-loop system HI A, Ihis can easily be 
proven by using the identities (2.2.2) and 
(2-3,.1). If f) - ^ 1 then ht, ” 0 for k ' f) and as a 
result the number of the columns of the matrix 
H decreases with 

Equation (2.3,9) is the basic equation m the 
development f)f ( (iPC control law. however the 
following Laplace transform form of it will be 
needed to write the resulting lime domain CGPC 
control law in the Laplace dorna.n and thus to 
develop the closed-loop equations 

y'Jtv) - ls^ HS,,U{s) f 1,v V'(.v) (2.3,13) 

where 

- (I • - .v'"' '•]' (2.3.14) 

Y"(.V) -- (/(.S) + V'(.v) (2.3. 15) 

C (.V) ( (.v) 

where (#' and H are (/V, -i- 1) x (>i - 1), (/V, 4- 
l)x/i coefficient matrices of and 

polynomials respectively and Sf,. S, are 
corresponding v vectors. 

S,. - l.v" '• ■ A 1|' (:.3.Ih) 

S, -1^' '.v" ’• ■ - v 1|'. (2.3.17) 

7hc subscript 7’ is used in equation 2.3.13 to 
indicate that the Laplace transform is taken with 
respect to t and 7 is left as a parameter. 

Control order. In Ihe discrete-time CiPC^ 
(C larke ct al.. 1987), the control horizon is 
a key design parameter I he significance of this 
parameter is that Ihe predicted controlt 
increments arc constrained to be zero (C7arke et 
al., 1987) h)r future time instants greater than 
(N^). Ihis constraint is convenient for the 


t The term “predicted contri>r' is used thruughDui the 
pupiu for the future control which is to Ih* calculated, at time 
f, from the predictor niixlel in order to minimise the specified 
wist function The calculation.s arc bused on the receding 
horizon strategy; the predicted control u*(r. T) i.s nut applied 
to the sysicm over the lime interval for which the cost 
function is minimized, but rather only its value at 
/ - U) IS applied rhercforc Ihe predicted control and 
the actual future control are not the same I’hi.s matter will 
be clarified in Section 2 4. 


following reasons: 

1. It reduces the dimension of the matrix 
involved in the control law calculations and 
thus the computational burden. 

2. It enables the control of non-minimum phase 
systems without other forms of control 
weighting. 

3. It can be used lo adjust the system transients. 

As discussed by Clarke et al. (1987), more active 
control action results from larger and vice 
versa. As a result, is a useful design 
parameter 

In discrete-time, the predictor equation 
explicitly includes the future controls whereas in 
continuous-lime (equation 2.3.9) the future 
control is implicitly included in terms of current 
input derivatives and the future variable T. More 
precisely, the future control (predicted control) 
appears lo be a polynomial in T. Therefore the 
above discrete-time constraint is not as ap¬ 
propriate for the continuous-time case. In.stcad, 
we use the constraint that input derivatives of 
order greater than arc zero that is 

u^(t) - 0 for k > N„. (2.3.18) 

We call this the “control order ' because of 
the obvious reason that the predicted control is 
constrained to be a polynomial of order >V„. For 
example, the predicted control will be a constant 
for a ramp for “ 1 and so on 

'rhe control order (N,,) is algebraically 
equivalent lo the control horizon (/V,J because it 
reduces the dimension of the vector u lo 
(N^ 4- 1) X 1 and the dimension of the matrix // 
(lo (N^ 4 I ) X {N^, 4 1). However, they arc not 
physically equivalent; despite this, the constraint 
(2.3.18) has similar effects in continuous-time 
(control of non-minimum phase systems with 
zero control weighting, the larger N,, the faster 
response etc ). This will be discussed in detail 
later in the paper. 

Interpretation of the predictor. At any time r, 
the future response of any linear system can be 
divided into three parts. 

V(r4 7’)=.vU/. T)^y,(t, Y)^v{t^T) 

(2.3.19) 

where: 

— > 1 ,( 1 , T) is the response to the input after lime 
t assuming zero initial conditions at time t 

— y,(f, T) is the response to initial conditions at 
time t created by the past data, assuming zero 
input after lime t 

— n(/ T T) is the future noise component. 

Al time /, v,(r, T) is exactly known, y,,(L 7') 
depends on the future input and i^(r + T) is not 
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known. Thus, assuming that future noise is /.cm 
a predictor model for the system depending on 
the future control is obtained as 

yi‘ + ?') = ^(T)*u(f + J ) 4 y,(f, D (2 .t 2U) 

where h{T) is the impulse response of the 
system and • denotes convolution. 

The predictor of equation (2 3 9) is of exactly 
the same form. The term V entirely depends 
on the past data and can be calculated at time i; 
thus this part is related to the initial condition 
response. The part Tv /Yu depends on the future 
input in terms ol input derivatives at time t and 
the future variable T. Thus it is an appro.xima- 
tion to h(T)*u{t + T). To make this point more 
clearly, consider the following approximate 
functions. 


/i(7')-fi(T) = /i, +/i,7 [- 

yns, o 

4 • fiv (2.3 21) 

(,V, -D’ ' 

u(t + T) u(t + T) ~ u(r) 4 W|(f)7 4 u,(/) 

7 V 

^.; (2.3.22) 

It can be shown that 


fi(7')*r<(t f T) - Tv /7u 4 T,//,U (.\3 23) 


T, is given by 


T, 


y-i V, . I I • 1 

('/\r+'i )! (A', 4 .VJ' 


(2.3,24) 


and H, by 

’ 0 u 

(I 0 /iv, 



0 0 


/As 


A, ♦ 1 i 


/t I s n I 

/iv i 

(2.3.2.S) 


Note that H is of dimension (A, + 1)4 (A',, t I) 
as discus.sed in the previous subsection 

If Ny >Nu (which is the case in the C (il’t'). 
then the term T./Y.u will be much smaller than 
the term Tv 7/u. In particular, when A, —» + 
T,/7u-»0. So, by ignoring this term one can 
obtain the following approximation: 

yjl, y^ = 7,(7)*u(, + / ) -Tv /7u (2 3 26) 


worth emphasising that ihe above approximation 
can be made very close by the prx»per choice of 
these parameters 


2 4 Refrre^H f nafectmy 

Tlie abjective of the CGI\\ as in (he 
discretc iime (j|H\ is to drive the predicted 
future output as close as |x»ssibk Kv the future 
setfxnnl subject to the input airistratnls llns 
implies that the future setjioint needs to Ik* 
kncmn, which is the case in some applications 
such ns rofxMics tlowcvcr, in many applications, 
the tuiurc sci(X)ml is not known In this case, 
one could consider a const ant seifxnni u into the 
future, but trying to match the predicted output 
to ii constant value might give an excessive 
coniri>l action or overshiHit at the output Ibe 
iilternaiive approach used here is to consider a 
reference output which gtKs smiKithly Irom (he 
current output y(r) to w as lUusiratcd in h'lg 1, 
As Will be seen later, this approach indeed has 
the effect of reducing the overslHHU and the 
coniri'l activity. in addition it enables us to 
obtain model-following type co?rirol (even 
somciimes exact nuHlel-following) with the right 
chmcc o! CCiPC' design parameters 
The reference trajectory H,(r. /) will he taken 
as the output of a rational transfer function 
(reference model) with numerator H,, and 
denorninaitn R,f 


Vf , (r V) ” 


Rjs) w(l) 


v(M 


(2 4 1) 


Note that here the Liiplace operator \ denotes 
the I aplace transform with respect to future 
variable I\ not ( In order ity have the same 
structure as the output predictor (equation 
2 T*^). the reference irajeciory will be ap¬ 
proximated as a truncated Maclaurin senes 
( onsider the following approximation to RrJR^f 


RJ^\ 


X A' 


(2.4,2) 


where r,v are the Markiov parameters of 



' »'■fr'tr.fi II .1#■ ► a*- ► 



;i4wi31(-ln3 w»0i:.' 



The accuracy of this approximation dcjvends on 

the parameters A/, , K and the range of 7. It is Fi.. i (..aphical .llusir.iKm »( r tipr -a-.icgy 
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By substituting equation (2.4.2) into equation 
(2 4.1) and taking the inverse Laplace transform 
with respect to 7 (and rearranging in a matrix 
form) the following approximation to the 
reference trajetiory is found 

^ w:0, W (2.4.3) 

where 

is a row vector as defined before 

w - r|w(0 - >'(0) (2.4,4) 

where r is a column vector which contains the 
Markov parameters of RJs)IRJs), 

''i ■ ' ■ rvj' (2.4.5) 

If the future sel[;K)int is known, then this can 
be used instead of the reference output lo do 
this, the future setpoint should be approximated 
as a truncated Maclaurin senes as in the form of 
equation (2.4.3). '['his can then be used in the 
control law calculations. However, if the future 
setpoint does not have continuous derivatives in 
the given time frame, this approximation is not 
possible; unless the problem is divided into 
intervals in which the future setpoint has 
continuous derivatives. 1 his implies that the cost 
function given in the next section should also be 
divided accordingly. I’herefore, .setpi)ints which 
are discontinuous or have discontinuous deriva¬ 
tives, such as a square wave, cannot easily be 
incorporated into the design, unlike discrcte- 
timc dPC' 

Remark, In some control methods a setpoint 
prefilter is used to adjust the closed-loop 
setpoint response. In the (iMV method the 
setpoint weighting transfer function R also 
comes into the controller in this way. 1 his is not 
so in the C(iPC'; the effect of the transfer 
function RrJf^u implicitly appears in the 
controller gain. This point will become clear 
after the control law calculations. 

2 .^. Orntrol 

The CXiPC', like the CiPC, is based on a 
receding lime frame. Ihat is at a given lime t the 
ct»si function minimi/.ation occurs not with 
res|>CLi to t but with respect to a receding time 
frame whose origin is at time t. Thus for each 
time /, a pseudo input u,{r, / ), a pseudo output 
v,(/, / ) and a pseudo setpoint 7) arc 

considered where 7 is the receding time variable 
and f is a constant for that lime frame. These 
pseudo variables are delined so as to be directly 
related to the actual system variables at 7 = 0 
(sec equation 2.3.4 and Fig. 1): 

yv(r. 0)^0 (2.5.1) 

UrU,())^u(tl (2.5.2) 


These pseudo variables arc undefined for 7 < 0 
and have no direct relationship with the actual 
variables for 7 >f) In particular, it i.s nor 
generally true that ujr. T) = u(t 4- T), 

In the discrete-time GPC, output predictiont 
depends on the future controls which are to be 
determined. Suppose that the future controls are 
known, then the predicted output can be 
calculated. The reverse operation is also 
possible; given a predicted output over a time 
frame, the corrcsp<)nding future controls can be 
calculated. These future controls will be called 
predicted controls. GPC' does this reverse 
operation by minimising a cost function over the 
given time frame The hrsl element u(t) of the 
predicted controls is then applied to the system 
and the same procedure is repealed at the next 
time instant. 

Similarly, in coniinuous-time, the predicted 
output depends on the input m( 7) and its 
derivatives (see the prediclor equation 2.3.9). In 
other words, future control (predicted control) is 
a polynomial of order N„ in T II the input and 
its derivatives are known, the predicted output 
can be calculated; or given the output prediction 
over a time frame, the ci^rresponding input and 
input derivatives can be calculated. [he 
objective of the C'CiPC is then to find the input 
and its derivatives such that predicted output is 
as close as possible to the relerence trajectory 
This is done by mmimi/ing a cost function 
(equation 2..3.3), similar to the one in discrete 
case, over the given time frame. Having 
obtained the Maclaurin representation of the 
pseudo control, only the first term of the scries is 
used in computing n(0 from 2 3.2 

Finding the input and its derivatives is 
equivalent to tinding the predicted control 
u*(i, 7). Because the predicted control is in the 
form of a truncated Maclaurin series of order 
N^,, the ('GPC control input can he written as 
n(r)-u;(/. 0) 


C onsider the following cost function 


y-j' |v;(r T) - <(/, / )|-'d/ 


+ aJ IuUi.dY^t 

(2.5.3) 

where 


y:(r, 7)=y*(f + 7) - v(f) 

(2,5.4) 

V, jk 

«;(/. 7')- V 

(2.5.5) 


1 ITic term "nutpiil prediction” is used to imply ihc /-step 
ahead (/’-ahead for ihc continuous-time case) output 
prcdicnon ba.scd on the information availahlc at time f, 
where ;(7 ) is anv integer (real) numl^cr greater than the 
system lime delay 
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or in main* form 


u;u. D^Tv.u 

(2.5 b) 

r 7 1 

T s - 1 7 -.. 

K! 1 

(2 5 7) 

t . J 

■ = (u(r) U|(/) Ms.(0)' 

(2.5 S) 


T, “ mininium prediciion hon/on 
/; maximum prediciion hon/on 
A “ conirol wcighimg 

Note that \ *{i. T) is exactly given by the same 
predicior equation (equation except that 

the hrM element of V’ is set to zero i tu the 
Laplace domain equation (equation 2 .V13| this 
IS equivalent to setting the hrst rows o( (/ arul / 
matrices to zero 

Re marks. 

1 Note that a minimum prediction hon/on l\ is 
included in the cost I\ can always be chosen 
to be zero; but, if the system is known to 
have a delay, I] can be set equal to ihat 
delay. If the time delay is not known then !\ 
can be set equal to the (nr^e\t possible delay 

2 Ihc situation in Remark I is rather diftcrcnt 
from that found m the discrete time case 
where, if the time delay is riiil known, V, is 
set to the minimal delay 1 his is because it 
the actual delay is large I he eoi res(X)nding 
leading elements of H are eslimaled as zero 
If iV, set to the maximum delay and if the 
actual delay is smaller then the H polynnmial 
will be undcTparameterised and this may 
create estimation problems. I he source ol 
this difterence is that m discreie time delay 
corresponds to relative order In coni muons 
lime the same problem occurs it the order nl 
H{s) IS assumed ui be smaller than the actual 
order of B, however the problem does not 
occur in the lime delay case He me. wi- 
believe that f\ should be set to the maximum 
possible delay to exclude possible range of 
lime delay variations 

.V Returning to the continuous-time case, the 
predicted input u*(i, / ) in ihc mteryal 
T Tj- 1\ has no effect on the predicted 
output y*(f, /’) yy'ilhm the range covered by 
the cost function as long as l\ is equal to the 
system lime delay. This is the reason for the 
choice of the integration ranges m the caist 
function 2.5.3. 

4 In the cost the predicted output (not the 
output itself) is considered. In this way, we 
transfer a stochastic problem into a deter* 
minislic framework. However, this does not 
mean that the effect of disturbances is 
ignored; the predicted output takes into 


ticcouni the efleci of disturhanccs up to time t 
and thus the cfllecl of disturt'Mnccs are 
included in the cost iiidirecily 
The CTilH' control law can now K* restated 
as follimv 

I. Find the vcvo>f u which iiiimriusc's the above 
cost (2 4 M 

2 I-SI* the hrsj ciement ol u *<(/) as ccminvl 
input 

With the .substitution of cquaitoris (2 33>), 
(2 4 3) and (2 *^ 6) into equation (2 S 3). ihc cost 
becomes 

J - j [TyUn t 1\ V' T, wr d7 
l' ' 

4 AI u'TVl v Wdl (2 5 q) 

llie rnimmi/ation of the J results in 

u Mw V") (2 5 10) 

when 

K (H' lj{ ♦ A/J '//W. (2 5 11) 

/. I T^ is d/ IS {\\ 1 1) ' .;V 1 1) 

' 

/■' '■ 

/„ < ' l» '■ t'\. ' 

C S H) 

Note thal becomes submaliix ol 1] when 
7, 0 I ct ihc hrsi row ot K be k. then (lilH 

control law is given by 

u(t) k|H Y"|, (2 .5 14) 

In the Laplace domain 

f (H)- kr(H(0 )’(N)| kV"(s) (2 5 |5| 

Hv sulHliiuimg equation (2 VI5) mio equation 
(2..5 15). the (ollowing transici junction form of 
the ( (iL( tamlrol law is oblained 

f/(s) : >'H)| ^ r'(v) ^ > (V) 

(2 Ih) 

where the scalar jiain t; .iriil the polynDtiuals (>,, 
anti /,, are ^ivcn b\ 

K-kr (2,^17) 

(2 5. IH) 

f„-k/S, (2.5 19) 

Ihe (ccdback syAlcni ^ivcn by the CCjpC eoniiol 
law (equation 2 5 lb) is illuslraled in l ie 2 Ihc 
(‘GP( control law tan alw be rewritten in the 
followin)! form 


W( v) - «t>.(.v) 


(2 5 211) 
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li(t 2 Iht fccdbiick sysicm (if ( GPC 


where 


= ) + K(,v) (2.5.21) 

(l,f f ( 

. (2.5.22) 

j? 

(2.5.23) 

f! 

Remarks 

L Nole ihat the CGFX' control law is obtained 
by scllinfi the output of an equivalent 
emulator equal to the setpoint (equation 
2.?i.20). The equivalent emulator polynomials 
satisfy the pole-placement identity PC- 
(i,.A + hji but P is implicitly specified by the 
C CiPC' algorithm 

2. An important result of using the receding 
time frame is that, although the control law 
required to realize M*(f, / ) (for fixed r and 
varying 7 ) would vary with T, the actual 
control law required to realize nit) = u*(G (I) 
for variable / and fixed 7 - 0 does not depend 
on t. T hus, like the (iFH\ the (XiP(/ is a lime 
invariant control law 

3. Note that the effect of R,JR,t is reflected by 
the vector r in the gain g. 


V analysis or ini- (opc c iosi n ioop 

SYSi r M 


3.1. (ieneral closed-loop equations 
Closeddoop setpoint resp(mse. The CXiPC' 
control law gives the following closed-loop 
re.spinsc to the setpoint. 


Yis) - 




AC' f CA)A -b l\)B + g/7C 


;W(sY (3.1.1) 


Using the decomposition identities (equation 
2.2 2 and 2.3,3), one can show the following 
relationship 


(hA 4 F,B = UC 


where L^^ satisfies 



(3-1.2) 

(3.1.3) 


Considering equation (3.1.2), together with the 
equations for the polynomials Co and fn 
(equations 2.5.18 and 2.5.19), it follows that 


G,h4 + FaB = /^)C (3.1.4) 

where the polynomial is given by 

To = kLS/. (3-1.5) 

L is the (iV^ + l)xn coefficient matrix of the 

polynomials (k = \ .and the first row 

of L is zero) and S, is the corresponding n x 1 
vector containing powers of s. 


S; c . . ,iy (3 1^) 


The order of C, is n - 1. It follows from 
equation (3.1.4) that C is a factor of both 
numerator and denominator of the closed-loop 
system. Cancellation of this common factor 
results in the following closed-loop transfer 
function: 


Yis) 


_. 

A 4 4 ^B 


Wis). 


(3.1.7) 


The feedback sy.stcm given by equation (3.1.7) is 
shown in Pig. 3. 

Noie that the closed-loop zeros are equal to 
the open-loop zeros (except for one special ca.se 
which will be given in the next subsection). In 
addition to this, the closed-loop system has the 
same degree as the open-loop system State 
feedback would give the same effect. Indeed, the 
feedback configuration given in Fig. 3 cor- 
re.sponds to a slate feedback where the partial 
state and its derivatives (Wolovich, 1974; 
Kailath, 1980) are fed back through the gain 
vector k(/. rB) where B is the 1 x n row vector 
of the coefficients of the polynomial B. Hence, 
the CGPC control law is equivalent to state 
feedback for a particular set of state feedback 
gams. In essence, this state feedback is made 
possible by the polynomial G(.i), which acts as 
an observer polynomial yielding state informa¬ 
tion from the input-output data. 

Using identity (3.1 3), the polynomial Lo can 
be written as 


BkS-AkHfSn, (3.1.8) 

where 

S = [O.v.v' ■ ■ (3.1.9) 


^'9 |T 



Fui. 3 Equivaleni CGPC feedback system. 
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H, IS the full H matrix: that is the H malm when 
= -V, -- p and S/y, is the corresponding .v 
vector. In addition. L,, can he written as 

BZ„- AH„ (VI 10) 

where the polynomials Z„ and H„ are dehned as 
follows 

2„ = kS (3 111) 

(.3 1 i:) 


With the substitution of equation (3 1 10) into 
equation (3,1 7), a new expression for the 
i losed-ltHrp system is obtained as follows 


y'(.t) 


.4(1 - H„) + H{Zu + k) 


W(v) (3 1 13) 


Phis expre.ssion is used to prove some properties 
of the closed-loop system in the following 

sul^scclions. 

Closed-loop disturhance response. 1'hc closctl' 
|iK)p tlisturbance response is ^iven by 


>'(v) 


(+ ( )A 


MMv) 


(.^ I 14) 


where 4^.0 is the direcl disiurbiiriee ai ihe 
f>iilpiH and given by v) ' (('/A )l (.s). 
f^qualion (3.1 14) can be divided into tw(» parts 


A A a,, 

Xs) - , „4Mv)^ - , y, 4'(v) 

A 4 f fyP {A 4 /,,, f ^H)( 

(3 1 IS) 


Although the second part of the closed-loop 
disturbance response may be adjusted bv ( 
polvnomial walhoul affecting the closed-loop 
set[X)inl response, as a whole we do not have 
enough flexibility to adjust the disturbance 
transients separalelv from the closed-hxyp 
setpoint response 

Closed-loop control input. I'he closed IcKip 
control input is given by 


f'(v) - ^.f--- 

A 4 4^ gfl 


gC 4 C, 

A 4- 4- gW 


V'(M. 

(3 1 lb) 


w'here 


/(t) 


g 


022 ) 


Tltis may W demons!l alcd as (oflows 
( onsider the gain matrix K (equation 2 5.U) 
when A »• tl and " S\ p 

K iHl CH/) '/// /, (3 2 3) 


It followN (lom equation (3 2A) and {} \ \1) that 
ihc f>i>lvnoimal tC- \ This aunpictes ihe prot>( 
(see equation ' 1 13) Nivic that dcg(/(0) p 

!n general, Ihe analysis oi the closed hwip pole 
locations in terms id ihc ( (IK' design 
parameters seems UTi|HisMble analvifcally In this 
s|X‘cial casi-, however, this can Iv done lo vmic 
cxicni t his may also provide some insight inio 
the general case 

C iuisidcr the matrix //;, ii can be det:i>m(>i>scd 
as tollow's 


/A 


II,: 


(3 2 4) 


where ii, is a zero matrix with the dimension 
P 4 (,\ p 4 1). and Hf IS a lowu inangular 
square matrix in ihc Inflowing lorrn 


t) ' 1) 


1 /'V I 

The matrix 7, can also be deeom[>i»sed 
appropriate IV as 


/,M /.13 


(3 2 b) 


It ean be shown that tile gam matrix K (equation 
3 2 3) can K written as lollows 

Av ^ /7f/| 7 > ^;i /| ( V2 7) 

where / is a unit matrix with appropriate 
dimension Sinee H, is lower rnangulai its 
inverse is also lower triangular. hence Ihe first 
rr)w of K IS given as 


3.2. A special case 

A special case occurs when /. - f) and 
^ V; -f). the CGPC control law becomes a 
zero cancellation law; the closed-loop ['xdc 
p^dynomial has B as a factor and would give 
unstable control for non-minimum phase sys¬ 
tems. In this special case, the closed-kKip system 
is given as follows. 

y( 5 ) = J - W(.v) (3.2.1) 

Z(.v) 


or 




I) • • 0 


R.;' /v.-, I] (3 2.K) 


k - IT. J b or (3.2.9) 


T, IS the first row of Note that Ihc 

dimension of T. is 1 y p. 

I he elements of T, arc non-hricar functions of 
different powers of /', and 7>, so even in this 
simple cave a general expression for the 
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cl(>.Hcd-kK)p pole polynomial fin this case Z(s)) 
will be quite complex. Therefore we will not 
examine Z(s) in the general case; instead we will 
consider two special cases where p - I and 
p-2. In both cases R,JRa is assumed to be a 
first order transfer function 


R.(s) ^ 1 

R^S) " rv 4 1 


(3.2.10) 


One can show that, for this R„IR,i, the vector r 
will be 


Case 1. Here p -= 1 and thus X is scalar, say t,. 
Then it follows from equation (2.S.17) and 
(3.1.11) that 




1 



.V 



(3.2.12) 


Hence, from equation (3.2.2) 

Z(.v) -“^ rv 4 1. (3.2.13) 


This means that under these circumstances we 
obtain exact modeCfollowinji* regardless to the 
choice of 7, and /;>. Note that if R„/R,i ~ 1 then 
Z(s) will be 

Z(.v) - ' .V 4 I (3.2.14) 

t, 


and the pole location can he adjusted by 7, and 
7;: generally 7j is cho.sen to he zero and is 
used for adjustment. Simulation results show 
that the effect of J] on the pole location is that 
the smaller the 7], the further away the pole 
from the imaginary axis. 

Case 2. Here p - 2, thus T, “ (f., t, |. hence 

.(.v- +f,,.v). (3.2,15) 


One can then show' that, in this case, Z{s) is 
given as follows 


Z(.v)- (n f |)( ^ v f l). (3.2. Ih) 

Equation (3.2.16) shows that, in this case, 
irrespective of 7', and I], one of the closed-loop 
poles will be at the location defined by 7?,/. The 
other piilc can be placed far away from the 
imaginary axis by the proper choice of 7, and I). 
This results in very close model-following. This 
is also true for p > 2. that is one of the 
closed-loop poles will be at the location defined 
by R,i and. replacing the other poles further left 
from this model-following type control can be 
obtained to some extent Note that if R„/R,i ^ 1 


then Z(s) is given by 

Z(,v) = -(.r’ + f,,.v + /,,). (3.2.17) 

'.I 

3.3. J'he effect of common factors 

If the system model is overspecified, a 
common factor will appear in the estimated 
model when self-tuning control is used. It is 
therefore important to examine the case where 
the system does not have a common factor, but 
the model on which the design is based does has 
a common factor. Consider the following model 

A:. AX: H^H X (3 3 1) 

where A' and R' arc the actual system 
polynomials and X is a common factor riicre 
arc two questions to be answered 

1. Does the common (actor create any problem 
in the control law calculations.^ 

2 How does the common factor affect the 
control law ’ 

Examination of the decomposition identities 
(equations 2,2.2 and 2.3.3) shows that common 
factors will not create any problem in the 
solution but, for dilTerent common factors, wc 
will have different and polynomials. 
Although //a polynomials and thus the vector k 
do not depend on the common factor (this is 
apparent from the identity (3 1.^)1, this gives 
rise to diftcTcnt f/,, and polynomials for 
different common lactors Note that gain g is 
independent ol common laclor. 

As the control law is applied to the actual 
system, the closed-loop system (equation 3.1 1) 
will be given in terms o{ the actual system 
polynomials A‘ and /T. So we will have the term 
7„/T in the denominator instead of 
Ci^A 4- What this term will be as (/,, and 7,\ 
are different for diflerent common factors? 
Examination of the identity (3.1.3) shows that 

To - T’T (3.3.2) 

where T,, is ihe polynomial when A'-l. It 
then follows from equation (3.1.4) that 

Ci,A ' ^ = Llf . (3.3 3) 

Equation (3.3 3) shows that the closed loop 
system does not depend on the common factor. 

In the above analysis, we did not make any 
distinction between the stable and unstable 
common factors: the above result is true for both 
eases. Also, the above result is true when the 
system itself has a common factor but, in this 
case, unstable common factors will result in 
unstable control. 

An important feature of CGPC is that, unlike 
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pole-placement, it does not suffer from the ill 
effects of the pole-zero cancellation 

3,4. Relation of CGPC lo LQ control 
CGPC is clearly related to LQ control. Here 
we give a brief heuristic discussion of this pom! 
In Section 2 2 under the heading "Interprelalion 
of the predictor ", we discussed the relationship 
between the predicted future output v’(r4 T \ 
and the actual future output vfr + T) and it was 
shown that y*(f + C) is an approximation to the 
noise-free future output >(f + 7’) (equation 
2.3.20). It was also noted that the approximation 
accuracy depends on S\, and / From this 
argument, it is clear that when ,V,—• a; and 
,V„ = N, - p (largest possible A'„ for a given N,) 
the predicted output v *(r+ D can be replaced 
by y(f + T) (assuming no future noise) and m 
the same way the predicted control can be 
replaced by wff + 7 ). By considering that r is the 
initial time and chtxising /, - (I, then ( XiPC cost 
function can be written as+ 

I - /; 

|y'( 7 ) + Ai/ '( 7 )| d7 (3 4.1) 

This is also LO cost function lor a siiigic inpul 
single-output system. The control law mmiini/- 
ing this cost function is a (unction of / 
How'cvcr. when the control law becomes 

stationary. Therefore, when I --' • and with the 
above choices of N, and .V„. ( (il'( and 1 (.) 
control law becomes equivalent I his argument 
IS also supported by simulation 

Wc can summarize the above discussion as 
The following settings of the ( (il’( paiarnelcrs 
results in LO control 

- Wa = 1 

N, ^ t\ , - f) 

K ^ - 

7,-0 

4 TUF. FFKt-.C’lS AM) niOK I Ol ( (WH 
PARAMFn RS 

This section gives a practical guide to the 
choice of CGPC design parameters, and relaies 
these parameters lo the discrete-time (iPC 
(Clarke e( at.. 1987). 

4,1. The minimum prediction horizon 

Usually, the minimum prediction horizon 
T, = 0; but it is useful to choose 7] d when the 

^ ITie vcipoini ha.s been omiiicd lor simpliciu sinte 
closcd-lfK>p stability properties arc indcpcndcni ol the 
closcdaoop system inputs. 


hS 

system has a unie delay oi when ii is 
non-minimum ph;iNc If the system has a tunc 
delay then there »s mi |x>ini in setting 1\ less than 
the time delay smcc the corresponding output 
canniu bi* itflecied by It the tunc delav is 
m»t known then /, may l^e chosen Ciiual to the 
largest pi^ssibk dciav (Section 2 5) Poi non- 
inininnim phase s>stems. J\ may l>e chosen such 
that the ncjjaiivc going part is cscluded 
Alihtnigh It IS piHvtble to obtain reasonable 
control lor time delay and noivmininmm phase 
systems with ' 0. the above choice ot f, *{) 
will jutpiove the control |Xutormancc tor each 
case /, cories|X)nds |o V, m the diMietc lime 
tonmilation (Clarke et ul , 1UK7i 

4.2 The maximum predu tion horizon I . 

Hus paramcier is etpiivaleni lo in the 
disciete iime lonmilatum (( laike el at . 19H7) 
and has tlic same etUci in conhiHious iime In 
general, the smaller value of I, coiresponds lo 
the lasUi outpul response and ihus ihe more 
active ctmirol action tor the larger /., the 
slower output resp<mse is ohiained Iheielore. 
I\ can be used as a km»h to adjusl the rise lime 
ol Ihc closeil"loo|) outfuil response However . i( 
a relerence irajectoiv is spccihed bv the 

choice ol 7 needs lo agree wiih the mnc tunc til 
the model It the system lias an initially 
negative going non mimmum phase response, 
the minimum value ol / should covei the later 
positive-going part 

4 3 1 he predictor Ofder N, 

In the predictor design, the luture outpul is 
approximaled bv a oidei trunealed 

Maclaurin series It is obvious ilval appioximii 
lion accuracy depends on \\ 1 So S, needs to be 
chosen such that a good apprtiximalion can Ih* 
obiained over the range in whicli / vanes In 
other words, the sum ol the terms c,(r)(/'>/r’) for 
f ' sliould be reasonablv sm.ill However, as 
v37|n are not known it seems nn|vossible to 
choose V, on Ihe basis ol ihe al»ove aigurneni 

Intuitively, one may argue (hat if V, is chosen 
such that we liave a good approKiniahon ol Ihe 
open loop system step (or impulse) resjxmse 
over the range D • 7' / . then this will also 
result in a good approximation lor the fuitpul 
prediclor This is because the prediclor design is 
based on the open-loop system This intuitive 
argument can be supported as lollows f nnsider 

i AnprnKimalion n( ii lunttifm Kn 'A *110 raylm senes. 
aNiul a spetdicd jMMnl t,, »isill be iiteuf ilc ntMi lo ihi^i 
and miiccuriiic away from that fxvinl C)l coufM:. the range m 
which Ihc appr'isimaluffi is g(MHi dcfKnds on the finkr i»f 
favlor series On <»ur ease ) 
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the output predictor (equation 2.3.9) when 

Nu = 0 

>*(t + 7 ) = y:(7)u(t) + T;v V’ (4.3.1) 

where 

(4 3.2) 

As one may notice, >’,*(/) is the approximate 
step response (truncated Maclaurin series) of the 
open-loop system. We believe that if N, is 
chosen such that >'*(/ ) is approximated well 
over the range 0' 7 " will also be 

approximated well over the same range as it is 
the initial condition response of the same 
system 

As a conclusion, choosing N,. such that the 
error between the real and approximate step 
responses of the open-loop system over the 
range (J ^ 7 - is reasonably small will be a 
good criteria. 1 his is also supported by 
simulation results. 

Consider the following illustrative example. 

A(\) .O.lv f 1 

/i(.v)" .v(.v' f 1) 

rhe actual and approximate step responses of 
this system for various N, over the range 
(C 7 - i .'S is given in Fig. 4. As can be seen from 
the figure, for a larger 7. a larger N,. is needed 
and vice versa For example, for 
should be 12 whereas for 7, ■ 3. A'^ “ 6 will be 
sufficient. 

It follows from the above discussion that there 
is a close link between 7. and N^.. Iherefore 
these two parameters should always be con¬ 
sidered together. However simulation studies 
showed that a large number of systems can be 
controlled reasonably well with the value of 
Ny - 6. For the simple plants this value can be 
reduced even further Hut, lor the complex 
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systems (at the same time open-loop unstable, 
non-minimum phase and higher order) Ny can be 
as large as 30 depending on the complexity. This 
is the case generally with the time delay systems 
since their approximation becomes non¬ 
minimum phase and higher order. For example 
for the double integrator w'ith the unit time delay 
(e 7v ')/V, needs to be chosen around 20 when 
7; = 2. 

Note that wc do not use the step response 
reprc.scntation in the predictor design; we 
introduce the step response only to give a 
criteria in order to choose N^. Flowevcr, it is 
interesting to note that A, will never be as large 
as in the control methods based on step or 
impulse response representation such as DMC or 
IDCOM (Cutler and Ramaker, 19H0; Richalet 
et ai, 1978), since is chosen in order to 
approximate a part of step (or impulse) response 
not all of it. 

Fhcrc is no physical equivalent to in 
discrete time hut alf^ehraually N,, is equivalent to 
N, (maximum cost horizon) since both have the 
same effect on the dimension of the matrices. 

4.4. The control order 

The control order A',, can be seen as a design 
parameter to constrain the predicted control 
For example A',,--0 constrains the 
predicted control (though not, of course, the 
actual control) to he constant in the future; 

“ 1 constrains the predicted control to be a 
ramp and so on. The smaller A',, the greater the 
constraint on the predicted control ad vice versa 
Note that in this way wc indirectly constrain the 
control u(t). No mathematical argument has yet 
been devised, hut it seems reasonable that more 
constraint on the predicted control u*(/) means 
more constraint on n(r) or vice versa. As a 
result, a small value of A',, gives less active 
control u{i) and slow' output response. Increas¬ 
ing N„ makes the control and the corresponding 
output more active until a stage is reached where 
any further increase in A',, makes little difference, 
Simulation results show that a value of A', = 0 
gives generally acceptable control for a large 
variety of systems. But an increased value of 
is needed for more complex systems (high order 
open-loop unstable and non-minimum phase 
systems.) 

The control horizon A'„ in discrete time is an 
alternative way of constraining the predicted 
control. Because of this, they have similar 
effects; but they arc physically not the same. 
However, the alternatives are mathematically 
equivalent since both have the same effect on the 
dimension of matrices and thus on the control 
law calculations. 
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4,5 llte model RJR^ 

The closecl-kK>p system respimse can he 
specified by a reference irajcctory defined by u 
model The CGPC control law tries to 

match the system response to the model output. 
But, in general, n is nt>i pi^ssiblc to obtain exact 
model-following since C(iPC only changes the 
closed-loop pole liKalions A special case where 
exact model-following is obtained is examined in 
Case I of Section 3.2. A first order R^/R^ 
generally seems an appropriate choice In ibis 
case, the CGPC places one of the closed Unip 
poles at the location specified by the rest 
away (the distance depends on the choice of !\) 
from the imaginary axis when ^ \\ p and 
A - (I (see Case 2 of Section 3 2) 1 bus it is 

possible to obtain a very close model-lollowing 
with the right choice of T; Ihis niodel-lolltvwing 
property becomes less accurate as decreases 
trom V, ~ ff- Por a small such as b or 1, no 
longer model-following is obtained instead ihe 
effect of R,JR,i IS that it smooths the response h\ 
penalizing the overshool. 


S A SIMl'l ANON SIIDV 


^ 1. iV( )t\-udapti I 'c V imulatiofi\ 

CXilH' design paramelcrs (.\\. /,. I\, a, 

Rrt'Rj) have ihe same effeds m boih ilii* 
adaptive and non-adaplive case. In this section a 
set of non-adaptive simulatums arc presentcil lo 
illustrale ihc effects of these parameters on the 
properties of non-adaplive ( CiPC Snnuiations 
for the self-tuning CGPC are given m Section 
5 .C All of Ihc simulations were perlormcd using 
the MATLAB package program running on a 
Sun 3 workslalion "Ihe examples used m the 
adaptive and non-aclaplive simulalions are 
tabulated below. 


Example 1; 


B(.vi 

A(s) 


1 

s(,s' ^ 1) 


C(.v) ^ O.iv 0 ^ - 1 


Example 2 


A{s) 


0.2-s 1 

.s(v' ^ 1) 


( (A) -O.Iv *t .s ^ 1 


Bis) r 

Example 3 -= — 

A (a) V 

C(.s) = (,v ^1)' 

Bis) 1 

Example 4; - ,—^ 

‘ A{s) A‘ t 1 

( (a)- A ^ I. 

Note that the polynomial ( (a ) is a design 
polynomial, not a part of the system 


AEE Ihf ffleas of /. and Eiumplc 1 
simulated to illustrate the eflects ol T: and In 
the simulalions, the amirol wx*tghtmg A and J\ 
were choM'n to b<* /crt>. R^ Hj to t>c 1 and the 
sample inierviil ii» Ik (11 sec 

Figure > illu>trjiies the efteci of 7> where 1] 
vanes from I to with an increment of 2 ITie 
predktOT ordei .V\ and the contrtd order A, were 
chi>Nen lo bt* 6 and 3 respectively, that is \\ ^ b, 
X ' 3 In the figure, the upfKi graph shows the 
step responses the lower graph shows Ihe 
cli>sed liHAp pidcs l<Kus as 7 varies Ehe fastest 
rcs|>4>nsc in I ig 5 ciu responds lo /> ' 1 As can 
bi‘ seen Irom the graphs ihe response iKcomcs 
slower and |>oles nunc towards the origin as I\ 
increases 

If a model R„/H^ is s(KLified, the effect of fr 
mas be differcni fhis is IxTuu.se the sfsecifica- 
lion given by the model and /; cimiradict with 
each other In this case /> should be chosen by 
ctinsulenng the lime consiiini of the model 

Ihe effect of A,, is shown in Eig b For this 
example, V, and 7; were chosen to lx b and 2 
res|X'ctivelv and V,. is vjiied limn H lo 3 Hu* 
up|xr graph shows the step respi uses and ihe 
lower one Ihe poles hxus as A’,, vanes For 


I fmvC' rr^lX^lfii' 




f- 


r l(, ^ lllut.iraiion <»t the clfcci of / 
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6 l^c effect of the coiiirnl itnlei 


Nu ~ 0, the output response and the correspond¬ 
ing poles arc marked oti the graphs. I’he cuitput 
response become taster and the poles move away 
from the imaginary axis as /V,, increases Note 
that iV„ and 7] have opposite ettects that is, when 
is increased response becomes taster whereas 
when T 2 is increased response becomes slower. 

5.1.2. The effeet of R„IRa As mentioned in 
Section 4.5, the reference model R„/Rj has two 
functions: it can either be used as an 
approximate model or to penalise the overshoot. 
This section again uses Example 1 to illustrate 
these two functions of R,JRj. In the simulations, 
A and were chosen to be 0, N,. to be 6, R„ to 
be 1 and the sample interval to be 1) 1 sec. 

Figure 7 shows the simulation result with 
Rti A 1 (model = l/.y + 1). 7'. - 1 and N,, ~ 3. 
In the figure, poles arc the corresponding 
closcddoop poles and ym is the model output. 
Note that CGPC control law placed one of the 
poles at ~1 and the others far away from the 
imaginary axis in order to approximate the 
model. Also note the impulsive behaviour of the 
control at the initial time; this is because a 
third-order system was made to closely follow a 



PDk-t 4;, 


0 . Z ‘ 4 ’ b ■' ’> 

. ..' 1 .. .. 


Fk. 7 The iisv of R^iRj us a rLTcrcnic.' model 

first-order model In the example A', was chosen 
to be N„ ~ N,. " f) in order to obtain the best 
approximation to the model If A', is chosen 
smaller this relationship becames less accurate. 

The use of R„/R,/ in order to penalise the 
overshoot is shown in Fig. H. In this simulation, 
and 7^ were chosen to be 1) and 1 
respectively. 1 he upper graph shows the step 
response when Rj - \, the lower graph shows 


t "InvciJ liM'p 'Tr 


loop ^irp ^r^p 0 ^^w v 


rorutoi 'i£Ti,nJ 


- ; ^ 4 ft ' s ^ 

Fi(. 8 Fhc use of In penalize ihc over.shtH>l 
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the step response when K,, 7i 1 Note that 
the use of for this example, compleiciy 
removed the ovcrshcKH. 

5 1-3 Non-mmimum phase systems In con¬ 
trast to the GMV algorithm, one ot the 
properties of the GPC is that it is able to control 
non-minimum phase systems with zero control 
weighting. The CGPC also has thi.s property. 
Example 2 was simulated to illustrate the control 
of non-minimum phase sysieins. In the Simula- 
non the following choice oi parameters were 
used and the sample interval was chcjsen to be 
(105 sec. 

R. /R. - 1 

a; - 6 
= 0 
7 ; - 0 

J \.. 3 
A - 0. 

Ihc simulation result is illustrated in l ig 9 As 
seen from the figure, output response is 
reasonable but il can further be improved by 
increasing A;, and using the reference model to 
remove the overshoot. Ihis is illustrated in Eig. 
10 where - 2 and Kj 1 5a + 1. As seen Irum 
the figure the response i.s much improved 

Note that the ehoiec ol \ f) is not 

possible (when A ~ 0) lor the m>n-minimum 
phase systems since it removes the system zeros 
So lor a non-mimmiirn phase s>slcm must be 
V ; ^ P (when A ~ 0) 

5.1.4, If me delay svsterm. Example ^ (a 
double integrator with unit time delay) was 
simulated to illustrate the ability of the ('(iP( lo 
control lime delay systems A second order Pade 
approximation of the lime delay was meorpor- 
aied into A and H polynomials ( (iP( design 




y -r 0 '» 3sn 


I . 

h M ; . '4 il Jl; 

l iu IH I I* wkMh \, ‘ ^ .5*^ > 1 Sa * I 

was based on the resuliing 4th order approxim¬ 
ate system without time delay, but simulation 
was performed with the exact lime delay The 
(’(iP( paruriuters used m the simulation arc m 
follows 

R. 1 

f<„ (I tVA i I 

h I 
I - 
2(1 
<1 

A - 0 

In the simulatnm. the sam[>lc interval was 
chosen to be (I : the result is shown in Eig 11 
As can fvt‘ seen from the figure, c<mtrol 
petiormanee is gooti. but this performance is 
obiaincd at the expense of mereased N^. 
However, this increase m \\ did not increase the 
eompuiational burden significantly since N,^ ^ il 
Although / IS chosen equal to ihe system lime 
delav. tl IS also possible to obtain g<H>d control 





Fifi 9 Control of d niin-minimuni phavL' ^vsicm 


J H. 11 ( nnirnl ta a hiric Uclay vy^icm 
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when T; =0. However, in fijcncriil, chcK)sin^ 7’, 
equal to the system delay improves the control 
performance. 

.‘5.1.5. I.Q conirot As discussed m Section 
3.4, the following setting of the CGPC 
parameters gives LO control, 

RJRu= 1 

A. - A, - p 

My -* 

7’| - 0 . 

A double integrator (hxamplc 3 without time 
delay and ('(.v) ~ .v 4 l| with the following choice 
of CGPC parameters was employed to illustratc 
this relationship. 

/V, - 12 
A., - Ml 
A - 1 , 

The closed-loop LO poles for the above choice 
of A are found as: "(1.7071 ± 0.7()71i. 

The closed-loop CGPC poles were calculated 
for 7> - I to 1\ ~ H) to see whether they 
converge to the LO poles, fhe resulting poles 
are given below. 

7;-- 1 - (). 1.546 ±0.bO.54( 

.0.6021 ±0.7020; 

.0.6041 ± 0.6087/ 

■ ■ 0.60.36 ± 0.7(K)2i 

.0.70.30 ±0.7071; 

• ■0.70()5 ± 0,707,5/ 

• -0.7071 ±0.7071; 

.0.7071 ±0.7071/ 

• -((.7071 ±0.7071/ 

= 10 -0,7070 ±0 7072/ 

As seen from the CGPC poles for /[. - 6 CC 1 PC 
poles and I.Q poles become the same. 

5. 2. Parameter estimation 

Any control approach can be combined with a 
recursive estimator to give its self-tuning version. 
In the self-turning version of the CGPC, 
parameters of A and H polynomials are 
estimated by using the continuous-time least 
squares with forgetting.! Estimation of 
continuous-time system parameters can be 
performed by using a discrete-time estimator, 


t We wUI nol give Ihe details of the algorithm here; more 
detuils appear in (ti«w(hrt>p IW) 


however for a continuous-time system a 
continuous-time estimation algorithm naturally 
.seems more appropriate. Moreover, Gawthrop 
(19H7) points out that discrete-time least squares 
is an approximation to the continuous-time one 
and so there are probably belter ways of 
approximating the continuous-time least squares 
and thus obtaining better estimates. 

In discrete-time least squares, the inverse of 
the information matrix, so-called covariance 
matrix, is updated. For numerical reasons, 
updating IS performed by factoring the covari¬ 
ance matrix and updating the factors; such as the 
square-root or 6 /-D factorization algorithms 
(Bierman, 1977). These methcxls guarantee that 
the covariance matrix always remains positive 
definite and thus non-singular. However, in 
CGPC there is no requirement on the system 
order and there may be situations where the 
system is overspecified. In this case the estimates 
are not unique (any common factors together 
with the actual parameters will be a solution to 
the estimation problem) and thus the informa¬ 
tion matrix is singular. Despite this, the above 
methods will try to update the inverse of a 
singular matrix which does nol exist. In contrast, 
in our simulations, we update the information 
matrix itself and then take its pseudoinverse 
(Lawson and Hanson, 1974). Ihis gives a unique 
solution which has a minimum Euclidean length 
among the other solutions. Of course this is not 
a numerically efficient algorithm but it is 
numerically stable 

Further work is needed to elucidate the 
fundamental and numerical problems arising 
from the essentially singular information matrix 
arising from the overspecified problem. 

5.3. Adaptive simulations 

In the first part of the simulations (Section 
5.1), properties of the non-adaplive CCiPC and 
effects of the CGPC design parameters were 
illustrated. Since these properties will remain the 
same in the self-tuning case, in this section we 
did not reconsider them; instead wc simulated 
several examples in order to illustrate properties 
of the self-tuning CGPC. In the simulations, 
parameter do of the highest order v term of A 
was fixed to I and thus one less A parameters 
were estimated. The following are common in 
the simulations. 

L All simulations start with a set of wrong 
parameters. 

2. Estimator parameters: forgetting factor and 
initial inverse covariance are 0.2 and O.fKKX)!/ 
(where I is the unit matrix) respectively. 




Coniinuous time gencraluted predictive comr<>l 


3 Sample interval is 0,05 see. 

4, Each figure consists of four graphs the first 
one is the setpoint and output (some include 
model output as well), the second the control 
signal, and the third and fourth the estimated 
,4 and B parameters. 

5 3.1. An example. A non-mmimurn phase 
svsiem (Example 2) was simulated to give an 
example for the self-tuning ( (iPC Simulation 
was performed with the same C CiF\' parameters 
as in the non-adaplive simulation c('rres(H>nding 
to Figure 10. Two ft and three A parameters, the 
same number as actual parameters, were 
estimated. Simulation result is shown in Fig 12 
As can he seen from the figure, parameters 
rapidly converge to their true values Much more 
rapid convergence can he ohtamed if the initial 
inverse covariance is chosen zero However, ihis 
results in large variations in the paramelers at 
the beginning and this mav give rise to imtiallv 
large output. Note that, after convergence, the 
output is the same lor adaptive and 
non adaptive simulations as expected 


V 3 2 kffta €»f the mnie in prasiice. control 
systems are suh(eci to disturbances of ail kinds, 
such as stepwise Kmd disiurbanoes, high 
frequency sensor or thermal noise In self-tuning 
a>ntro!, aldioo^h the underlying design inethivd 
may have a giMni setpoint resptmse and 
disiurhance re rectum, ilicse dislurhances miiy 
give rise to wrong parameter estimates and thus 
result m a bad ci>ntrol jK-rlormunce or even an 
unsiable system In general this problem ciin Ivc 
avoided it the signal to noive ratio is high 
In order to see the perfonnance* of the CXiP( 
when noises arc present, we simulated Example 
2 with an added random disturbance (Claussmn 
white noise with zero-mean and a standard 
deviation of 01) diieci at the output In the 
simulation exactly the same parameters as in 
Section 5 VI were used Hie siimilation icsult is 
shown in i ig I V As can Iv seen Irom the figure 
dcspiic the noise paiameier estimates and the 
coniroi (H*rloimancc is giHul 

riiere are some fiuciualions in the estimated 
paramelers after time 40 svh' I his appiears to be 
due to the exponential torgctling f iClor causing 
the earlier part o( the data (where the signal is 







Fff, 12 Solf-luninc ( (»PC (f2) 


Yu, M I x^fTipk 2 ^Uh iiitUtd lunikmi diMurb«rux:!i!» 



72 


H. DfcMiRc kKju; and P. J. Gawihrop 


large compared to the noi.ve) to be forgotten. 
Tlie fluctuations are then due to the lower signal 
to noise ratio in the latter part of the simulation. 

5.3.3, Time delay systemx. In non-udaptive 
CXjPC, time delay systems are approximated by 
a higher-order system without a delay. This is 
done by approximating the delay and incor¬ 
porating it into system polynomials. The CXiPC 
design is then based on the resulting approxim¬ 
ate system, However, in the adaptive case, 
knowledge of the time delay is not available. 
One possible approach to this problem is to 
estimate the delay together with the system 
parameters (Besharati-Rad, l‘^8K). Then the 
above design procedure can be applied. How¬ 
ever, there are two drawbacks of this method: 
first, it will increase the complexity of the 
estimation algorithm, and second, each time 
instant we need to approximate the delay and 
then incorporate it into system polynomials to 
obtain the approximate system. Fhe second 
approach, which removes these two drawbacks, 
is to let the estimator obtain the approximate 
system by specifying a higher-order model to the 
estimator. Ihis is the approach taken in the 
self-tuning CXiPC . Note that this approach 

I AtiU ijHiipui 

1 ' / 1 , 

O' 


1 S i ' 

Ilk,. ; 1 

- ■ I ' ' ' I 

m ' , . ... 

I) '> 10 1 .'ll Id 111 4*1 


r^hnulr\l h pirimrirrs 
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0 M) 1 ^ .'(1 1(1 ll >|. .I*. "^O 

■■(j rsomjTrJ p4.r4n»rirr\ 

I (1' : 

0' ■' , . - 

U! ' . • - . .... 

0 ' 10 !’I .;0 ’,[1 4^ JO {S ^0 

F ui 14. Selfauninii amlrol of a lirnc tlclay sysicm. 


resembles the approach in discrete GPC where 
the time delay is taken into account by 
estimating a higher order B polynomial. Here we 
take the delay into account by estimating 
higher-order B and A polynomials. 

Example 3 was simulated to illustrate the 
control of time delay systems by self-tuning 
CGPC. The CGPC design parameters and 
polynomials were chosen as in non-adaptive 
simulation (Section 5.1.4) expect that was 
chosen here = O.Kr -f I since R,/ = O.bv 4 1 
gave very slight oversh(X)t. Four A and four B 
parameters were estimated. Simulation result is 
shown in Fig. 14. As can be seen from the figure 
control, performance is very gcHKi. Note that 
estimated system is non-minimum phase as 
expected. 

5.3.4. Over parameterization. There may be 
some situations where the parameters of the 
model are overspecified, this results in common 
factors in the estimated model. Pole-placement 
algorithms (Wellstead et al., 1979) fail under 
these circumstances. In Section 3.3 the effect of 
common factors is examined and shown that, as 
for the (iPC' it is not a problem for the CGPC. 
Fhis will also be illustrated by simulation. 


4(1 

. i'Turn! Mjjti-ii 


li' i' :() :s (d 

ciiimaied H p ji WTKirrs 


111 10 

ruimaieil A jUfanictm 


5 !(' :o 50 

Fio 15 . The effect of over puramcienzaition. 
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Example 4 was simulated for this purpose with 
the following CGPC parameters: 

= 1.5a ^ 1 
Ty - 0 
/;=: 1 
N, - 6 

N.-o 

A - 0. 

One more each of A and B (3/t and 2H) 
parameters were estimated. The simulahon 
result is shown in Fig. 15 As can he seen from 
the figure there Ls a common factor at v - 0 m 
the estimated system model 1 his common tacioi 
did not affect the control performance If the 
simulation is repeated with exact parameten/a 
lion, it can be seen that the same output 
response is obtained. 

6 (;()N( I i;si()Ns 

In this paper the C(jPC'. a conimiioiis iimc 
analogue of the GPC developed hv ( larkc vt al , 
(JMK7), is presented, lake its discrete time 
counterpart, the CXiPC algorithm appears to be 
a useful design method. A large sanety of 
systems can be controlled reasonably well b\ 
only adjusting the prediction horizons 7, and L 
keeping the control order as zero but. for the 
more complex systems (at the same time 
higher-ordcr, open-loop unstable, non-mimmum 
phase) an increased value of i\„ is needed In 
general, it is advisable to keep small in order 
not to increase the eomputalional burden, 
instead use reference-model R„/R,i to adjust the 
transients. Apart from this can also be 

used to obtain model-following type control 
(sometimes exact model-following) with a 
large 

The relationship of C CiPC with EO eoniml is 
also examined, and it is shown that l.(J control 
can be considered as a subalgonlhm ol the 
C'GPC. In addition, it is shown that iime-delax 
systems can be controlled in a similar way in 
GPC by increasing the system order in order to 
accommodate a rational approximation to the 
delay. 

An important feature of the CGPC algorithm 
is that, unlike polynomial 1,0 and pole- 
placcmenl controllers, it is not necessary to solve 
a Diophantine equation to compute the control 
law. In particular, the case of systems with 
cancelling pole/zero pairs Is considered and 
shown to cause no difficulty. In addition, unlike 
the (jMV algorithm, control weighting is not 
necessary for the control of non-mimmum phase 
systems. 


ITic t CiPC algorithm um n^lso Ik further 
generalized by using an auxiliary output 
approach and dynamic control winghiing Hus 
will pn^babU make ii jK»\sihlc to considei the 
iiHHlcIrefererHe and [xolcpiacenient conirol 
(and also their detuned versions) m the CCifX' 
frame work 

In these resiKsis. the C (ilX is vupertuiaily 
similar to its discrete liriic coumerpart, but there 
are imjHirtani differences in the way in whieti 
output prcdiciton and cimtrol weighting is 
accomplished An example of this is that, 
whereas the (iPC consinuns the predicted 
conirol difference to tx* zero after V, samples, 
the C CiP( constrains flu ptcdicfcd contoff so 
that ilie derivatives of ordi i liicatci than arc 
zero 

In bncl. ( (»P( fas (iP( ) ap[H*ars to be ii verv 
suitable umlrol algorithm toi the sell tuning 
control applications loi a large vanelv o( 
systems 
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Robust Gamma-stability Analysis in a Plant 
Parameter Space* 

J. ACKHRMANN tt D KAhSBAUl Ri and R MTl NtUl 

Polynomial parameter dependency oj the charai tenstn pidxm^mial <>/ a 
control system tan he handled by cifustruk tinj^ stahihfx (tnd petfcnmance 
regions in the parameter space. I hts ndyustness analysis is applied to 
automatic steering of a bus. 


Key Words - Rc'husi umiiol, siahihis. t.oniio| iii\alvsis cuu(UM»ns 

applications, auromobilcs 


Abstract- ( liven a charaL'lcnstu |X)l>nitrnial wlxtsc 

tixrfticicnts depend fxilynomially on / ufii;eri.iin p.ii.inuMris 
the following rohusincss prohlcni arises Deicrnnni sshuhcr 
all the riKits ol the |x»lynomial are loc ated in a fnesc rilx'd 
regK»n 1 in the complex plane for all admissihle paranieiei 
values lo this end, the Ixiundarv s-tT ot I is niapjH'il into 
the paramcier space A necessary and sntficient amdiiion l'’r 
I sliihility of an operating domain in p.iranicicr space is that 
n contains at least one T stable point ainl is not mti iscited 
l>v the image ol ^91 This condition may be tested graphicallv 
hv gridding / 2 parameters and projecling all htniiulanes 

into a iwci-diincnsional subspaee nl the paranuiei space 
I inallv the method is applied to a track guided bus sxiih 
uru Tiain mass and vclociiv 

1 INIHODlif'ilON 

C oNSiDi R A linear, limc-invananl s\sieni with 
characicnstic polynoniial 

P{s, q) - fl„(q) -k ri,(q).v 4 a ri„(q)v'' (I) 

where q = [^i. d veclor of real 

uncertain parameters in a set of allowahle 
perturbations. a(q) = [rti,(q)- tJi(q) d„(q)| is 

the real coefficient vector ot the polynomial (1) 
Assume u„(q) ■(' for all q c and let 
V “04 jro. 

(jiven r, a subset of the complex plane, and 
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we dfc inleresicd tn it yes no rinswei lo ihc 
lollowihg robusi stabilily qtieviion; Is /’(.v. q) 

I 'Slable lor all q t (F* I hat is, does /*(.v, q) have 
all Its iiK»ls in I' (or all q< (.J"' 

Noting that analysis lt>i>ls are fti .jUenily used 
for desi^in by trial and error, it is desirable to 
gam msi|,»hi from ihc analysis bcvontl a yes no 
answer In ihis regard, one wants to krnrw how 
small I can be made, how large (J can be 
made or how ctmlroller parameters must be 
changed such that robust stability for a given I 
and IS achieved Ilrese ijucstions motivate 
the approach of this paper which is aimed at a 
study of the conflicts and |>ossible tradeoffs 
between I and 

The diHiailty of the robust stability analysts 
ahne defKmds on Ihc kind of ctK.‘ttkient 
functions a(q), the number / of parameters, the 
shapes ol and I and on (he [polynomial degree 
n 

F ra/er and Duncan have shown that for 

continuous coelfrcicnl (unctions ii(q) a necessary 
and sufficient condition lor robust staltility is that 
(i) there exists a q “ q,, e {> such that /*(v, q,,) is 
stable: and (n) /'(v, q) does not have roots on 
the imaginary axis for any q r t/ 

( ondmon (i) is easily tested by checking the 
stability ol P{s,q,,) for an arbitrary q<) r If 
f*{s< q.») IS unstable, Ihen we cannot have robust 
stability, if Pi.s, q^) is stable, then condition (i) is 
satisfied Fra/er and Duncan (192V) have also 
shown that condition (n) is satisfied if and only if 
P(\, q) neither has a real ompi at v 0. i c 

rtnlqi^d for all q € (2) 

nor an imaginary pair of roots at ; « ijru. r e. 

del H., ,(q) # d for all qc (J (3) 
where , is the lust but one Uurwit/ matrix. 



76 


J. A<'KI:kmann et al. 


i.c. 


H„ ,(q) 


fli(q) “i(q) 

Oo(q) fl2(q) 

0 (i|(q) a,(q) 


0 


0 ■ ■ • a„-,(q)J 

(4) 


Nolc that the ease of a root crossing the 
stability boundary at .i = ^ has been excluded by 
the assumption a„(q) >0. In fact we could have 
divided /'(.v, q) by u„(q) in order to make 
the polynomial monic. It is easier however to 
deal with polynomial cocflicient functions 
ttofq) • ■ • a«(q) than with rational coeHicient 
functions u„(q)/u„(q) ■ |(q)/ujq). Thus a 

robust stability analysis for the case of 
polynomial cocflicient functions covers the ease 
of monic pt)lynomials with rational cocflicient 
functions. 

fn the recent literature on robustness analysis 
studies were made how to make the “for all 
q 6 (.T’ condition tractable. Typically Q is 
assumed in form of a box 

q,e\q.;q:\, . = 1, 2 • • /. (5) 

Kharitonov (1978) proved, that for interval 
polynomials, i.c. u, = q, i. it suffices to check 
four specific vertices of the box (5) for stability. 
For affine coefficient functions n,(q) " u,,, ^ c'q, 
Bartlett et ai (1988) have shown that it suflices 
to check the exposed ed^es of Q for stability An 
edge q^ “ q^ can be tested by Hurwit/ matrices 
of and /'(.v, q,^), (see Bialas (1985)). A 

simplified version of this test was given by 
Ackermann and Barmish (1988): The edge 
q,, ■ q„ is stable if and only if H„ i(q,,)H„' ,(q„) 
does not have negative real eigenvalues. For 
multilinear cocflicient functions, sufticicni condi¬ 
tions for robust stability are available (Zadch 
and Desoer, 19b3) and necessary and sufticient 
conditions are obtained only under restrictive 
assumptii>ns. 

For the analysis of systems with general 
multilinear or polynomial cocflicient functions in 
the characteristic polynomial, one of the 
possibilities is brute force gridding of Q. It is 
possible however to use the above results in 
order to reduce the gridding dimensionality and 
computational effort per grid point (Ackermann 
etuA. 1988). 

The Frazer-Duncan condition (ii) can be 
tested in different ways: 


1. Zero exclusion from the value set. Flere the 
condition (ii) is interpreted as P(ja>, q) #0 for 
all u) and all q c C?* frequency w is gridded 
and for each frozen frequency w ~ lo* the 
complex set 

(/’(jw',q);qeC)} (6) 

is constructed. (This construction may require 
gridding of Q.) must not contain the point 
zero (see the survey by Barmish (1988) and the 
references therein). 

2. Parameter space approach. Here the set of 
all real q is investigated such that P(s, q) has 
roots on the imaginary axis. 

Qiiu = {q: q) = for s<jme w 0). (7) 

A necessary and sufficient condition for stability 
robustness is that (i) there exists a q<» e C? such 
that P(s, qo) is stable and (ii) does not 
intersect Q, 

( 11 , q) may be written as 

q) = Uiti)\ q) + }u)V{(o\ q) (8) 

where 

L/((o\ q) <i„(q) - « 2 (q)r/r’ + r/jfqlff/ - + • ■ • 

(y) 

V{(t)‘\ q) = u,(q) - o,(q)w' + Os(q)«>'* - + • ■ ■ 

( 10 ) 


For (o “ 0 the real root boundary (7^,. “ 
(q-^o(q)”d} *s obtained. For n) ' 0 the set 
C^iri. " Iq- q) - 0 and T(fi;\ q) ^ 0 for 

some <ir>()} must be described, then ™ 

C>H< 

Frazer and Duncan (1929) apply the Silvesier 
test to the polynomials (/ and V' for relative 
primeness. I his results in a condition 

delH,, ,(q)-() (11) 

for U and V’ to have a common root, where 
H. ,(q) is given in equation (4). Thus (o is 
eliminated By Orlando’s (1911) formula, 
(Ciantmacher, 1959) 

dctH.. ,(q)-(-l)'”'' "•=(«„(q))'’ ' 

I n 

U (.v,(q) + .s.(q)) (12) 

I’ k 

where .v,(q), ^^(q) are roots of P(.v, q). Obviously 
detH„ ,(q) = 0 for i,(q) = jw, .r*(q)= -joj; i.e. 
eim is a subset of = {q: det H„. ,(q) = 0}. 
But det H„ _, also vanishes for a pair of real 
roots .y,(q) = a, .v,(q) = - u. (In the elimination of 
(o the restriction to real values of to got lost.) 
The values of q that are contained in but 
not in give rise to unstable polynomials. 

Thus for robust stability also (7u must not 
intersect Q. 
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In this paper we derive a description of by 
solving the equations V{o}\ q) = (*. v•(,o^ q"= () 
for 

= ■ 9/. W) (13) 

= - «//. at) (14) 

to IS not eliminated, thus the restriction lo real 
values w>0 is preserved. A strength of the 
approach considered here is its ability to handle 
general polynomial coefficient functions, i.c 
i(q) and therefore L'(aJ^ q) and V'(ai'. q) may 
be polynomial in q, and q. and arbitrary 
continuous in q^, q,- q,. q^ and q, art- 

calculated for each admissible grid jHiinl 
q* ■ ■ ■ <]*< w*. Real values </, and q. obtained 
from (13) and (14) must be located outside the 
operating domain, i.c. 

‘/il (IS) 

or 

k: it/.n 

7 'hiis two parameters q, and q, can be treated as 
continuous variables, only (urther parameters 
must be gridded. 

In the next section the concept is applied to a 
simple example with affine coefficient lunctions 
In Section 3 the approach is gcncrali/cd to other 
regions F in the complex plane. Polynomial 
coefficient functions are treated in Section 4 I he 
example of a track-guided bus shows the 
practical application of Ihe method 

2 AN EXAMPLE WITH AFFINE ( fit IFK II NI 
FUNCTION.S 

Consider 

P{s. q^.q:, qx) = (12 - 4i/, ~ q^ + </,) 

4 (-44 4 19r)| 4 4 (/,).\ 

4-(78-9.625^, - 

4-(-24 4-lf«/|).v'4 Ihv" (16) 

€(2; 2.5), ^je(l;2|. 

(./(a>^ 9,, q2. qy) = (12 - 4^, - i/. 4 9d 

- (78 - 9.625^, - I6t;:)ra- + Iba/ = (» 

V(a>\ q,.q2, qy) = (-44 4- 19£/, 4 Hi/, 4 Hi/.) 

- ( -24 4 16^1 )a)'~ (I. 

(17) 

Solve these two linear equations for q^ and q; 

_ 4(64ru* 4 4i/iW‘ - 26m' - 2 ~ 

256m‘ - 24^u' - 13 


9: 

512at*‘ - 2642w* 4 .51 25i/.u»- 

+ 2M»9m' 46i/, ■ 104 

:-'(25(h./'-'24.3«» .13). 

Singularities of ihcNc curves can tkrur at 
frequencies where the dcnominaioi vanishes i.c 
aij - 1 l or iiij iHc siahilitv tHiutuiary in the 
(</i </:) pl^nc has an asymptoic. IXHausc (|7) 
rcprcscnls iwo parallel hut not itlciUical lines If 
rfy is chosen such that the mimcratoi of 

the cxprcssnins lor or q^ also vanishes at 

then an entire straight line belongs to tiu* 
stability bounitarv tor ■ n), In the cxiiinplc 

this iKcuiN for lyV - (I and llu equation of 

the straight line is given by ( (1. t/,, q , tyV^I 
eonstant ^ I (1 ^ " d I his value is 

iHitside the o|X‘iiHing domain 
boi each tued q^ ■ lyt t (0. >| and each fixed 
inin* a fioinl q[(q*.<tf*). (ydc/tvin*) is 
obtained bor siabilily robusliiexs all Ihex' points 
must satisfy [(/,. q,] i l|2i 2.^1 11 ; 2\\ 

bor a graphical representation in Ihe (i/,. (/.) 
plane a reasonable slepsi/e in r«» must lx chosen 
(like in Nvquisl plots) arul for ;ach q\ a 
eontmiious stability fvoundarv is obiained All 
these boundaries are ()iO|eeled into the same 
(r/,. t/.) plane I he pri>|ettion ol the three- 
dimensional (,^box IS a rectangle I igure 1 shows 
the complex rooi bt>undaru*s ((‘KH) and Ihe real 
root Kiundaries (RRIM Uuiq) 12 4</j qy\ 

q \^ (I for q\- I). ().7V I S, 2 2.S and V 

It IS seen that the original operating domain is 
not entirely stable bor q, 4 the complex root 
boundary intersects (_> lor frequencies m« 

|l lrnl 24| We could (or example try a 
comjxnsaiion for this frequency hand oi reduee 
(> 10 f (2, 2 q: f 11. I H| in order to fihiain a 
stable ofxraling domain 

bor other examples with additional paiam 
eters q 4 (h an / 2 dimensional grid lor 

q\. q 4 qi must be chosen bor each grid |>oint 
the stability Ixnjndary may be projected into the 
(fy,. r/; )-planc arul compared there with the 
rcclanglc q, « (t/, , t/,‘ |, c/.. c ((/, , </,' |, 

1 (.ENI KAl l/AIION }(i I MAHK.HV Kl l.IONS 
I'he designer o( a control system is not 
satisfied with mere stability for the given 
operating domain; he wants to achieve pcrlor- 
mance One aspcxi tif performance can easily fx 
captured m the present context, that is the 
IrKalion of the closcd-ltwip eigenvalues m a 
subset of the complex plane Thus properties 
like mimmum damping or negative real part can 
be assured. Also the designer may have dune a 
design for nominal parameter values and wants 
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F'Mi I ( i>mplcx ((’RH) ami real rtuM bminJanes (RKIi) l(»r ihe example I 16) Bounilanes lor r/, I). D 7S. 

I S; 2.2S and S art projctied inln (he (^y,, ( plane The pri»jceln)n of the Hox is a reelanglc The system 

IS stable for ry, f (2, 2 S|, ry. f (1, 1 H| q, f |(l, 


to guarantee that poles do not move too tar from 
their nominal positions under the influence of 
parameter variations, figure 2 shows an 
example, where three eigenvalues have separate 
allowed variations and all other eigenvalues 
should remain to the left ol a further boundary. 

I'hc continuity argument of t ra/er and 
Duncan (1929) is valid also for this case: If q 
varies continuously in Q, then also ii(q) and the 
roots of P(s, q) ^ [ 1. v • • .f"|a(q) vary con¬ 
tinuously. rhe roots are not allowed to cross the 


boundary i3f ol the I -stability region as they 
move away from a f'-slable starting position. 
This IS equivalent to saying that the image a 
of 3\ in q-space must not intersect Q. 

Like in the case of the left half plane Q is 
composed of real root and complex root bt)und- 
aries: Q , - , U . U CV. . U Qr. > In 

the example of l ig 2 the real root boundaries 
are given by 

(q:nrT.,q)-()}, 1-1,2,3. (IH) 


X 


M .- 

X 



I'he set r is a union of two complex and one real 
set, thus the complex boundary is a union of two 
branches. In other examples L may be the 
intersection of two sets, e g. damping greater 
than l/\/2 and Re .v, < 1. In this case the 

boundary is defined and parameterized 

piecewise, in the example, with a = (o, 

C>imi "" {q:/"(-l ^ Jfv. q) = 0 

some a e [0; 1)} (19) 

0im:-(q;^'(“n ^ j«.q) = ^^ 

for some o e [ 1; ^)}. (20) 


The image of the complex boundary is the union 

Fmo. 2 Crosses indicate closed Ux)p psde locatioii.s lor r . . I i D 

iTOitmiJil parameters ty m/,. r atability is detined by til IHC segments C:im i Vim 2 

I’oundarics arovind (-roups of figcnviiiues In the following a computationally tractable 
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TV 


description of 

G*im = q) = 0for some s e 3r) (21) 

IS given. 

In analogy to the frequency w we define a 
scalar parameter a called "generalized fre 
qucncy” that parameterizes ihe complex 
hranches of The boundary ^P may (or 
example be described by a sufficiently dense hsi 
ci(a,), (i)(a,), 1=1,2, 3.... or by coniinuous 
functions o(a), io(tt) on each branch or segment 
of ar for a in an index set /„. i.e may be 
written 

U (22) 

For a fixed cr=cr*, i.e. a fixed complex 
conjugate pair 5(a*) = 4 jo)(a*) on 3V, 

SC' parameter values q such 
that P{s(a*), q)-0. dF is symmetric with 
respect to the real axis. 

Each branch of dV must be either a finite 
closed contour or a contour extending to infinity, 
such that Sr provides a clear distinction between 
a T stablc and a F-unstablc location for each 
root of P(s, q). 

The main result of this section is formulated as 
the following boundary representation theorem 
A preliminary version of this theorem has 
appeared in a conference paper (Ackermann and 
Kaesbauer, IMHJ). 


Boundary representation theorem 
M t C?ini(^») tf only if 

J„(o). d^(a) ■ ■ ■ dja) 1 


{) 

0 


(23) 


for some a e where 
da{(^) = \ 

ddot) = 2o(a) (24) 

d,^,(cr) = 2a{a)d,(Q) 

- [oHa] ^ u)Ha)\d, 

/ = 1. 2 • n J 


Proof, Consider the polynomial P(s, q) ” 

11, Y • .v”l*(q) for a fixed q = q* I' 
complex conjugate pair of rewts on f9r at 
(7(a) ± joHcr). a e/^. if and only if 

^('. q’) = \aHa)^ w^{a)-2a{a)s ^s‘]R{s, q*) 

(25) 


q*) = ■ -f -s” 

= (E j • -s" ‘|r (26) 


IS an arbitrary polynomial with real aKlficieniSi, 
Equivalently (omitting the dependerny of n am) 
ui on it for noiai]i>nal amvemcnce) 


•(q)- - 


1 2ii 0 0 

0 

(t 1 2o 

0 

(10 1 


o' 4 ifl* 


.2o 


0 1 



(27) 


The matrix in (27) is triangulai wiih idcntiviil 
elements on the diitgonals Ificreforc us invciM: 
I) has the same siruciuic lire entries d, of l> arc 
determined (lom 

d^^ d, d„ 

f) do 

d) 

do 


I 2fT f/' t fif 
0 1 2o 

0 0 1 


y 


f) 


(I 

(T i 
fJ)* 

2o 

I 


1 0 

(I I 0 
0 0 


0 


(2K) 


which lorccs 


0 


1 


d, ■ 1 
2odo f d, (I 
(fj f Of )do 2fid, f d; - I) 


{o' ^ ii)')dr, > 2od,, , r d„ - (I 

(2‘^) 

do - 1 
d| - 2o 

dy ■ ?Pld, ( 0 + ft) )i/o 

d„ 2od^ , (o' 4 i0^ )d„ >. 


where 
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Premultiplying equation (27) by D we have 
^ Q\mi^) if only if 

r^o b 

0 Jo 0 



Ihc last n I rows ol (3(1) have an uncletcr- 
mincd right hand side because the remainder 
polynomial is arbitrary. There only 

remain the first two rows Mence we conclude 
that q* c if and only if 


Jo((r) J,(a) 
0 Jn(o) 


J„ ,(a) 


The fixed value q*" may he replaced by the 
general vector q to obtain equation (23). I’hus 
the proof of the theorem is complete 
Hy equation (22) we now conclude that 
q C; C?i,„ if and only if there exists an a c such 
that equation (23) holds. In other words, in 
analogy to the u; sweep over the imaginary axis 
in the robust stability test of Section 2, an 
n-sweep along all branches or segments of 3V 
must be made Poi each a ihe set ) 

calculated from (23). 

Example 1 Imaginary axis, (t(o)“ (), f(C(a)- 
n, a c [0, ^ ) 

^A. - 1 

J,-(l (32) 

, I ™ c\ ii, I 

I 0 n (I O' ■ [0 

0 1 0 (I •""io 

This expression is equivalent to (‘^) and (10). 

Example 2. Unit circle, (T(n)“(i. rr (a) 
ar'( a ) " 1. n e | 1; 11 

iio - 1 

J,-2n (34) 

J, *, ~ 2a J, “ d, 1 
J,i J| J^ ■ d,, 0 

0 Jn r/. • • • J. .J ^ loj ^ ^ 


(35) 


Numerical values for a may be substituted into 
(34) and (3-S). Alternatively the expression may 
hrst be simplified symbolically. Premultipiving 


(3.5) by 


s-l 

‘ 1 


L-i 

2a\ 

yields 

{) 

Jjj J1 J? * ■ ' 


— J,) 

0 J(, J| 



The term d„ with the highest power of a has 
been removed. This reduction prtKcdure may be 
aintinued n/2 times for n even and (n-f l)/2 
times for n odd. The resulting equations are 
for n even 

- , > ■ -J,, ft Ji) ■ ■ d„ J 

,-J, -rA, (I d.. ■ ■ d„, , 


and for n odd 

J(« 11> * 

~ J(«4 nI 


- Jm 0 Ji, Ji 

-J, -Jo 0 Jo 


|ii(q) 

(39) 


In (38) and (39) the highest degree polynomials 
in a have been reduced to about half the degree 
arising in (33). 

Example 3. Logarithmic spiral z " e' ” ■ 

This curve is of interest for sampled-data 
systems, ('onstant damping lines o = ±rri) 
(r ^ - ^/Vl u - damping) arc mapped via 

- e'' -c”' • c^'"' into the z-planc. l et a “ (dT, 

a e I'.t; 0], z r cos a -i- je‘'' sin a. r 

and ?/ now play the role of a and (o m (24) 

Jn - 1 

./,.2r = 2c-a,«« 

J, ^= 2rJ, ” ( 3- (a )d, , 

“ 2c'cos a J, - e^' '"J, i 

Remark 1. In (3b) a simplification was intro¬ 
duced that reduces the degree of the polynomials 
m a for the example. The question may arise, 
for what other examples this idea may be useful. 
It is easilv verified that k premultiplications of 
(23) by 

0 (r(Q) + (u'(a) 

s= , T / <4i) 

--1 2rT(LT) 


modify it to 

, J :iJ 1 ■ ■ Co (^ Jo J 


Co 0 Jo J, ■ • J„ A 

f) fo 0 Jo ■ ■ ■ Jrt ii 1 

rtn 


|-(q) 

(42) 
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where c,-= -d,t[a‘ ■¥ a simpliftcation in 

terms of a is only obtained if a‘(ft) 4 j,, g 

simple expression, e.g. for a circle with center 
zero and radius R. For Example 3 the reduction 
matrix is 


r 0 e^" 

l-l 2e‘"cosa 


(43) 


where 


A ((i, q) 

X£t' 

<f.,( n I 

«/i(a) 


>'(n. q l 


1 it 


i(«» i 


a(q) 


(4>!) 


All calculations are iliUic in the real held 


For boundaries with more complicated functions 
(T^fa) + o>'(n) it is recommended to use the 
original form (23). 

It should be noted however, that the resulting 
equations in q can be modified by the alune 
premultiplicalion. If, for example, only one 
coefficient a,(q) is a nasty nonlinear function of 
q^ and all other coefficient functions are linear 111 
then a form (42) can be chosen in which o,(q) 
is multiplied by zero in one of the equations and 
it can be solved for g,. 

Remark 2. Note that a related boundary 
representation was derived by Siljak (1%4). 
Instead of our starting point (2.“!) he usc-s the real 
and imaginary part of P(.v) where v* - A* 4 jf j 
I'hen 

/•(.v) = Re P(A, 4- jV,) 4 j Im /’(A', 4 |>,) 

n n (44) 

= 2 + j X ^ A ~ *’ 

A " 0 A ll 

the two equations for real and imafzinarv parts 
are related to (23) by 

ReP 

Im/\ 


1 -a(o) 

Af()(ft) 

f/i(a) ■ 


0 (ia((v) . 

. 0 

cl„(a ) • 

■ i(‘») 


(4M 


The advantage of the form (23) is that tmly one 
recursion for the J* iS needed instead nf two 
recursions for Xf, and V*. 

Remark 3. Equation (45) is useful also for the 
zero exclusion approach to robustness analysis 
[see Barmish (19H8)]. The robustness test is 
based on the condition 

0<(P(j,q):qeC?i ve^r} (4b) 

For the complex boundary, this is 

equivalent to 

0<{Af(a, q)4-jy(ff.q):q6 e. a^L) (47) 


4 SOU HON li)\ MU>SS 

Vi)k AM) ^ 

^or a given |H)lvnoiiual 

P{s. q) - 11. V. V V l*(q) ^49) 

the complex r(H)t boundaiv in q sp^ut is goen bv 
the q values salisiving <23) As \n the example 
ot Section 2 an / 2 dimensional gnd foi 

qv * l^f. 1/4. . c/zl chosen I oi 

each gfii) point q^ qt (^M n\ay be solved (or 
a) and t/dqtf, n) lor lohusl slabililv q, 
and </; nuisi be outside tlu* mierval (5) (or all 
a t This eoiuhlion may be tested graphically 
like in lag I 

riie ddficulty of soKing for (/, ami q 
obviously de|H'nds on the kind ol loehuient 
(unctions a(q) In the example (Ifi) the solulion 
o( the two equations (H) lor i/, and */ is easy, 
because the coeftKienI lum lions ii(q) aie altine 
linear in and q > In tins seehoii lire sfilution 
lor j>olvnomial mefficieiil lum lions m r/, ami i/ 

IS given In this case (2') imiv be written 

/ Uq. ) ^ /i(3/;)<yi ^ hiqj)q\ b 

K " ^ K^Jq UfT " b 

Ihc I, and g- ‘*tc poIvnomiaK m (/ and 

continuous functions of q^/ and a k ami m are 
chosen sucli that and ,i;„, are not idem k ally 
zero 

for each q„ and a. (5b) deseiibes the 

mierseclions of two algef^iaic curves in the 

{q^. r/ j plane These solutions q^, q> o( (SO) are 
calculated by elimination of one vaiiable sav k/i, 
by the resullani method, Imding the real rf»ois 
r/V Then the corresponding q\'' are given by a 
linear equation (in nonsingulai crises) I h(' 

resultant meihtKl is also contained in S4)tlwaie 
packages for symbolic mam|nilalioMs like 
REDlid (sec Hearn (lOH?)] 

The method ol finding all real intersection 
jximts of (5b) IS reviewed here following Brill 
(1925) 

Expand (5b) bv the redundant equations 

/ - (I - 0 

fq, 0 er/; "■ b 

/A/l . (,S1) 


(I 


J 
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and write in matrix notation 



'Fhe vector \ \,q^ q\ *| is nonzero, thus q^p simultaneously, q^ may be determined from 
(52) is equivalent to the condition R - det R -- 0. (52). Note that m the generic case rank 

The resultant R is a polynomial in q.. It is easily R “ /c m - 1, thus one linear dependent row 

generated symbolically lor general q., and n, and column can be removed from (52). A 
c.g. by a procedure provided by KFl)U('K For further reduction of the matrix dimension by one 

finding the (real) zeros we have to substitute to a square of dimension k m ™ 2 can be 

numerical values for the grid points qt/ and a*. achieved by allowing r/, to appear also in the 

[^t i /2 - i/VMie a real root of/^(^/,) - 0 matrix. Both steps can be accomplished by 

Now determine the corresponding real value removing the equations /i/7' ‘ “ d and gc/, ' = 0 
</7^ that satishes both equations (5(1) with from (52) 



TTiis rectangular matrix is now made square by including the last column into the last hut one as 



(54) implies T ^ det T = 0, and q^ can be calculated as the ratio of two determinants 
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= det T, ;cJetT> (5^^ 

If detT.^O and delT, then cy, gi>es tt> 
infinity for that q 2 If both deierminanis vanish, 
then the algebraic curve is reducible 
A singular case arises, if jn (52) rank 
- 1. In a similar way wc renune 
additional columns and include riune columns ii> 
square the matrix. Again we arrive at det T (I 
hut now' two entries m T are of quadratic, third 
order etc. depending on the rank dehetenev of R 
[see Brill (1^25)]. In this case two or more values 
of correspond to one value of q>. 

Ri'mark 4. Ihe reader may wonder wh> we dig 
out an old elimination method inslead of using 
the modern approach o( (iroehner bases [see 
Buchberger (I^^H5)|, that is also conliuned in 
Rfc'DUC'h 3.3. The method ol Ciroehner basev 
does a symbolic evaluation of del'F, and (let 1V 
for arbitrary n and q> and yields very com¬ 
plicated expressions l or then numerical evalua 
lion, however, r/.- r/da) must be calculated by 
factorizing the polynomial R{a, ij:) lor given a 
anyway In the example of the next section it 
was not possible to compute a (iroebner basis in 
reasonable time 

V APri.K AMON rr) A tKA( K (it IDt I) lb S 
A Daimler Benz 0305 bus is guided bv the 
field generated by a wire in the sired 
(Darenberg. 19K6). The Iineari/ed system with 
actuator input w - steering angle rate, and 
output V " displacement of front antenna from 
the guideline, has the transfer lunction 

q^, qi) 

q^{4H2H(^q, 4 3HH600v 
~ (I6^f^74 -^fKKK) 4 1077r/,7;-v t r/'t/Vs ' 

(57) 

Note that initially the problem had four interval 
parameters; 
m masvs 

J moment of inertia with respect tii vertical axis 


/i friction tAH'ffKicnl (1 for dry road. 0 5 for 
w(M road) 
r veliKiiy. 

Ihere is a rclaiionship J ■ cm with a constant 
< for the empty bus and tor the full bus In 
between these cases the passengers could cluster 
either in the ccnici or at the ends of the bus and 
thereby change c Fhis second-order effect was 
neglected by the psycholivgical asMiinption that 
passengers disiribuic unilormly over the bus. 
After siibsliiuiion of J ■ cm it turned out that m 
and did not af'ipcar separately n. the dynamic 
equations but only as one parameter 
(/. f 05 tons. 32 ions| t he first parameter is 
the bus velocity ry, ■ r For i» - (I the bus is 
not controllable and f»(A. 1), r/.) H T'-stability 
IS required in the speed range (/,f 
| 3ms ^ 20 Ills ‘1 

Ihe resulting o(Kraling domain is shown in 
Fig 3 The desired I region is the lefi sale of a 
hvjX'rbola, i e jxunis v " o i pu satisfying 



mi 0 3.51. (5K) 

Since this papci is concerned with analysis the 
controller C (a ) taken as given 

0^75 f 1(N3K^ A 2344 a ' 

((v)^ , - (59) 

1.5025 A I2S()a 4 5(h' 4 A^ 

( (a) was determined by Muench (lOHfi) using 

q^'lonr,;^ 



hii> A f^pcrnlin^ ckmiain of Ihc iiiJicpm;»liL huxk Mcrcring 
(ccab^k ^vslcm vcl(Kilv. * m//i. where m * maM. 
fi - trKiHm a>cfficK:iU 
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simultaneous pole region assignment for the 
representative operating conditions A, C and 
D in Fig, 3 Thus there exists a e such that 
the closed l(K)p is F-stablc and condition (i) of 
Frazer and Duncan (192^) is satisfied. 

The closcd-ltK)p characteristic polynomial is 

- numerator of [1 + C(5)G(.«, qf,, 

H 

I •! 

A lengthy but straightforward computation gives 
the coefficients 

a„ ~ 4fi3 X 1 

a, = 328 X lO'V/]' 4 3(v4(l x KC’r/, 

Uj 5.72 X 4 113 x lift/; 4 4250 x 10*’^, 

a, == 6,93 X nfqiq, 4 91 1 x 10'^, + 422(1 x Uf 

a, 1,45 X l()'’^fr/, + 16 S x Hfq.q, 4 338 x Kr 

a, = 15.6 X lO'tyiV/;; 4 M{)q\q , 4 1 .45 (b(>) 

X Ufqtq. 4 13.5 x It)'’ 
fl, 1.25 X I0'r/f(/:: 4 16.Kf/fr/, 4 53.9 
X H)'q,q, 4 270 x lO' 
a^ ~ 50r/ |f/;i 4 10H0r/|f/ , 

«H ^ f/W 

I'he real root boundary (or <r=-0,35 is 
de.scribed by 

/’(-0.35, q^. r/0 ” • TJ.iihiqiqi 5339(/;(/, 
.3077</|r/. 3540213(/i 

f 9946676c/ 1 4 2208293) = 0. 

(61) 


I'he complex root boundary ST is parameterized 
by f7(ar) = c». <u’(cir) = 25cr^ - 1 . 75 ’. Q e(-»; 
-0.35]. Hence any real polynomial which 
vanishes at ,s(o) = ofer) 4 jcyj(o) must have the 
factor 

a‘(a) 4 (u'fo') - 2o(cr).v 4 j* 

= {Ifyar — 3.0625) - 2or.v 4 .v‘ 

and the coefficients in the boundary repre¬ 
sentation (23) arc given by 

d„(a)= 1 

d,la)~2a (62) 

d., ,(a) = 2ad,(a) - (26a- - 3.0625)cy,. ,(a). 

Substituting the d, and a(q) into (23) and 
collecting terms with the same power of </, the 
following form is obtained. 

fJa) 4 |/i„(a) 4 /,,(rt )93j</i 

+ (y^nln) +/;i(a)</; 4 f2:(a)r%]r] = 0 (63) 

S<.(n^) + U'in(cr) 4 gn(a )c/ 3 j(/i 

+ k.’o(fl) + t?ri(rt )(/: + a)c/^jc/f 0. (64) 

The resultant of (63) and (M) has the form 

-f /i d a )q > 4 /j 4 ( a Uj ;! (). (6.>) 

If all its roots arc complex (or a given a = a*, 
then there exists no real pair t/. for which the 
closed loop has an eigenvalue at o(rt*)4 
j(u(a*). On the other hand if there are real 
solutions q\‘ o *), then the corresponding q\'\ a *) 
is given by the root of the greatest common 
divisor of (63) and (64). By (.SS) and (56) for 


ikH 

L'’pp 


V 







Cit;, -( 


-IV' 


- a 





q,[^r 


26 


Fk; 4 the liiick guulcd bus is rnbustly [ stahlc |scc (58)] m the operating (Jomain a speed of 

4ms * the real hkM at o • '0 45 is erihcal rt is the real part of the eigenvalue on the eomples boundary 
For 20 m s ‘ n, 0 60 is the enlical po\c liK'alion for the full bus and a. - -2 97 for the empl\ bus 
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each fixed a = or* and q. ~ o *) 


At /» , i At f: j 
ifo Si ISo S2I 
At i j/n 


/^t 




For physical reasams we are only inleresicd in 
positive solutions X). q, > (). Figure 4 shows 
the r-siability boundaries The vertical line at 
r = 3ms ‘ is the real root boundary (RRH) To 
the left of it is a branch of the complex renn 
bi^undary (CRB), further branches are the 
curves to the right. It is seen that the o|x^ratirig 
domain Q is T-stabie 

In fact we can read from Fig 4. how much Q 
could be expanded without loosing F-siabilitv. 
e g- the velix'ily may be increased to 27 5 ms 
if all other circumstances allow a safe ofX'ralion 
at this speed For the maximum design speed of 
2()ms ' the critical generalized fiequcncies at 
the closest boundary points are n, - {).M (i.e. 

.v(ai) ~ —0.69 ± j2.y7) for the full bus and a.- 
-2.97 (I.e. .s(a.)- '2.97± jl4 75) for the 
empty bus. At the minimum speed of 3 ms ' the 
eigenvalue at .v = -0.35 is the critical one 


6 ( ONC l ll.SIONS 

A parameter space method for robustness 
analysis was derived It is based on a boundary 
representation theorem for the complex root 
boundary. Only continuity of the cixOicienis of 
the closed-loop characteristic polynomial with 
respect to the uncertain parameters must be 
assumed; otherwise the boundary representation 
is completely general and gives necessary and 
sufficient conditions for I'-stability ol a given 
operating domain. A broad class of regions I for 
the desired eigenvalue locations can be treated 
The complex boundary is described by two 
equations. It depends on the kind of coefficient 
functions, how easy or how difficult it is to 
reduce the two equations to one by eliminating 
one of the uncertain parameters For the cases of 
affine, multilinear and polynomial coefficient 
functions the general solution is shown. Even¬ 
tually / - 2 of the / uncertain parameters must be 
gridded. The final numerical calculation and lest 


for each gnd point may be diMie numcnc'ally 
However addilKinal insight Ixyond a yes no 
answer to the r-stabihty question can be gained 
by a graphical illustration of the computed 
boundaries n p*0|cction on a two dimensional 
subspace of the parameter space 

The mclhtHl is recommended for pniblems 
With a small numtxr of uncertiitn parameters and 
polynomial c^xlticicnl functions One example of 
this kind IS a track-guideil bus. for which a 
robustnev.s analysis is jx'rformcd 
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On the Attitude Stabilization of Rigid 
Spacecraft* 


C HRISTOPHER I RYRNI SI and Al BER IO ISI1K)RU 

While rif^id body nwdel\ for spaiccraft wtih /no loninds are locally 
iontrollable and loctdly reachable for rrun/ aifuufor i fm/if^nrafiirns, jfhese 
sysfenis canno/ be locaHy asyrnptottcallv stabilized by smooth feedback but 
usinff methods from a i*eneral nonltnear feedhai k desif^n (haav, feedback 
laws are derived which control the closed-loop trufectones to a retHflute 
motion about an axis of rotation 

Key Words- Am lUnlc* cnnuDl, suhiluv, iiotiliniMr miUMtl itivnlituai 

conirol 


Abstncl— In Ihis papir, wc MtfK; in ihi.* a 

longslanding problem conicrning ihc cxisiciut oi .1 srrKH^Ih 
(static or dynamic) stale variable (ccdback lav^ liKalK 
asymploiically stabilizing a rigid spacccrati vsiih iwo coniiols 
about a desired relereme attitude Moilelling 1 spatter.iM 
actuated by three thruster )els. mU' o( wtuch has t.nled this 
well studied system is known to bt liKallv icachable and 
locally asymptoticallv null contudlublt We nhiairi our result 
as a corollary ol a surprising result which asserts, (or a class 
ol rumlmcar systems containing seseial esaincilcs ol micresi 
that such a system is locally :isvnipu>iicall> siahili/ablc 
precisely when it c.m be lineari/ed via siait (eedbatk 
transformations Wc give a further result on the insiabilitv 
(in the sense of I yapunov) ol ngul sp.iccci.ill hu cerlain 
feedback laws, but we are able ti» mnstruct .1 Icedhack law 
locally asymptotically driving the closed Niop liaiccronev it» a 
motion about the third principal axis Ihis law is tlcnvctl 
using general principles comprising a nonlinear rnhariccmrni 
of rixrldiKus design principles 


1 INIROOI CHON 

In nils I’AiMH, wc study the husic problem of 
constructing smooth state variable feedback laws 
achieving certain desired steady-state closed- 
liK)p behaviour for a system, esscnliiilly l.uler’s 
equations for a rigid [khIv, modelling a rigid 
spacecraft actuated by three thruster jets, one of 


* Received 14 October 1^H7, revised 17 April 
received in ftnal form K May IMHV I he original version ol 
Ihis paper was not presented at any If AC meeting Ihis 
paper was recommended for publication in revised form by 
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Kwakernak. 
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Washington University. St Louis. MO U S A 
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which IS in a failure mode This prttblem has 
been cxlensively studied m the literature |m:c 
e g. Aeyeis (I^KS), HttKkcIl (E^H3); Oouch 
(IMK4. Hermes (IWI)) Eot example, it is 

known that, relative lo a fixed desired idcrtncc 
attitude, this system is locally reachable and 
locally asymptotically null controllable. It has 
been a h>ngsianding problem lo rcali/e such 
open loop strategics via (eedback, e g to find a 
smooth (e g ( ‘| stale feedback law Uxally 
asymploiically slabih/ing this system In Seclion 
2 we prove a general stability result valid for u 
class oi nonlinear systems containing severiil 
examples of micresu specifically the rigid 
spacecraft model in question Perhaps surpris¬ 
ingly. a corollary of mir mam result asserts 
that there exists a smooih Icedhack law* l(»cally 
asymptotically siabih/mg such a system if, and 
only if, the syslrni can be Imeari/cd via 
coordinaic changes m the state and input spaces 
and stale feedback iransformations As a further 
corollary, we show (hat there exists no smcMrth 
(static or dynamic) slate feedback law locally 
stabilizing this rigid spacecraft system about a 
nominal reference frame While examples of 
kKally reachable but not static feedback 
stabilizahle sysicms have been recorded earlier 
(Hrocketi (l‘^Hl); Acyels (1^/85); Soniag and 
Sussmann wc stress that this particular 

system is a widely used model for a physical 
system, demonstrating that the nonexistence of a 
sm<K>th closcddoop realization of an opcn-Unip 
amtrol is not just a mathematical anomaly. 

The prfH)f (Section .1) entails on the one hand 
an application of wclEkmiwn linearization 


HI 
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techniques (see e g. Brockelt (1M7H); Jakubzeyk- 
Respundek (I9HB); Sommer (1980); Hunt ei ai 
(1983)1 to this class of systems. We remark that 
for mechanical systems, our proof boils down to 
the existence of an independent control for every 
position variable It is more likely this feature, 
rather than including in the system design 
specihe involutivity considerations, which ac¬ 
counts for the relatively ubiquitous application 
of linearlization techniques, On the other hand, 
the converse of our theorem is proved by 
appealing to Krasnoselski’s Ihcorem which 
computes the degree of a locally asymptotically 
stable vector field. As pointed out by Zabezyk 
(1989), this degree calculation also implies u 
local solvubilitv criterion discovered independ¬ 
ently by f3rockelt (1983) Moreover, from 
Zabc/yk's argument it would appear that the 
nonexistence of smooth stabilizing laws for this 
satellite model also applies to Ijpschiiz con¬ 
tinuous feedback laws. 

In Section 4, we brielly illustrate our general 
methods lor applying center manifold theory to 
stale feedback design, based on a nonlinear 
enhancement of classical root-locus design 
principles. We apply these methods in Section 3 
to derive a state feedback law which (locally) 
asymptotically drives the closed-loop trajectories 
of the satellite to a motion about the third 
principal axis, thereby stabilizing the motion 
about an attractor, which is a circle and not an 
isolated equilibrium. This control scheme raises 
several interesting questions about the steady- 
state limits of such trajectories; e g. does this 
control scheme, or does any continuous feed¬ 
back law, render the satellite dynamics Lyapu¬ 
nov stable^ Lor example, the open-loop 
dynamics are Poisson stable and therefore not 
I.yapunov stable We conclude with a fairly 
general instability result, asserting in particular 
that robustly (Lyapunov) stabilizing feedback 
laws asymptotically inducing a motion about the 
third principal axis do not exist. 


1 ASYMI'lo rK SI AHILI/.AHII I I Y C)t A ( I ASS 
OK NONl INI AH SYSTIrMS 

In this section we shall investigate the local 
asymptotic slabilizabiliiy of control systems 
evolving on having the form 


i, “/i(A I. .V ,),r 1 f V e W. . 1 ,. b, e /?'■ 

(21a) 

A,). (2.1b) 


where in addition we shall assume: 
(HI) The drift vector field 



is C' and has 0 as an equilibrium, i.e. /(()) = 0; 
(H2) ^ 2 ) = d implies a, = 0; and 

(H3) The Jacobian matrix ^f 2 l^x^({^) has 
rank 

Examples of systems (2.1) satisfying (Hl)- 
(H3) abound, since many controlled ‘ second- 
order’' systems take the form (2.1) when 
expressed as a “first-order" system. In particu¬ 
lar, the rigid body model for an n-joint robot 
arm, operating in an environment where 
gravitational forces have been cancelled or are 
negligible (such as outer space or underwater 
applications) and controlled at each joint by an 
applied torque (e g. actuated by a fX' motor) 

M(q)q 4 c/)(/ T, if e R"' (2.2) 

can be expressed in the form (2,1) after a 
smooth, state-dependent change of coordinates 
in input space with stale 

t (2.3) 

Of particular interest in the present paper is 
the rigid body model of a satellite controlled by 
momentum exchange devices, such as momen¬ 
tum wheels or gas jet actuators. On the state 
manifold M - S(}{^) x R\ the evolution of an 
orientation, angular velocity pair {R, to) takes 
the form 


J(j) = S(tij)Jaj 4- V h,u, (2.4a) 

I I 

R = SUo)R (2.4b) 

where J is the inertia matrix and 5 (ok) is the 
matrix representation of the cross-product, 
h—*h X (n ; i.e. 


0 -~u) 

- (1)^ 0 (0| (2.5) 

U)2 0 

Choosing principle axes (i.e. diagonalizing /), 
(2.4)(2.5) can be expressed in local coordinates 
about a reference frame /? = [r,rjr^) using Euler 
angles, g;, 0, representing rotations about the 
r,, n, r, axes, respectively. Explicitly (2.4) lakes 
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ihc form 




a 11^2 CO 



CU: 

=r 

a2(o^^o^ 

+ 2. 

. h,(R' (2,4a) 



^O^COiCOj _ 

1 ! 


<P 


r cos 6 

(1 

sin H 


e 

= 

sin 6 tan 0 1 

cos H tan <p 


.V- 


-sin W sec (p 0 

cos M sec ip 



In particular, (2.4)' has the torni (2 1) with 
n, = n.==3 and satisfies (HI) (H2) and (M3), 
since 

del (0) - I 

3x, 

In general, we shall set 

m' = dim span (/^i, , h „,) 

in (2.1). 

Ihe local control of the saiellilc equations 
(2.4)' is well-known to be relalively straightfor¬ 
ward if m' 3. but the case rri' ~ 2 is tar more 
difficult. While it is known in this case that the 
satellite equations are locally reachable and 
locally null controllable, it has been a longstand 
ing, open problem as to whether (2 4) can be 
ct)ntiolled to 0 using a closed-loop strategy, 
especially using continuously dilfereiuiable state 
feedback. One of the corollaries to our first set 
of theorems is that this widely believed 
conjecture is false. 

Theorem 1. Consider a system (2 1) satisfying 
(H1)-(H3). There is a continuously differ¬ 
entiable feedback law, u,-T,(x). rendering 
the origin locally asymplolically stable it. and 
only if, nT = 

Necessity is a consequence of our next 
theorem which will be demonstrated in 
Section 3. 

Theorem 2. Consider a system (2 1) satisfying 
(H1)-(H2). If there is a continuously 
differentiable static or dynamic stale lecdback 
law rendering the origin locally asymptotically 
stable, then m' - n,. 

Corollary 1. A rigid satellite with (one or) 
two independent actuators cannot be locally 
asymptotically stabilized using continuously 
differentiable sialic or dynamic slate feedback. 

While several examples of UKallv reachable or 
locally asymptotically null controllable systems 


m 

which cannot be siahilized have been known for 
Mime time we stress that this particular sv'stem is 
a widely used miHicI tor a physical system, not a 
mathematical anomaly Concerning the 
sufhcicncy ib** condition w we hrsi 

remark that tor a rigid robtrt arm (2.2|. we have 
m - m ^ n and hnean/aiion. known in this case 
aN iccdback stabili/alion b\ the mcihiHl of 
“computed torquehas fK*cn widely used for 
some time More generally, if m - fi». span 
(kb- trivially invoUitive (where 

g, ~ (/>;, 0^)' ) iiiul bv (H3) we have 

M>-*n (Ki. . U. )(•')) 

- liH" '" I 

In particular, if m' ■ then (2 1) can he 
Imcan/cd using state and input co<ndinatc 
changes and slate feedback, from which 
sufficiency billows \scc eg lakub/evk and 
Respondek (IMK<))|, Therefoic. a nonlinear 
system t2 1) satisfying (HI) (113) can be 
stabilized bv smooth feedback if, and only if, il 
can be linearized Of course, systems (2.1) such 
as (2 2) or (2 4) are nv)i designed so ihal certain 
distributions arc involiitive Rather, they arc 
designcti so that there is an indc|X‘iuleni control 
for Mflually everything in Ihe system which 
moves, l e so lliat ^/i ri, I (m nicehanK at 
systems ot this form, taking position coordinates 
IS outputs this amounts to designing the system 
to be square ' Moreover, the enndilions (HI). 
(H3) and m n, imply the eondilion that about 
ihe equilibrium 0. the linearization of (2 1) is 
eoniiollahle II is for these reasons that 

linearization techniques apply so generally 
within Ihe class of systems (2 1) We summarize 
these results as follows 

The<frcm ^ ( oiisider a system (2 1) satisfying 
(111) (H3) Ihe following are equivalent; 

(1) The system can he Uically asynipUitically 

stabilized by smooth state feedback 

(2) Ihe system can be locally asymptotically 

slabilr/cd by smooth dynamic stale 
feedback 

(3) m' - n, 

(4) Ihe system can be Imeari/ed by smtHith 

caKirdmalc changes and smooth Iccdback 

(!S) The linearization (i c the first variation) 
about 0 IS controllable 

3'hus, a rigid satellite can l>e liKally asymploti- 
cally stabilized afHiul a nominal reference 
atiiiudc when we retain full control; i.c, when 
m’ “ 3 Nonetheless, some stabilization results in 
the case m' - 2 were obtained by several authors 
for certain subsets of the controlled rigid liody 
equations (2Aa)'-(2.4b)' for example, Brock- 
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cH (1983), Aeyels (1985). Crouch and Irving 
(1983) and Byrnes and Isidori (19K8a) derive 
stahifi/ation schemes for the three angular 
momentum equations (sec also Section 5). 
Assuming the two actuators arc aligned along 
the lirst two principal axes, Hermes (1980) 
derived stabilizing laws for the four equations 
involving ru,, nr,, 0, 0 so as to induce a spinning 
motion about the third principal axes (note that, 
if a limiting motion of this type existed, it would 
be periodic with constant velocity) In this paper 
we derive feedback laws such that the closed- 
ItMip trajectories asymptotically approach the set 

A " ((m>,, 0, 0, vM : ^ b. 0 ” - fl} 

(although a limiting motion may not necessarily 
exist or he periodic). 

Theorem 4, C (insider a rigid satellite with two 
actuators aligned a king the first two principal 
axes. The feedback control law 

- ri|K’;>iv< W\ - 0 A(K'» “ 

- Wy cos 0 ' w'l sin 0 

Uj “ a . ■ Wj. rj A y 

w’l sin 0 tan 0 h'.> - m , cos 0 tan 0 

~ 2 /f yr A M ' I W; K' ^ A ; W , VC; 

where 


A0 and 

UsiA.iA, H:) - 0 

locally asymptotically stabilizes the rigid satellite 
model about a rcvolutc motion about the third 
principal axis 

FKOOl Ol ntliORI M : 

We shall use Krasnosclski s I hcorem (Kras- 
noselski and Zabreiko, 1984) which gives 
necessary conditions (or the origin to be locally 
asymptotically stable equilibrium lor the auton¬ 
omous differential equation 

t-f(v). f(())-(), VC (3.1) 

Bxpliciily. in order for (3.1) to be locally 
asymptotically stable, it is necessary that, locally, 

deg (-/• ) == I 

where deg denotes the Brouwer degree An 
immediate consequence, noted independently by 
Brocket! (1983), is that the equation 

l|v||«x (3.2) 

must be solvable. In this section, we shall give an 
independent proof of Krnsnoselski's Ilicorcm 
and hence of the solvability of (3.2), but we will 


first use this condition to prove Theorem 2. 

Proof. Let y = j eFor an arbitrary 

but fixed choice of static feedback laws 
» w^(xi, X 2 ) denote by F(x) the 
closed-kH)p drift 




Fi(x I, X2) ^ 


/,(X|, JTjU, + X -* 2 ) 

( v. 1 

f2(Xi.X2) 

Now choose ||yi||«^ and >2-0 and consider 
the solvability of equation (3.2). By (H2), we 
conclude that x, = 0 and therefore that 
/i(x,. X 2 )X] ~ 0. Thus, solvability (3.2) reduces to 
solvability of 

m 

I - I 

which can only occur if m' - n^. In the case of 
dynamic feedback, the prrmf is identical. 

We now turn to a proof of this necessary 
condition for local asymptotic stability. 

Theorem 5. (Krasnosclski). A necessary condi¬ 
tion for (3.1) to be locally asymptotically stable 

dcg(- F)= 1. 

Proof Choose a Lyapunov function L(a) and a 
real number r «^. We remark that w hile it is 
tempting to believe that V *(() is diffeomorphic 
to a sphere, this is equivalent to the Poincare 
conjecture [see Wilson (1967)]. Instead, we use 
another nontrivial assertion about the topology 
of Lyapunov functions; 

Lemma. V ( ) is diffeomorphic to R". In 

particular, M, = V rj is contractible. 

Proof. The open subset K ' {-^,c) is smooth 
manifold with a vector held possessing a globally 
asymptotically stable equilibrium. According to 
Milnor (1%4), 

1/ '(-oc, c)-/?" 

so that V ‘(-x, rj is contractible. 

Returning ot the proof of (3.1). denote by <pr 
the time 7-map induced by F(x). According to 
the Lcfschetz Fixed Point Formula (Griffiths and 
Harris, 1978), since = {()} for f ^ 1, 

!«(» 
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where L(^r) is the oriented intersection number 
of graph( 07 ) with the diagonal of W. x A#.. For 
such fixed points are the equilibria of 
Fix), viz. 0. More explicitly, if F had a simple 
equilibrium, then (see Griffiths and Hams, 1978 ) 

tlcg(-f) = deg„(-f) = ind„(F)= ( 3 ,_t) 

Since degrees and intersection numbers arc 
robust with re.spec 1 to small perturbations, for a 
multiple equilibrium and for T«y, We 
conclude Krasnosciski's Theorem: 

deg(-F) = i.(<p,)= 1 . ( 34 ) 

4 (iEOMFTRIC ( (JNTROt THIOKMU 
STABIUZATION lEC HNIOlirs 

Although the full set of satellite eciuaiions 
with only two controls cannot be asyinptoiically 
stabilized via smooth feedback, one rnav still 
wish to design a control law that siabili/es at 
least a particular subset of them The structure 
of the equations (2.4) is such that the behaviour 
of the state variables u),. (Oi, and (p. (f is not 
directly affected by the value of the third F ulcr 
angle yj (it could indeed In: affected — 
indirectly—throughout a slate feedback control) 

The state variables in question describe the 
motion of the satellite regardless ol a riUation 
around one of the principal axis and one may 
wash to examine whether or not it is possible to 
achieve asymptotic stability of tlie motion at 
least up to a rotation around the axis 

Consider a rigid satellite with twa acluaiors 
aligned along the first two principal axes 
Suppo.se fi 3 = 1 (this assumption will he relaxed 
later). Without loss of generality, we can 
suppose that, after feedback, the equations in 
question assume the form 

tu, = w, 

(0:> — Uj 

dj^=ajjaj> (4 1) 

= cos 4 sin 

(b = sin 0 Ian (poj] <p(Oi, 

The equations (4.1) can no longer be viewed 
as a system of the form (2.1) satisfying 
(H1)-(H3) and they are not feedback lineanz- 
able in a neighbourhood of 0 m order to 

obtain asymptotic stability, we have to use 
different techniques. 

Consider again a nonlinear system having the 
form 

m 

X =f(x) + ^ f.’.(x}i/, xf R”. M, e W (4.2) 

I ^ 1 

and suppose there exist smcKith functions 
y,=h,ix) 1 = 1. 


of rigid spaccct afl 

defined in a neighbiiurhood o( i ^ 0. satisfying 
the assumptions: 

(H4) /i,(0) w 0 for , m and 

(H5) ITie matrix 

A{x ) - )) « )| (4 4) 

, } 

IS nonsingular x ^ 0. 

Because* of (H5), the functions .... 
have linearly independent ditfifemials at x * i) 
and it is fHissible to chcH^se new Uxal ciHYidinates 
for (4.2) in the form 

(’i. . Vi. . v,.) v) 

with ;^(0) 0 for I » I, . , ni 

Rewritten in these ciHudinates, the system 
(4,2) becomes 

i y) 4 g,( 2 . > )u (4 Sa) 

V ^ y) ^ y)n (4 5b) 

with /,((i 0)/;((i 11} - (1 and non- 

singular at all (z, v) near (0. 0) 

Fhc choice of feedback control law ot the 
form 



M ,v)l ■ V y )l 

(4 0) 

changes 

(4.5) into i) system of the form 



i =/)(.’. ,v) -t V )> 

(4 7a) 

where 

V " - V 

(4 7b) 

/,(?. V) 

-/.(r.v) )?,(:, >■))•, '(.',v)l V 

/.(- v)l 

*l(‘. >) 

- ,V). 



It IS apparent from (4 7) that locally around 
4 “ b the set 


/ ~ (x ; ) - 0,1 I. , /n ( 

i.c the set ol points with c<M)idinales (r. 0) is an 
invariant manifold, [lie effect o( the control law 
(4 6) in such as to constrain on / every motion 
of (4.5) starting at a point of / On the 
system evolves as 

z- h(z,i)}. (4 K) 

In other words, (4 8) is a hxal description of the 
behaviour of the control system (4 2) under the 
constraint 

/i,(x) b 

A proper choice of the functions 
/i,(x), . h^(x) can F>c helpful in striving a 

stabilization problem, as explained in the 
following statement 

Theorem 6. Consider a system (4.2) satisfying 
(H4)-(H5) Suppose, in addition, that 
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(H6) 'Fhe amstrained dynamics (4.H) has an 
asymptotically stable equilibrium at z == 0. 

Then, the control law (4.6) locally stabilizes 
(4.5) at (z, V) ~ (0, 0). 

Proof. If the first variation of (4.8) has spectrum 
in the lefThalf complex plane, then the first 
variation of (4,7) being upper block-triangular 
also has its spectrum in the left half plane. If 
(4.H) is locally asympotically stable but is 
critically stable, i.e. has some eigenvalues on the 
imaginary axis, then the constraint set Z contains 
a centre manifold for (4.7) |scc Carr (1981)). If 
Z is a centre manifold, then asymptotic stability 
of (4.7) follows immediately from the centre 
manifold theorem. If Z properly contains a 
centre manifold, then after a local change of 
coordinates, as in Byrnes and Isidori (1988), we 
can separate the stale into two pieces one whose 
linearization is stable and which, when con¬ 
strained to zero, defines the second, invariant, 
piece as a centre manifold. Again, by the centre 
manifold theorem, (4.7) is locally asymptotically 
stable. 

Remark 1. Some early versions of stabilization 
schemes such as (4.6) were studied by Brocken 
(1983) under an additional ‘ finite gain” hypoth¬ 
esis, which was later relaxed by Aeyels (1985) 
using centre manifold methods. Our approach 
u.ses output functions very heavily and in this 
way is inspired by classical frequency domain 
controls and its extensions to nonlinear, high 
gain controls via singular perturbations [see e g. 
Young el al. (1977)) or sliding mode control |e.g. 
Utkin (1974)1 with one important exception 
Namely, for applications such as attitude 
stabilization of rigid spacecraft the motion on the 
sliding hypcrsurface is at best critically stable 
and cannot always be stabilized by high gain. For 
example, consider the system 



In Byrnes and Isidori (1989), it is shown that 
while the analogue of (4.6), viz. 

U - “V ” 2^ 

is locally stabilizing, for every value of k the high 
gain law 

u - - ky 

is destabilizing. In fact, no smooth output 
feedback law is locally stabilizing, for this choice 
of output. In the next section we show how to 
design appropriate outputs for the reduced rigid 
bixly model, analogous to control via “optimar’ 
sensor location. 


5 S I ABtLlZATION OF THE SATELLFTE 
EQUATIONS 

We now return to the problem of stabilizing 
the satellite equations (4.1). The matter is to 
design ‘‘dummy” output functions 

yi = 

y2 = hjliOi, (O 2 , <p. 0) 

in such a way that some of the procedures 
discussed in the previous section will be 
applicable. 

l^t us consider, for a moment, the simpler 
situation in which the last two equations of (4.1) 
arc being neglected. Stabilizing control laws for 
these equations are already known, but we want 
to show how it IS possible to derive them within 
the present approach. 

In order to siilisfy requirements (FI4) and 
(H5), choose 

/7i(n>,, a)., -o)i 

/i2(o>i, (02i “nil ~/2(r^i) 

with/,(())-/i(()) = (). 

The corresponding normal form (4.5) then 
becomes 

>■’1 ■= -• (ft f; + /| y. + /, y, + y, yj) - MI 

a(i>, 

-5/: 

yi - ~ if\fi + ./i y.’ +/?yi + yi ys) - 

~ f\Ji /i y’i i: y'l I'l y’• 

The use of ii feedbuek law of the form (4.6) 
yields a system 

.V’l = -.Vi 

y. = -y.. 

I = /i /: + f\ .V.1 fi y'l + Vi Vj 

whose stability depends entirely on that of 

From this, it is easily seen that the choice 

/,(«>,) = 

solves the problem. Note that the feedback law 
derived using these outputs and the method 
desScribed in Section 4 coincides with the 
stabilizing control law found by Brockett (1983) 
[sec also Aeyels (1985)]. 

The stabilization of the full set of equations 
(4.1) is not terribly more difficult. In order to 
fulfill requirements (F4) and (H5), set: 

/i,(tu,, ^2. -/i(ro3, 0) 

fi2(o)i, (O 2 , ru,. ip, 0) = <p, 0) 

with/,(0, 0.0) =/ 2 ( 0 , 0 . ())=(). 
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Using again a control law of the form (4 6 ). 
we arc led to examine the asymptotic stahihly of 
the following equation; 

= <p. <I>. 6f) 

^ = -cos <P. 0) 4- sin «C 1 >, 

-sin «tani^/,{(,i,. 0 . ^ 

- cos 6 tan d>n> ,. 

(5 1) 

Since the linearization of (5.1) at (» has the 
form (supersenpts denote diflcrcntiation) 

(dcOi) = 0 

((i^) = -/l‘‘'(0) (iw, - /*(()) /;-,()) fyo 

{dd) = “/?’’(()) d(o,- ft{i)) - /IV)) 

we are in the “critical case”, ihe stabihu ot 
which shall be analy/ed via C entre Manifold 
Theory. In order to nimimr/e the dimension of 
the centre manifold, we may wish lo have ihc 
eigenvalues of 

/r(0) nw 

:./?(0) /?(()) 

in the left-half plane. This is accomplished, e g 
by means of the choice 

<p, if) ■=-- (p 4 if,( fU ,) 

/.(w,, (p, (i) - a 4 

We now want to (ind and ^ , that make the 
dynamics (.S J ) locally asymptotically stable at n 
To this end introduce a local change of variables 
and take the right-hand sides of (5 2) as new 
state variables, still denoted by /, and / The 
system (5.1) will thus be rewritten as 

“ /i/: 

/= - /i (7: ' g.) 

-h/i(l - cos (7 “ g.)) 4 g',"/,/: 

7 = “7 - /i (/: “ K ;) I (/", g,) 

- ( 1 >, cos (7 ” ;^ 2 ) (7 gi) ^ 

This system has a local centre manifold 
{f]=Zi{w^), near zero (where 

z,(0) = Z 2 ( 0 ) = 2 ‘r(()) = zr'(n)), which can be 
approximated by the solutions of 

0= “Z, -h 

0 = -zi - wdz, ~ gi) 4 

At this point, one has to make a choice of g,. 
gi such that the solutions z,(n)d. of the 

previous equations render 

(ij^ = zdt^V7^2V^^7 


locaUy asympcottcaily siabk. Selling e g, 

g,, 4 I \. 2 

and taking Taykn scries expansions for : 

Z, ™ f ^,10 1 4 i ® L 2 

one obtains 

~ A:nii 4 (A^ 

Z; - 4 t/t 4 4 

In order lo have liHMl asymptotic slabihly, 
provided (hat 

A, A: ' (» 

It IS sufticieni [o set 

li:) ^ ^7) b 

Thus, a locally asympiotKaliv stabili/ing 
control law lor (4 11 can fx' obtained when 

/i, 4 <p * A 4 .4,rj>4 4 /74fr,) 

( <U; 4 1 / 4 4 (fl'd 

provided that A,,/i,,i 1.2. satisfies the pic 

vious requirements In case Ui /t the same 
arguments show that local asymplolu stabililv is 
achieved primded 

B ) A.{A: 4 /f,))' 0 

u AN INSt Ahli Its Ul SI I I 

( outsider again the model of a rigid satellite 
with just iwo controls and supptise its motiivn has 
been, as m the previous scemm. asymploOcally 
stabili/ed up lo a motion aonind one (»l the 
principle axes I he question that naluially arises 
IS wheiher or nol ihe stale variable y. which 
measures the rotation arouml ihai axis, will 
evenluallv converge toward some finite lirnil as 
j * It the Jacobian (^u/Jii/Jr/| of a 
y^-independcnl control law has rank twi). then 
an argument similar to the one given in Section 5 
shows that the closed looj) system lias ihe 
onc-dimcnsional manifidd 

A {{(rt,. (/>, 0, y>) : fit, - (I, 0 ■ (I “■ (f) (0 I ) 

as Its equilibrium set and ii makes sense to ask 
(IcKally) whether closed loop rrajectories tend, 
m fact, to a point of A. 

More generally, throughout the rest iif this 
strenon we shall assume that all feedback laws 
wc consider satisfy 

(H7) Tile equilibria of (he closed-loop system 
are given by (b I) 

ITic questions we shall study is whether feedback 
laws satisfying (H7) exist which robustly Mabih/c 
the closed lixip system 
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Definition 1. A feedback law <t>, 6, V') 

&ali.sfying (H7) robustly stabilizes (4.1) provided 
for all ( sufficiently small, the feedback law 

u,(o), 4>. 0, yf) + f W, 

renders the dosed lcK>p system (Lyapunov) 
stable. 

In order to analyze this question we first note 
that from the form of the closed-loop equations, 
a robustly stabilizing feedback law must have no 
eigenvalues of the (partial) Jacobian (evaluated 
at 0) 

’3m, 3m I 
30 do 
3m 2 

_ 50 30 

being zero. Henceforth, we may assume that 
(6.2) is nonsingular 

Without loss of generality, consider the 
equilibrium priinl o;, - 0)2 ” tO) ~ 0 ~ r/ = 0 = 0. 
The linearized system around 0 has two 
eigenvalues at the origin and four eigenvalues 
with negative real parts. 

Thus, the syslcm has a two-dimensional centre 
manifold at 0 Set 

z ^ (z,, z», z^, Z4) “ (mi, m2. 0. 0) 

and recall that 

0. 0, (I, 0, 0) = MyJO, 0, 0. 0. 0, 0) = 0 

for all 0 near 0. The (controlled) satellite 
dynamics has the form 

z - Az ^ Ihoy, f /i(z, m,. v^) 

m,-Z|Z2 

0 m, -f z,g,(z,, Z4) -4) 

where A is a matrix with all the eigenvalues in 
the left-half plane, h(z, m^, Vv) is function that 
does not contain linear terms and is such that 

6(0.0. 0) = O 

for all 0 near zero, g,(0, 0) = g,(0. 0) - 0. 

A linear change of variables 

$ - Tz ^ ku}^ 

where T is an invertible matrix, brings (6.3) to 
the form 

A^ ^ m,. Iff) 

dh - + D,m0(r2| T /Xm,) 

0^ m3) 

where /i(0, 0, V') = 0 for all 0 near zero and 
m3) docs not contain linear terms. A centre 
manifold for this system at 0 is the graph of a 


function § = zt{iUy, 0) such that ,;r(0, 0) = 
;r0) = ;r^(0, 0) = 0. Such a function is a 
solution of the partial differential equation 

D,m3)(c2-T + 

4 ^ ^^(m3 + oj^)) = Ajt + m3, 0). 

Since /i(0, 0, 0) = 0 for all 0 near zero, we have 
necessarily for any centre manifold 

.t(0 , 0) = 0 

for all 0, and this is turn implies 

;r(m3. 0)= m3if(m3, 0). 

As a consequence, the stability of the flow on 
the centre manifold near zero is governed by 
equations [see (6.3)] of the form 

V = V) 

(6.4) 

X- y -j- yQ{x, y) 

where ^(0, 0) - 0. 

An appropriate choice of Lyapunov function 
shows that x == y = f) is an unstable equilibrium 
of (6.4). Set 

L(x, y )= xy 

and note that 

L(x. y) -y‘( 1 4 (J(a. v ) 4 a7*(a. y)). 

If r >0 is sufficiently small, on the open disc 
Dr - {(4. y):A'' 4 y‘-‘<: 

we have 

IC>(a, y) 4 y)| < 1 . 

At each point of [), where V(x, y)' 0, we also 
have V(a, y)< 0 and therefore the equilibrium is 
unstable. 

Wc can thus conclude the following. 

Theorem 7 There is no smooth stale feedback 
law, having closed-loop equilibrium (6.1), 
robustly stabilizing a rigid satellite using two 
gas-jet actuators. 

In closing, we note [see e g. Xu (19H6)| that 
the open-loop system (2.4) is actually unstable, 
showing that the instability result. Theorem 7, 
holds in a broader context. It is templing to 
conjecture that no smooth feedback law exists, 
stabilizing (in the sense of Lyapunov) a rigid 
satellite with two controls. 

7 CONCLUSIONS 

Important questions such as controllability, 
reachability and feedback stabilizability for the 
standard rigid body model of a spacecraft 
controlled by three independent pairs of gas-jets 
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can be analyzed elegantly and simply using the 
recent melhtxi of nonlinear feedback Uncarua' 
lion. For the case of a spacecraft with two 
independent controls, modelling for example 
failure of an actuator, local controllability and 
reachability have been known to hold for almost 
all actuator configurations but the question of 
feedback stabilization has heretofore remained a 
heavily researched yet unanswered question 
Using topological melhtxls, ii is shown that such 
systems cannot be stabilized by smixith feed¬ 
back. This is also a special case of a mi>re 
general result asserting that for certain classics of 
systems feedback stabilization can be achieved 
precisely when feedback lincan/ation is possible 
On the other hand, using some general feedback 
design methods which comprise a nonlinear 
enhanccmenl of root-locus techniques, il is 
possible to derive explicit feedback laws 
stabilizing this system about an attractor, 
inducing a closed-loop system with trajectories 
tending to a revolulc motion about a principal 
axis. The general problem of feedback stabi¬ 
lization about attractors appears to be an 
imporlani extension of stabilization about an 
equilibrium, yielding bounded irajeciories when 
siabilization about an equihbnum is not jsosMblc 
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Knowledge engineering is spin tnu^ kn<n% ledge tiupnstfifni ami w siem 
impletnenlufion, and u review prift^tdes examples kinnetedge elaitiitiipn 
and niuehine indtn don in indusinal diP/nntn.s 

kcj \%onl» Knc'wlcvi^H cnjimi kfu^v^ aiquiMtion. knnvi clKtiuiiMO m.Gluiu 

iruluction. f'xjKrJ svMoms vu^ntimsmui .uuI oMi(n»| imhisiii.il coniiol 
tJUallMllVC mOllcUmjJ!. ktlOWiilCfi^'l iU^IUlsMUiH \y^y\\ 


Abftirsrl- Thr mhcrcni liilhcallies uuGlvcd id ihi: puKcss .»| 
kriGwIeilpe Imm ;irt liMiisseil .aui 

uiinhfutl Saeh tlifliculUcs hdvi nsulicii in (eiA 
Nvvicm'^ progicssm^’ hcvrmtt ihi priMoTspin|^' sia^c Iht 
iiJiidKlin^!, icrminolujtv used lo licsciiln ifie whole pnxcss iv 
and, as a rcsiill kin)wled|^c cnjiiiu ctin^' is dt luu-d 
its rhr .ippfopnaic icini lor ihe v^hoU: imihi vs I Ins i> ihi n 
furihrr spin iiiio knowk‘d|L'e iKiiuiMlnni .nul sysiern 
nnpii.'iTienialioii IiDiiIIv. kiiowlcd]i;e .uo| imtiod is iniihcr 
sul diMiUtt into knowledpe clii ilaliorv and in.tehme iiufih (ion 
1 he pariJCuLu prohlerns assmi.iUd wiifi the consirmlion 
ill expert svvtcms in indusinal eonirol a(iplieiiiions iire 
discusse d Such swiirns are i haracterised In ihe naluie o| 
Ihi ir tner populaln jd, the ly[><- <d sniifYort pioMded and 
wihi'it''-r dun ip|x*iale t)n line or nfl hue 1 he inif'on.irui o( 
delinnn. (unction.ilils ami pnaK ai the outset n siresseil Hu 
need lor user models is .dso hi):hli|.'.Mted Ihe n arums 
iioliniques used in knowledge elieitiilion interviews qnes 
lionnaircs. <'hservanons. jirotovol tiialvses leathhiuk 
inters lewinp. walklhroiiji^hs and lorma' teehnu|nes are 
hnetlv reviewed l*he alternative a(iproach usiri^' machine 
imhution leehniques is also divsussetl An examination is 
made ol the coriifH'iin^ iipprti.iehp^s iintdMii(,' holtoin ii|« ami 
lop down techniques I'he henetiis resuhmy horn ihe 
.ippluaiion ol engnitive task analyses rather than leelmolouv 
drivi-n approaches .irc alsi» snesscd t urreni kriowlcvl^'c 
aiquisition tools such as KKiniN KADS, \t fjl ISl 
KF A fS and K()Cir I are reviewed 
I xarnjdes are jiiscn td the use ut time line tevimupiev m 
pmir plant kmiwled^e aiquisiiion, knowleiJf,!e and task 
anaUsev in the construction o( a tiiilure management expert 
system and of the use of induLtivc techniques in j;.is oil 
veparalor design arul siilellile }hiwcr systems umiiol In the 
latter case, the use of quahl.iovc rmuleMiiif; i-* hivhhehlcd 
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The (»ossihliiv of ilomain expttis in mdustnal 
vaiTving oui ilu'ii own knttwUdge eiirif: is iAanuiu d 

I'UI rcjeti.d av iinlikek. unk s% Ist iit r loolv exol f t\i 
poiMsum ol btuiei iiuv|s is ulenithed as om ol the ks v fai uns 
required to simplilv ifie knowtedge enguienmg pns i.-? 

INIROIH t HON 

K\'<>VMltK»l INidMIKJM* IS llu‘ pnU'CSS oj 
building i*x|K‘ri svsiciiis .Sikh sysicms ;irc 
incthunt In liiigc-svdlc soilwku* pHuliuis vkhuh 
dre* ilcsignotl lo solve prtd^lcnis of tlitlcrenl kinds 
using d kruuviedge hitsoil ap)uo;Kh whoic die 
knowledge is repiesenied in an explivil mannei 
I hey have a wide area ol ap|>liealnlil v 
parfuularlv in nuluslna! eoutiol Haves Kolh rf 
ill. lor example have idenlilled HI 

generic ealegories of knowledge engineering 
appheations Ihese are inierpielation, predu 
lion, diagnosis, design, filanning, monitoring 
debugging, repair, msiruehon. aiul eonirol. Sikh 
svslerris normally eonlain iwo main compuneriis 
(Davies, 1 ‘ 4 K 2 ) ihe inlerence meeliamsm (die 
problem solving lomponenl) ami the knowledge 
base (which may acluallv comprise a number rd 
know ledge h;ises) (i e nerails s(>eaking. ex|>e‘rI 
sysiems work besi m narrow application 

domains 

Madm (IdKM) has provided a hieraichiial 
elassifitalion of cx(Kri sysiems from a human 
laelofs pcrspcelive One level of his dassifuahon 
dislmgurshes belween exfxri svslems with 
respect lo dtflereni purposes 

"" pcr(t)rm a (ask; 

- assist in a task, and 
“death a task 

Ihc first calegory deals with auionornous cxfH'rt 
systems such as those found in autonomous 
r()N)ts or automation sysiems The second and 
third ealcgoncs are concerned with expert 
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consultation systems. In addition, systems 
concerned with leaching have more granular 
uncompiled knowledge and access a pedagogical 
knowledge base in addition to domain knowl¬ 
edge bases. In industrial systems, expert systems 
of the firsi category are always embedded within 
the technical system whereas those in the second 
category can be either stand-alone or embedded. 

The poKcss of building an cxfxrrt sysfem 
consists of two main activities which usually 
overlap—acquiring the knowledge and im¬ 
plementing the system. The acquisition activity 
involves the collection of knowledge about facts 
and reasoning strategies from the domain 
experts. Usually, such knowledge is elicited from 
the experts by so-called knowledge engineers, 
using interviewing techniques or observational 
protocols, However, machine iruluclion, which 
automatically generates more elaborate knowl¬ 
edge from an initial set of basic knowledge 
(usually in the form of examples), has also been 
extensively used (Michie and Johnston, In 

the system eonstruclion process, the system 
builders (i.e. knowledge engineers), the domain 
experts and the users work together during all 
stages of the process, which traditionally has 
involved extensive prototyping. 

To automate the problem solving process, the 
relevant task knowledge in ihc domain of 
interest needs to he undeis(t)od in great detail 
but acquiring the knowledge lor expert system 
building is generally regarded as a hartl problem. 
This is not surprising. As Kidd (1^^H7) has 
pointed out, acquiring knowledge from an expert 
entails answering some really lundamenlal 
questions such as 

.-what is ihe relationship between knowledge 

and langiiageV 

—how can we characterise different domains.^ 

—what eonstitutes a theory of problem solving ' 

Clanccy (IMSb) has also pointed out that the 
process of extracting knowledge from an expert 
is not the proce.ss of transferring a mental model 
lying in the brain of an expert into the mind of 
the system builder, but the formalisation of a 
domain for (he first time, and this is inherently a 
difficult process. Ideally, models of conceptual 
structures of problem solving behaviour are 
required as a prerequisite to the knowledge 
transfer process. However, cognitive science 
approaches have not yet yielded sufficient 
information to enable a full understanding of the 
knowledge slnieiurcs and problem solving 
strategies of experts lo Ik applied, ,so that 
current approaches arc incomplete and often 
ad~h(H' Rouse e( aL (1989) view the situation of 
being able to capture human skills and 


knowledge as possibly improving but conclude 
also that there may even be limits to our 
understanding when .searching for models of 
conceptual structures. 

The situation is further complicated by the fact 
that experts often have faulty memories or 
provide inconsistencies. This means that separ¬ 
ate validation of the expertise elicited from 
experts is essential (Chigncll and F^elcrson, 
1988). Furthermore, experts exhibit cognitive 
biases such as overconfidence, simplification, 
and a low preference for the abstract, the 
relative and conflicting evidence. It is therefore 
important to test and validate expert systems 
both by analysing the expertise in the knowledge 
base and by examining failures in actual 
performance. As far as possible, cognitive biases 
should be filtered out during the elicitation 
process 

Much experimental evidence exists about the 
limitations of human decision making and it has 
been suggested that the development of systems 
which mimic human problem solving should be 
approached with some degree of caution 
(folcoit vt uL, 1989). In order lo reduce the 
chances of bias, experts should be made aware 
of commonly found biases in judgement, the 
elicitation proce.ss should include probes to 
foster the consideration of alternatives and when 
experts run through sample problems in the 
elicitation process it should be borne in mind 
that the way in which the problems are 
presented will have an impael as to how far any 
derived rules will exhibit cognitive bias. 

Madni (1988) has taken these important points 
into account in his detailed view' of the whole 
knowledge engineering process appraised from a 
cognitive engineering viewpoint. He has sug¬ 
gested the following six stages which he terms 
mainstream d e v clop me n I: 

1. knowledge elicitation 

2. cognitive bias filtering 

3. knowledge representation and control scheme 

selection 

4. software development and integration 
3. system evaluation and validaium 

6. advanced prototype expert system. 

Stages three and four ideally should only be 
carried out after the elicitation and cognitive bias 
stages have been completed. In reality, this is 
not pi^ssible and our own experience as well as 
that of other researchers suggests that several 
iterations through the hrst five stages are 
required before stage six can be contemplated. 
Madni also proposes two additional paths of 
prototyping activities for demonstration and 
software development purposes which arc to be 



Km>iA lcdge efigincering fof imlusinal expert 


m 


performed in parallel lo Oie f\n\ four ^^lages o! 
ihe mainsircam devclopmeni EvaiuaiK^ns have 
lo he earned out in all stages oi software 
devclopmeni 

!t IS important to realise that e\j>erts change 
their srdulion strategies dependent ujxm the 
boundedness of the problem (Mullin, IMKM) In 
well-btrunded problems an exfXTt's approach 
differs dramatically from that of a novice 
l:x|x*rts' conceptual mcHjels reflect the physical 
prtxesscs that actually ixcur Bv contrast the 
models used h\ nonexperts do not account for all 
the princess parameters driving the problem 
When problems concerning the poHcsscs arc 
jess well undersimxl, ex|H:ii and novice miidcls 
appear superficially t<v he similar, though the 
experts seem lo recognise that the simple motiels 
are not accurate and (hat the use t\l a precise 
model IS not practicable So exfxrls know what 
;he\ do not know and can readiU idennfv 
features of unceriamiv that preclude the use of 
precise solution strategies and in such cii 
cumsiances will adopt simple and somewhat 
inaccurate prexess models Knowledge acipiiso 
tion techniques must he able to co|X‘ with this 
variation in expert strategv 

lew systems have progressed hevoiivi the 
research or prototype phase mairilv because i»l 
the inherent ddticulries in the knowledge 
acqiiisiium process (HTciikcr and Wieiinga. 
ldS7' However, there is strong cvulencc that 
expert systems are now becoming cost efieclive 
A recent issue ol Expert Svsienis Strategies 
(Harmon. idenlilied 3d suecesslul systems 

selected from the contents n( the first 
( onlerence on Innovative Applications ol 
Artifical Intelligence sponsored hv AAAI Ihe 
applications included a Packaging Advisor from 
Du Pont, a lalHu Management Package from 
l ord, a Design Advisor from N( k and a 
|•|an^mg and Scheduling System for the I'S 
Navy (Ommerils on savings tor various systems 
(not necessarily the above) were ‘ savings of over 
Si million ', “a 3fKr saving’ , S2MIK saved 
‘$2 million per year in idrect payback' . 'StPv 
reduction m planning nmc . ‘ a tendold spceil 
up* . reduction m design lime , and tens 

id thousands of dollars saved ’ It appears that a 
more realistic approach to what is possible m 
exfxrt systems technology coupled with better 
development lixils is now beginning to yield the 
long awaited pay back. 

TUI: TTRMINOIXKrY OV KNOWN IK/t 
I NGINl F.RIN(i 

There are a number of terms used to desirilx* 
the expert system building pnxess which are not 
well defined and appear to overlap .Such terms 


include kmiwicdge fhcitalion, knowledge *c- 
quisition. system implemenlution, machine in¬ 
duction and even ihc term knowledge engineer 
ing n^lf Huchanan rr al (WH3) deftnc 
knowledge acquisition as 'the transfer and 
transformation of prohlern-ivotving cx|XTtise 
from some knowledf^e source to a program'' 
This dehmiion cvivcrs the whole pnxess 
including identification of the problem, its 
cvinccpiuahsation, formalisation. impkmtnta- 
lioiK testing and proioiyfx revision Diedrnch 
and Linstcr (I^K^) siiUhvidc knowledge aci|Uist- 
lion into knowledge elicitation and an openo 
luxial phase Mvdla ef al (lugM) leiin the whole 
prtKcss knowledge engineering hut sulxiivide it 
mti^ knowledge acquisition, knowledge repte- 
seniaiion and impitmentation rhev further 
break down knowledge acquisition inui know*!' 
edge elicitation and data interprctalion As 
Motia rr ul siaie. “ Hu* separation of acquisition 
from implcmentaiion Iciuls to a view ol 
km»wledgc acquisition as the production of an 
abstract arcbiieciure distinci Irom the im 
plementaiion ot Ihe svsicin” However, they 
accept that such a characiensatiou is iils<» 
problematic since the only way of testing the 
knowledge is to run it so that the boundaries 
between acquisUK>n and implementation can be 
very fu//y 

f )ur view IS that Ihe process of building 
knowledge basi'd systems is essentially one i>l 
knowledge engineering and we regard the 
different terms as filling together us m l ig 1 

Most authors agree over the general term 
knowledge engineering We have, lumcvcr, 
distinguished the knowledge acquisition prixess 
from the system implementation process |likc 
Motia rf ill (ldHq)| Although it is true that Ihe 
two mleriwiru: during prototyping, there are 
good rcaMHis (or separating them out, at least 
eonceptually. as will become clear later on Wc 
have alsti separated oui chcilation (cither 
manual or auiomatie) from machine induction 
since these acquisition techniques are quite 
distinel and hase ftillowcd different development 
paths 
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KNOWIJJX/L hNXiINf f-RJNCi IN INDUSTRIAL 
SYSITMS 

Expert systems can t>e introduced into 
industrial systems to provide sappK>rl for 
different classes of people such as designers, 
ofKTutors and maintenance t^>ersonneL In general 
such systems will be off-line (lor designers and 
maintenance personnel) and on-line (for o[>cra- 
lors). The knowledge engineering task will be 
different for each of these applications since the 
tasks involved will comprise different knowledge 
sources and structures. One difference is that 
between icchnological/scicnlific knowledge and 
experimental knowledge. Ihis difference was 
de.scribed as a "knowledge of functioning” 
versus a “knowledge of utilisation" by 
DeMontmollin and DeKeyscr (19H()) The 
former knowledge is used by designers and 
maintenance personnel whereas the latter 
characterises that used by opicrators. The 
adoption of a truly human-centrcd design 
approach (Alty anti Johannsen, Johann- 

sen, 1990) requires designers to consider both. 
Ihis means that user models arc expected to be 
part of future knowledge-based support func¬ 
tions for designers (Sundslrom, I9KK; Sundstrom 
and Johannsen, 1989). 

Generally, designer activity in industrial 
systems ranges from the computer-aided design 
of subsystems and components to picture design 
for visual display units in control rooms (Rouse 
1986; El/er and Johannsen, 1988). I'hus for 
designer support, knowledge about the applica¬ 
tion domain in addition to that concerned with 
design procedures is needed for all these tasks 
(Boiys, 1988). f urther, ergonomic knowledge 
and knowledge about user behaviour is required 
in picture design licnee, design activity should 
be supported with a set of different knowledge 
bases (and perhaps a user model). 

Off-line knowledge-based systems are not time 
critical Ihcy may utilise several knowledge 
sources including technical documents, reference 
literature, handbtniks, ergonomic knowledge, 
and knowledge about ojXTalor personnel (for 
use in user modelling). Whilst their operation is 
not lime critical they may still have to take into 
account operator lime constraints. 

The most critical and challenging industrial 
expert systems are those developed for system 
operation. They may encompass support for the 
automatic system as well as support for the 
operators and may provide heuristic control, 
fault diagnosis, consequence prediction, and 
prcKedural support (Johannsen, 1990). The 
latter is particularly suitable for consistency 
checking of inpul sequences or for operator 
intent recognition (Hollnagel, 1987, Shalin ft aL, 


1988). All these support expert systems work 
under time constraints because they are running 
in parallel with the dynamic industrial prtKcss. 
Like off-line systems, these expert systems will 
depend upon a number of knowledge sources 
related to knowledge of functioning and 
knowledge of utilisation. Additional knowledge 
such as that of senior engineers will be required. 

Whilst a supprjrt expert system for predicting 
the consequences of some technical failure will 
normally need only engineering knowledge, 
procedural support, diagnosis and heuristic 
control modules will need operational knowl¬ 
edge as well. Since they will also have to be 
integrated with the supervision and control 
system they will need to suppi^rt numerical as 
well as symbolic knowledge. 

I’he importance of signal processing as well as 
symbol processing has been emphasised by 
Rouse ft al. (1989). They point out that models 
of symbol processing are much harder to be 
identifiable than those of signal processing 
because semantics and pragmatics play a large 
role in symbol processing systems fhe need for 
symbolic representations is particularly under¬ 
lined for industrial process control applications. 

In all cases of knowledge-based sysiems 
developments, it will be necessary lo define 
carefully the goals and functionalities of the 
various sysiems and their interdependencies at 
an early stage. It is also imporlani to realise that 
in the industrial environment not all applications 
are suitable for the application of knowledge- 
based techniques. For example, existing numen 
eal supervision and control systems are based 
upon thorough engineering methodologies and 
replacement by knowledge-based techniques 
would in most cases lead lo performance 
degradation. 

Finally, it must be realised that most industrial 
applications are very complex and this makes the 
problems of acquiring and assembling the 
knowledge in the industrial environment much 
more severe than m traditional computing 
domains. The elicitation and conceptualisation 
processes are liable to be far more complex and 
attempts to prove the consistency of the 
knowledge will be very time-consuming (Shirley, 
1987; Johannsen, 1989), The full process is likely 
lo lake years rather than months. In the absence 
of a powerful methodology, wc will have to work 
with inadequate tools for some time to come. 

TECHNIOUFS FOR KNOWLEIX.F ACOUISMION 

The techniques used in knowledge acquisition 
can be broadly divided into two categories— 
elicitation and machine induction. Strictly 
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vjieiikmg. there is a wntinuum between human- 
human elicitation and auiomaiic induction. 
Tbree general principles have been prop^vsed lor 
iht act^uisiium poxess by Gruber and t'ohen 
fius7j rhey arc concerned wnh primitives and 
generalisations 

Ihe hrst prinnpfe prcstribes that task-level 
primitives should }yc designed m order to capture 
inifvortant domain concepts defined hy the 
expert The knowledge engineer musi use a 
language ol task-level terms raihct than 
imposing irnplcmentaiion level primiiives This 
principle stresses the inifvoriance of separating 
lUJi acquisition from implemenlaiion and will Ix' 
rclcrrtd tt» again later in the pa|H*f I hese 
task level pnmilivcs must he natural Ci>iistructv 
tor Jesenhing information. Inpotheses. rda 
lions, and actions, in ihe domain cxfxrTs 
l.ingingc This wtiuld suggest that task anaivses 
should be combined vvilh knowledge anaivses 
(Borvs vf ul . l^K7; Jt^hannsen. B^K^) 

[he seciUid principle suggests that explicit 
declarative repieseniatmnal pnniitivcs are pre- 
ten able to procedural descriptions Idiis prin 
Lipie IS based upon the observation that m(»sl 
expel Is more e;isil\ understand tieclaraiive 
representations, l ormulalme pn»cedural aspects 
in ihis wav ' can lacilitalc acquisiiion, explana- 
oon. and mainlenance Gruber and (ohen 
(l^vs7) suggesi that an expert shmiltl be asked 
tor ’he parameters ol a domain that aliesi 
Lonirol decisions, aiul ihcn to iorrmilate control 
knov ledee in terms of these paramelers’ 

Ihe third principle requires represent.ilions at 
(he same level ol gencralisahon as (he expert s 
knciwledge I xperts should noi be lorced to 
ccncralisc except when absolutely necessary and 
(hev shemld not be asked to specitv informaii4>n 
nol available to them. An example of an 
oversimplitied generalisation wauild be the 
rci.|uiremcni to calcgonsc a process variable as 
high, medium or low. when the c.xpcrl needs to 
difltTenliate between mans more steps or even a 
lull range ol numbers 

KrunvU d^c fhcitudon 

A rrjmber of techniques for knowledge 
elicitation are now in use I hev usually involve 
Ihe collection of information from the domain 
cxpert(s) either explicitly or implieilly. Origin- 
ally, reports written by the experts were used 
but this technique is now out ol lavoiir since 
such rc[x>rts tend to have a high degree of bias 
and reflective thought (urrent techniques 
include inlerMcws (Ivoth structured and unstruc¬ 
tured). questionnaires or observational tech¬ 
niques such as proKxr)! analyses and 
walkthroughs 


As pointed out by Forsythe and Huehaniin 
(1WV). knowledge chniiiiion niethtHlologies 
“have more in common with the field-work 
orientation of anthropology and quahlative 
scxiology than with the experimental oncniaiion 
of many m ti.e cognitive sciences' It is 
suggested that kmmlcdge engincci^ also use the 
large amount of 1 Icraiure and cx}X*ttefice as well 
as Ihe much longer liadilion of the MX'ial 
sciena^s m field work, particularly dala-palhering 
mcihiHls such as face to-(ace inieiviewing Some 
pitfalls of knowledge elicitalnm arc dcsi‘nfx‘d on 
the basis of this ex|X'ncrue m the sixial sciences 
In particular, some inierviewing problems such 
as obtaining data versus rclaimg to the cxpcMi as 
a fxuson, fear o\ silence and failing lo listen, 
difliculty in asking questions, and interviewing 
wivhoul a record as well as coiucplual problems 
such as irciiimg interview melhcHlology as 
unproblematic 4>i blaming the ex|X‘rt arc 
explained 

Iftfervit'Hs In a siruclured interview^ ilic 
knowledge engineer is m coniioT Such inici 
views arc useful tor ohiaming an ovctall sense o( 
the domain In an unsiiucturcd inc-rview', the 
domain ex|K*(i is usuallv m conirol; howevei, 
such interviews can. as the name implies, yield a 
somewhat incoheieni ci*lleciion ot domain 
knowledge Ihe result can be a veiv unsiruc 
lured set ol raw data tliai needs to be analysed 
and Ciinceplualised It is olnuuislv imporlani tor 
the knowledge engineer lo have some knowledge 
ol the domain before wasimg the valuable lime 
of the experi This rnigfn be obiamed through 
lexlhiMiks, manuals and other well-documented 
siHirces i iroup infer views can he useful 
piirlicularly in the phase of cognitive bias 
filtering 

ynrvno/mmrrs anil rating Males (Jueslion- 
naires van be used instead or m addition wiih 
mlcrvicws The interviews can be standardised m 
question answer caiegories or queshonnancs can 
be applied in a more trirmal way However, the 
latter should be handled in most cases m a 
relaxed manner for reavins ol huildirig up an 
atmosphere of ctinfidenee and no! disturbing the 
ex|xrt loo much when applied in aelual work 
siluations (Borys ei ul , 19K7), 

Rating scales are formal techniques lor 
evalualmg single items of interest by asking the 
expert lo cross-mark a scale Verbal descriptions 
along the scale such as from 'very low“ to “very 
high ' or from “very simple ' lo “very difficulT’ 
arc used as a reference for the experl, The 
consirutlion. use and evaluation of rating scales 
IS described very well in the psychological and 
scKial science literature Rating scales can also 
be combined with interviews or questionnaires. 



102 


G JoHANNSFN and J. L. Alty 


Ohservatioru. Obscrvarions are another tech' 
nique for knowledge elicitation. They require 
little or no active participation of the expert. All 
actions and activitie.s of the expert are observed 
as accurately as possible by the knowledge 
engineer who makes recordings of all the 
observed information. A special mixture of 
interview and observation techniques are the 
observation interviews (Matcrn, 1984; Johann- 
sen, 1989). Sequences of activities are observed 
and questions about causes, reasons and 
consequences asked by the knowledge engineer 
during these observations The combined tech¬ 
nique is very powerful because the sequence of 
activities is observable whereas decision criteria, 
rules, plans etc. arc elicited in addition through 
what", how- and why-questions. 

Protocol analysis. Protocol analyses are useful 
for obtaining detailed knowledge. It can involve 
verbal protocols in which the expert thinks aloud 
whilst carrying oul the task, or motor protocols 
in which the physical performance of the expert 
is observed and recorded (often on videotape). 
Eye movement analysis is an example of a very 
specialised version of this technique. Motor 
protocols, however, are usually only useful when 
used in conjunction with verbal protocols. 

In a verbal protocol, the expert thinks aloud 
and a time-stamped recording is made of his 
utterances (Ericsson and Simon, 1984). In such 
protocols, the expert should not be allowed to 
include retrospective utterances. He or she 
should avoid theorising their behaviour and 
should “only report information and intentions 
within the current sphere of conscious aware¬ 
ness” (Newell and Simon. 1972). As a verbal 
protocol is transcribed, it is broken down into 
short lines corresponding roughly to meaningful 
phrases |see Kuipers and Kassirer (1987) for 
examples of the technique). The technique can 
collect the basic objects and relations in the 
domain and establish causal relationships. From 
these a domain model can be built. The 
experience with the use of verbal protocols from 
the analysis of trouble-shooting in maintenance 
work of technicians is described by Rasmussen 
(1984). 

It is important when using the transcription 
method not to allow any proposed expert 
systems technology (i.c. rule-based approach) to 
influence the selection of items. Fox, when 
examining failures in the performance of an 
expert system designed to diagnose leukemia, 
noted that the cx|>ert systems technology used 
(in this case EMYCIN) strongly influenced the 
method used to “identify" useful information in 
the verbal protocols (Fox et a/., 1987), Fie also 
comments “We are even less confident about 


knowledge that may be implicit or distributed in 
the structure of the protocols rather than 
concentrated in identifiable fragments". 

The critical decision method (CDM) as 
described by Klein et al. (1989) is a special 
protcKol analysis which elicits knowledge from 
experts and novices in a retro.spective way. 
Nonroutine cases such as critical incidents are 
selected in order to discriminate the true expert’s 
knowledge. Sources of bias are minimised by 
a.sking for uninterrupted incident descriptions. 
Then the history of the incident is reconstructed 
by means of time lines and decision points are 
identified and probed. It is stated that 
knowledge can be elicited with relatively little 
effort by using the critical decision method. 

Teachback interviewinfi. In this technique, the 
expert first describes a procedure to the 
knowledge engineer, who then teaches it back to 
the expert in the expert’s terms until the experl 
is completely satisfied with the explanation. 
Johnson and Johnson (1987) describe this 
technique and illustrate its u.se in two case 
studies. Their approach is guided by Conversa¬ 
tion Theory (Pask, 1974), in which interaction 
takes place at two levels—specific and general, 
rhe paper gives a useful set of guidelines on the 
strengths and weaknesses of the technique. 

Walkthroughs. More detailed than protocol 
analysis, and often belter because they can be 
done in the actual environment which gives 
better memory cues. I'hey need not, however, 
be carried out in real time Indeed, such 
techniques are useful in a simulated environment 
where states of the system can be frozen and 
additional questions pursued. 

Time lines. Fables in which several items of 
knowledge are contained in columns. Ihe left 
column has to be filled with the time of 
(Kcurrence of particularly interesting events such 
as failures or operator actions. Related informa¬ 
tion about the behaviour of the technical 
priKcss, the automatic system and the human 
operators, at these limes is recorded in separate 
columns with as much detail as is felt 
appropriate (Johannsen, 1989). 

Formal techniques. These include multidimen¬ 
sional scaling. Repertory Grids and hierarchial 
clustering. Such techniques tend to elicit 
declarative knowledge. The most commonly 
used is the Repertory Grid lechnique (Kelly, 
195.S) based on personal construct theory. It is 
used in ETS (Boose, 1986) which assists in the 
elicitation of knowledge for classification type 
problems, and PLANET (Shaw and Gaines, 
1986). In ETS, the expert is interviewed to 
obtain elements of the domain. Relationships 
are then established by presenting triads of 



Knowledge engineenng for mdustrijil cxperi «y$itenxji 


KB 


ckments and asking the expert to identify two 
trails which distinguish the clcjnents I'hcite are 
called a>niaructs. ITiey are then classitied into 
larger groups called consiellalions Various 
techniques such as statistical, clustering and 
mulndimcnsional scaling are then used to 
establish classihcation rules which generaic 
conclusion rules and intermediate rules together 
with c-ertainty factors Ihe experts arc inter* 
viewed again to rehne the knowledge t lS rs 
siiid to save 2-S months ovet convctitional 
interviewing techniques The svstem has bc‘en 
modihed and improved and is now called 
AQUINAS (Bexise and Bradshaw. lo 

obtain procedural knowledge, techniques such as 
verbal protwols should be used. 

Machine induction 

Machine induction is a spc^cial case of machine 
learning which encompasses heuristus lor 
generalising data types, candidate elnninaiion 
algorithms, methods lor gencralmg decision 
trees and rule sets, lunction indiKiion and 
prmedure synthesis A frame work has been 
developed for descnhmg such techniques that 
allows an evaluation of the usekilness o( any 
technique to particular knowledge engineering 
problems (MacDonald and Wnieii. Wc 

have concentrated U[x>n decision tree and rule 
set generation approaches lK‘causc these lech* 
tuques have been sucecsstully used in a number 
of knowledge acquisition siluations 

It i:. a common observation (hat exfUTts have 
great difticulty in explaining ihc procedures 
which they use to arrive al decisions Indeed, 
experts often make use of assumptions and 
Ixdiefs which ihev do nol explicitly slate, and are 
surprised when the consequences of these hidden 
assumptions are pointed out (Jackson. IMHS) 
The inductive approach relies on the lad that 
experts can usually supply examples of dicir 
expertise even if they do nol understand tneir 
own reasoning mechanisms This is because 
creating an example set docs not require any 
understanding of how different evidence is 
assessed or what conflicts were resolved lo reach 
a decision. Sets of such examples are then 
analysed by an induclivc algorithm [one of the 
most popular being Ihe ID3 algorithm of 
Quinlan (1979)) and rules are generated 
automatically from these examples 

The problem w'ilh inductive techniques js that 
the rules induced depend btilh upon the example 
set chosen and the inductive algorithm used. 
Tlierc is no guarantee that the rules induced will 
be valid knowledge. Ihc approach iherctorc 
normally involves a checking with the expert to 
see if the induced rules are reasonable. It is not 


utiOLiitinum to cyde a numfscr of limes thiough 
the iiiduciion prixeiis refining the knowicidigc 
base with the domain cxjxii Braiko (1*989) 
gives a useful arnmnl of ihe techniques and the 
appUcaium *>f the ID3 algorithm llaii (19H7) 
has given guideluies on the Mppropriaie use of 
inductive leehrtiqucs 

.The technique is uvcTuI if ihcit ate diHu» 

men led examples oi if they can I>e oblatncd 
easily It is not suitable where an unpiedic 
tabic sequeiur of observations drives the 
system (c g as in some real time situations) 

Vhe technique is consistent and unbiased and 
IS \t*r\ suitable for domains where rules form ii 
major pan of the kni>wledge repif'seritation 
ImiiKtion pnnules ifie knowledge engineer 
wiih quesimns. results and hv|>i>lheses which 
form a basis (or nmsiihalum with Ihe ex|Kit 
Ihere is no explanation foi ihe lulcs 

pioduced All out|Hii must t>e exanuned 

CM he 4l 11’, 

The process assumes that the example set is 
\.ompleie and eunenl 

Results should nol be seiisihve to small 
chiingcs in the training sei 

Ihe mduclive lechmquc has been used tor 
weather prediction, prcclichng the bchavioui ol a 
new chemical comjHiund, diagnosing plant 
disease, svmbolu ini eg ration, improved debt 
colIcciKm, ami designing gas oil sepaialors See 
Bratko and Kononenko tlOH?). Michalski and 
( hilauskv (19S()), and Mitchell rt al . (1981) (or 
examples 

The technique is parhcularlv useful when a 
gieai lHid> ol data exists alnmi a process but Ihe 
undcriving rules are not known Induehon has 
Ix'cn useti theieforc on large eolleciions ol 
histoiical process data about induslnal plants m 
order lo mducc Ihe rules o( its openilion Once 
the rules aie known the iirocess can often be 
opiimiscd A well known example of ihc use of 
this technique was at the Wcstingluujse ( or* 
fKiralion where over SlU.tMUl.BBt) was saved 
(Weslinghouse, 19K4) 

Another iniereshng use ol inductive tech¬ 
niques which will have a wide application in 
mduslnal control is its use m conjunction with a 
qualitative model of Ihe pORCss This was first 
earned out in the analvsis of electro cardiograms 
(l^vrac et al., 19H5>) A qualitative model of the 
domain is built Ihen. cornfMinenis are failed 
and the consequences on measurable param¬ 
eters determined for this failure. Ihc process is 
repealed for each component and this builds up 
a complete set ol examples of failure. The 
examples arc then used as input to the ID3 
algorithm and the rules governing the failure arc 
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induced. Ihese form ihc basis for a diagnostic 
expert system The technique will be discu.ssed in 
more detail when we examine the application of 
inductive techniques to satellite power system 
diagnosis 

HOrtrjM DP OR I OP DOWN ' 
fhere are two competing views about the 
knowledge acquisition task which might be 
described as bottom-up and top-down. The 
bottom up proponents aim to prise data and 
concepts r)ul of the expert and then iteratively 
refine it. l eigenbaum, for example has described 
knowledge acquisition as ‘mining those jewels of 
knowledge out of their (the experts) minds one 
by one" (Feigenbaum and McC orduck, 1^83). 
The implication is that deeper mining will reveal 
more relevant knowledge, but this assumes that 
there is a simple relationship between what is 
verbalised by experts and what is actually going 
on in their minds. Hayes~Roth e/ al. ( 1983) claim 
that the building of expert systems '‘is inherently 
experirnenlar’ and is therefore characterised by 
rapid prototyping which is essentially a bottom 
up process The basic assumption underlying this 
bottom up approach is that an expert system is 
based upon a large body of domain specific 
knowledge and that there are lew general 
principles underlying the organisation of the 
domain knowledge in an expert's mind. How¬ 
ever. the existence of underlying principles and 
causal relationships (Davies, 1983) may be an 
indication that expert knowledge is more domain 
independent than was assumed by I eigenbaurn 
(1979). fkeiiker and W'ielinga (1987), for 
example state that ‘In our experience over the 
past three years in analysing eight widely 
different domains a number of concepts have 
invariably recurred, such as procedure’, proc 
ess’, quantification object' . and identification 
object’ ... Such concepts are abstractions of 
real world knowledge’. So ‘expert behaviour 
that is seemingly domain specific may originate 
from higher level pniblem solving methods 
which are well-structured and have some degree 
of domain independence Oomain-mdependent 
aspects to the problem solving process have been 
observed by I\iple (1982) in medical diagnosis 
tasks. 

Breukcr and Wielmga (1987) strongly support 
the top-down alternative and claim that there is 
a crucial siep missing in the prototyping 
approach between the identification of the 
relevant characteristics of the domain and 
selection of solution methods, that of “the 
interpretation of the data into some coherent 
framework, a model, schema or canonical 
form". I hcy equate it to the knowledge level of 


Newell (1980) or the “missing level" of 
Brachman (1979) in semantic network analysis. 
They propose hve levels of knowledge analysis— 
identification, conceptualisation, epistemologi¬ 
cal, logical and implcmentational, and have 
developed these ideas into a knowledge acquisi¬ 
tion methodology called KADS (Knowledge 
Acquisition and D(K'umcnlation Structuring; 
Breuker and Wielmga (19H5)|. An example of 
the application of the technique to insurance 
underwriting is given in Hayward et al. (1988). 

A CCKiNinVI lASK ANALYSIS APPROACH 

Roth and Woods (1989) identify “failing to 
appreciate the demands of the task" as a major 
reason for the failure in current expert systems 
developments They identify the iterative 
rctinemeni approach (Hayes-Roth et al., 1983) 
used almost universally during ihe knowledge 
acquisition phase as the main cause From a 
small prototype, the full system is developed 
through iterative rehncrnenls until the final 
delivery system is produced They claim that 
“the amount of time and resources typically 
available for systems development in industry 
does not allow' for the long term evolution of 
systems entailed in the iterative refinement 
approach" and point out that “architectures 
which are built based on consideration of a core 
set of examples will often not have the necessary 
structural hooks and processing mechanisms to 
deal with new cases that have complex aspects 
that had not been represented in the original 
set" (Bachant and McDermott, 1984). llic 
correct handling of new cases then requires 
major restructuring of the knowledge rather than 
fine tuning, l^xperts often state rules to which 
there are exceptions, not usually revealed until 
much later. 

They further point out that systems designed 
from a core set of examples often result in 
oversimplihed representation of goals and 
constraints and this leads to optimisation of one 
dimension of the user's problem at the expense 
of ignoring other goals. One example from process 
control, given in Roth and Woods (1989) 
concerned the design of an AI system to support 
operators in the start-up procedure for a boiler. 
The Al developers had originally concentrated 
upon a single goal—that of preventing shut¬ 
down. However the operators, in reality, had 
other goals to meet as well (shut-down could be 
caused by other sources). Thus, there were 
circumstances where sub-optimal performance 
on the boiler level goal was appropriate. They 
claim that their up-front analysis of the demands 
of the complete task enabled a much more 
realistic system to be built (Woods and Roth, 
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IU8K) Il'ey suggest a multi-phase progression 
ffOiTi inilliil informal initTvic>^ technicjucs (lo 
denvT a preliminarv mappmp ol the scma^!lt^ of 
the ik^mam), lo more Mructured knowledge 
clii lalion lechmques (lo refine the initial 
stmanrk slniciurc), to controlled exixrimcm^ 
designed li> reveal the knowledge and proievving 
Strategics utilised bv domain practitioners 

I he hrsl phase gives preliminary cognitive 
description of task to guide tunher analvsis it ts 
irnf>^»rtanl here not lo home in on sfKCitK rules 
One [sossibiiity is ui gel the ex(X-nN to provide an 
overview presentation ( (lammaek and \ oung, 
IMKS) Only when an overview of the sernanlies 
ol the application has been develojKHi can more 
siruciuted lechniques lx‘ used. 

The second phase conccnlraics on how 
praclilioncrs perform rheir tasks, thus, there is 
emphasis on observalion and analysis ol actual 
task performance It will involve techniques such 
as critical incident review, discussion ol pasi 
challenges, or the consiruction of test cases on 
which to observe the experts ai work During 
this phase. Roth and Woods (Mso 
recommended the use of expert panels ‘ to 
(‘hlam a corpus ol challenging cases to ivicntifv 
critical elements and strategics tor handling 
[hem 

1 he third phase uses ohservaiiona) Icchnujucs 
under controlled condifiims to observe e\[X’rl 
l>ri>blcia solving strategies I he pravlilioner is 
observed and asked to [xovide a verbal 
commentarv Ihe task can he deliberalels 
m.inipuiaied. lor example. h\ loicing the expert 
lo go hevond reasonablv rouiine procedures In 
some eases, the expert himself controls the 
inlormalion gaihenng Alternativelv. it is con 
trolled l)v the observer, 1 aeh approach provides 
useful inlormation, the former provides data on 
(he diagnosiie search process aiul the larte: on 
the effect (or bias; of particular tvpes of 
information on expert interpret.Hums Arunher 
useful technique is ti^ compare the performance 
ol experts with different iivels of expertise, so as 
lo isolate what factors rt .ilv accamril for superior 
perbumance 

Rolh and Woods (IW^I make a strong ease 
for cognitive task analysis ap[)roaeh as compared 
with a technology-driven approach where 
knowledge acquisition coneenliates ufion A! 
representation mechanisms (eg rules and 
frames) 

KSDWt lDCd ACUl fSniDN KKM S 

A large number of itMils tor supporting the 
knowledge acquisition process have lx‘en de¬ 
veloped m the academic environment and some 


UI5 

of ihcu' have been menuoned iilteitdy Hic 
gencfiil aim of all these fmiK is to minimix^e the 
number of iteraiions needed fi»r the whole 
krumlcdge cnguiecnng prvKTss by btulging the 
gap between (he problem domain and the 
implcmenlafion hiwise and (lames give a 

brief summary of the mam tools under 
devclopnicni and piiivide a suiinniiry Stvmc 
iixds endeavour make the prexess fully 
automatic KRMON (Dicdcrieh cr a/ , fi^r 

example, has a set of piixeduics pic stored 
interviews, meremenial text analysis, and priUo- 
col anal VMS KeixTtorv (inds air used to pull 
ou\ dcelarative knowledge An mtertncdiair 
km>wledge rcprcseniiition system is suggested 
(oi Mjpfxuting the knowledge elieitaiton iceh- 
niqucs Ihe knowledge representation scheme 
involves a propositional euleulus lor representing 
transformations during the problem st>lvmg 
prixess and i desiripiive language for functional 
and physical obfcets 1 his is then translated 
semi auloinalieallv into the ruiMime system but 
this commits the knowledge engineer to a 
particular representation Other tools (loi 
example KADS and A( Ul lS l ) nu rtfv provide 
a set of tools lo aid a more methodological 
approach. I hus, KADS aims only to produce a 
document describing the stnietuie of the 
problem in the form ol a doeumentation 
handbook 

KRirON supports only bottom up knowl¬ 
edge aequiMlion but KADS supi'^nts l>oth 
lop down and bottom up approaches KADS 
supixirts boiiorn up through a hypertext proto 
Ciil editor (ri.D) and hieiaiehies .ire developed 
and manipulated bv a context editor (( 1 | 
lop down IS sup(>orled bv a set ol interpretation 
models each describing the meta-level structure 
of a generic bisk 

Ihe KADS nietfxMlology is based upon the 
following ininciples 

knowledge and exi>ciiise should be analysed 
before the design and implemeniation starts, 
i c beloie an irnplcinenlalion formalism is 
eh«>sen 

the analysis should be nuKlel driven as early as 
[lossif'lc (see also Su. I^HK) 
e^xpcri problem solving should be expressed as 
epislemob>gleaI k now Iedge 

- tfie analysis should include the functionality of 
the prospective system 

- the analysis should Ix' breadlh-hrst allowing 
incremental refinement 

—new data should only Hi elicited when 
previous data has been analysed 

..all collected data and interpretalions should lx* 

drx'umenied 
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Tlie approach produces a four layer model of 
expertise (Hayward et a/., 198K): 

-<lcfinition of the domain concepts and their 
static relationships 

- definition of relations arising in a task context 
which are concerned with dynamics and are 
expressed in the inference structure 

- -specification of how the available inferences 

can be used to undertake a particular task 
—definition of how the task level may be 
controlled, 'fhis is the least developed part of 
the model 

KKATvS-l (Motta et al., 19KH) provided a 
Cross Reference hditing Facility (C REF) and a 
Graphical Interface System (GIS), to support 
data analysis and domain conceptualisation. 
CRF’F orjuaniscs the verbal transcript text into 
segments and collections and CjIS allows the 
knowledge engineer to draw and manipulate 
domain representations on a sketch pad. In 
KIiA1S-2, these have been replaced by 
ACOlJIS r, a hypertext application for structur¬ 
ing the knowledge from the raw text data. 
Fragments from the data are collected around 
concepts, concepts are factored into groups, and 
groups into meta-groups. Links can then be 
defined between any of these entities. The 
emerging structure is displayed graphically, 
ACOUIS r provides support for both bottom- up 
approaches (fragments to concepts to groups to 
meta-groups) and top-down approaches (using 
what are called coding sheets on which a 
‘caricature of the observed behaviour of the 
domain expert” is captured). In this approach, 
the knowledge engineer uses a predefined 
abstract model to guide the knowledge acquisi¬ 
tion process. Use of such models (even if 
incomplete or inadequate) can dramatically 
improve the knowledge acquisition process. The 
coding sheet is a set of hypertext cards. 

The knowledge acquistion tool by Strothotte 
and Sack (19KH) is based on the assumption that 
it is often quite natural for domain experts to 
express themselves through diagrams. These 
diagrams and the related dialogue allow the 
expert to transfer the knowledge in a way often 
used among humans. The diagrams arc drawn 
with lines by using a simple graphical editor. All 
details which arc important for describing certain 
objects have to be included. Then, the tool 
extracts features from the diagram by applying 
computational geometry and image processing 
algorithms Clarifying questions are then asked 
by the computer to the cxjiert about features 
which have to be further specified. Knowledge 
about the objects and their relationships are 
derived and stored in the final knowledge base 


together with the diagram itself. Ilius, informa¬ 
tion content of diagrams can be entered 
semi-automatically into the knowledge base. 
Diagrams can be rc-used if necessary. Strothotte 
and Sack stated that their knowledge acquisition 
tool needs to be combined with a ttH>l for textual 
knowledge in all those domains which allow to 
de.scribe only some types of knowledge in a 
diagrammatic way. A further limitation may be 
that the expert will be forced to overspecify 
irrelevant details. 

A further knowledge acquistion tool is 
ROGET (Bennett, 1985). It conducts a dialogue 
with a domain expert in order to acquire his or 
her conceptual structure. ROGET gives advice 
on the basis of abstract categories and evidence. 
Initial conceptual structures are selected on this 
basis. Only a small set of example systems were 
tested. 

The use of Pathfinder networks for knowledge 
acquisition was proposed by Fisposito and 
Dearholt (1988). It is a tool for the identification 
of conceptual structures with a sophisliealed 
interactive graphics system for network display 
and manipulation. Experts are asked to make 
simple similarity judgements and answer specihe 
questions. This graph-theoretic tool has been 
used in investigations with network models of 
human semantic memory utilising estimates of 
psychological distance. Path Algebra techniques 
(Ally and Richie, 1985) provide a more 
generalised tool for such approaches. 

The systematic acquisilion of knowledge 
about the fault behaviour of a technical system 
was suggested by Narayanan and Viswanadham 
(1987). A procedure involves the development 
of a hierarchical failure model with fault 
propagation digraphs and cause-consequcnce 
knowledge bases for a given system, ll uses the 
so-called augmented fault tree as an intermedi¬ 
ate knowledge representation. Fault propagation 
digraphs describe the hierarchical structure of 
the system with respect to faults in terms of 
propagation. The cause- consequence knowledge 
bases characterise failures of subsystems de¬ 
pendent on basic faults by means of production 
rules. The knowledge acquisition process can be 
reduced to defining parameters required by the 
knowledge representation scheme and trans¬ 
forming human expertise into these parameter 
values. The augmented fault tree is a conceptual 
structure, which describes causal aspects of 
failures as in conventional fault trees but 
additionally also probabilistic, temporal and 
heuristic information. The production rules of 
cause-consequence relations are derived from 
the augmentaled fault tree by decomposing it 
into mini fault trees. The proposed methodology 
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ha^i reached a relatively high level of formal 
descnption. However, it cannot yet deal with 
meiact knowledge hy uiving ^angc^ of param- 
cleri An example of a failure event in a reiicuu 
Mslcm IS given 

El KTT ATION 1WMIM I S 

The application ol the knowledge ciiciUitum 
techniques for mduslrial expert systems will Ix^ 
»vhown with two examples The first is the task 
and knowledge analysis m [vouer plants per- 
tormed with using observation imerviews. 
questionnaires and iirne lines, and the second is 
the knowledge and task analysis performed in 
parallel lo the lonsiruclKui of a lailure 
management expert svsiem fvir space systems 

Knan h^df^e analysis in power plants 

An extensive task and knowledge analvsis has 
ticen pe‘rlormed in coaMired |vower plants and in 
a pK^wci plant school hv ihe hrsi author of this 
paper and his resc’urch group (Horvs ei ul., IVS7. 
Johannsen er ul . U^S7: Johaniisen. IWT 

Sundstrdm, 1he work is part o| the 

I SFKH "(jRADII'N I protect on ( irajihics and 
Knowledge Based Dialogue lor D\namic Svs- 
lems' W'hieh is parlrallv supported hv the 
( ommission of the European ( ^unmunitres and 
IS performed in cooperation hetween Ihe 
research groups of the two auihvirs of ihis pa(>er 
together with two industrial companies Irom 
(iermanv and Denmark and a Belgian 
university 

A thermal power plain consists hasualK <>! a 
water steam cycle involving a boiler, lurinnes, 
condenser and feedwater svsiem. as well as a 
generator. The auttmiaiion system or su|v rvision 
and control of the plant is hierarchic allv 
organised into drive, group and contit»l levels 
When higher levels of the aulomaiion sv>icm 
fail, the shift leader needs U) operate the plant 
with less automation on the lower levels It is 
intended lo support the human tqKrators m 
these situations using l vpen systems Several 
cm)peralive cxfiert systems are devclojx'd wiihin 
the wh )le research consortium, mainly (or 
diagnosis of causes ol lailures. prediction id 
consequences of failures, knowledge based 
alarm handling, procedural support ol oper.ilor 
behaviour and plan recognition vsith operator 
input evaluation Also, a graphical expert system 
will be developed. It will be based on intelligent 
graphical editors which contain knowlcdge bascd 
support functions for graphical picture designers. 

The ’ inowlcdcc analyses were 

performed during a period ol three years in 
several power plants during day and night shifts 
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as well m in a fxiwer plant schi^d Otiiscr>iHii>n 
inierviews. qucsiionmiifcs and tone lines were 
used as chciiioion kxhniquirs During lioci 
stages ol the elicoathoi procTss, the analyses 
were resiocted to failure situations in the 
pre heating syMem The knowledge was cob 
lecied for two rcawns to build a diagnostu 
expert svstem lot supfsorting operators and fo 
construct a user model which will loim part of an 
intelhgcnl graphical cdiioi to support designers 
After using interviews and observations with 
fxrwei plant o|K*nilors and operational en¬ 
gineers, a number of dilferent questionnaires 
were a[>pbed A slalt iHuiUcd qucNtionnane 
with a total number ol 2^^ queslMms Iu'1|xh 1 to 
build frames of knowledge loi eacit subslaie ol 
the plant The qucsitonnaire was structured inl4» 
Ihe live groups of subsiate dcscn|>iion, activities, 
mental models ol the opciaioi. effects ol 
activiiies. and suggestions foi impnacrneni with 
ies|>eci lo the opcraioTs work Anothci 
quesiionnairc was designed \o capture cx|>eil 
strategies and knowledge reptcsintalions avail 
aide lo 0 |xrators m lailurc siiiiahons Ihis 
lailurc-i>iiented questionnaire was 1* sed on a 
general separation ol each lailuie siiu-iiii>n into 
several phases ol laull management such as 
detectmii, diagnosis, localisation, compensation 
and cotrection (Johannsen IdHK) 

lime lines were used in laler stages oj tlie task 
and knowledge analvses lliev were mamlv 
applied in the power plani school where ii is 
possible lo Irec/e a system state of interest in ihe 
simulaior, measure ihe lime ot onuirerne and 
cidleci the related knowTdge lioin .d! availaldi' 
sources wiihoul am pressure I or the diagnostic 
expert system, knowledge coliei led and lormal 
isc'd using ihe time lines appr<»aeh includes alarm 
messages, aflectcd com[X)nen(s. parameters, 
actions nl Ihe supervision anil control system, 
arul human operator aelions Ihe knowledge 
chcii.iUon lor ihe user model td ihe inlelligenl 
graphical ediior is coiuerned with decision 
alternatives and asvxiated inlormation search 
behaviour of the operator (Sundstrom, It 

IS related lo the inlormation prcKCssing goals ol 
categonsalion of states, choice ol aelions. and 
evaluation ol oulcomes Ihis inlormation was 
also elicited using time lines Ihe intormalion 
gathered in each of the two types ol tune line is 
diffcrcm but both types are iclaled to each other 
with respect to lime lor the same lailure 
siiuaiirm l.ach ol these time lines can lx viewed 
as a kind ol inicrmcdiaie knowledge repre¬ 
sentation on paper I'his leehiiique is a useful 
1(K>1 for further knowledge lormalisation and for 
knowledge implementation. Time lines can 
easily be discussed with domain exptots before 
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any implcmcnlalion needs to be accomplished. 
In the case of this project, the time lines, as well 
as hrsi prototype implementations, were eval¬ 
uated by a power plant instructor (the domain 
expert) loj^elher with two researchers (the 
knowledge engineers). 

Ihe effort for the knowledge elicitation in the 
task and knowledge analyses was approximately 
the same lor both systems, the diagnostic expert 
system as well as the user model. The first phase 
in the sense of a cognitive task analysis approach 
as mentioned above with initial informal 
interviews look half a month each for both 
systems. 7 he later two phases with more detailed 
analyses required an effort of 5 months for the 
diagnostic expert system and almost 4 months 
for Ihe user model I’his included 2 full working 
days each for both systems at the simulator in 
the power plant school as well as a total of 14 
tlays of sessions with experts for the diagnostic 
expert system and H days for the user model 

Ihe last prototype version of the diagnostic 
expert system contains knowledge bases with 
about ^71) units (objects) as well as about 1(H) 
rules in 14 rule classes I he branching factor is 
3' 14 for each rule and the chaining factor 4 7. 
rhe number of units of the user model prototype 
IS about 170 and the number of rules is 41 in 4 
rule classes. 84 states can be diflerenliated m the 
user model 


( on\tructi(fN ol failure manui'enient expen 
systems 

Another example of the application of 
knowledge elicitation leclmiques was given m 
the conslruclion of failure management expert 
systems by Malm and Lance (0^87). A 
knowledge and task analysis was performed in 
parallel with the conslruclion of an expert 
system for failure management in a space station 
prototype device. A device lor removing carbon 
dioxide from cabin air was selected. I he expert 
system is called f IXf’K (Fault Isolation Fxpert 
to Fnhance Reliability) 

The knowledge engineering process for de¬ 
veloping I IXFR was performed by three 
persons; an expert in life support systems, a 
cognitive scientist and a consulting knowledge 
engineer. I he prototype was developed through 
close coojx'ralion between the systems expert 
and the cognitive psychologist who was the main 
knowledge engineer The knowledge for the 
trouble-shiHiting expert system was based on 
device design information and experience with 
similar devices. Operational knowledge about 
trouble-shooting failures in the device was not 
used. I'hc goals, tasks, knowledge, methods and 


design decisions involved in conslrucling the 
failure management expert system were inten¬ 
sively observed and analysed. Thus, observations 
were the selected knowledge acquisition tech¬ 
nique for the investigation of the whole design 
process Five design tasks were observed and 
analysed; 

—alltxalion of failure management functions 
and interface definition 

—analysis of failure events, fault modes, and 
effects 

—selection and construction of measurements 
and test procedures 

—analysis of fault symptom patterns and con¬ 
struction of diagnosis procedures 
—conslruclion of procedures for failure effects 
management and maintenance. 

Furthermore, tasks for the revision of the failure 
nianangemenl software were observed and 
evaluated Ihe development and analysis efton 
for FIXFR required about 30 full working days 
for each person, the domain expert as well as the 
knowledge engineer, distributed over a lime 
of five months. I'he software revisions were 
performed one year later and required halt a day 
for the expert and seven days for the knowledge 
engineer. I he FIXI’R knowledge base contains 
IM8 units and references 42 IJvSP functions. For 
diagnosis, 28 rules in 0 rule classes arc used. 

One of the conclusions drawn from the 
experience with this cooperative knowledge 
elicitation technique is that ‘the knowledge 
acquired from Ihe expert should include much 
more than Ihe rules and procedures for failure 
management ' I he expert's choice of strategics, 
and supporting analyses and models, need also 
to be represented explicitly in order to deal with 
limitations of the failure management expert 
system and Ihe need for later revisions. Further, 
it was observed during the whole design process 
that mental models of the device and its 
behaviour were important. Such models are 
under development by Sundstrdm and .lohann- 
sen (1989). 


INDUCTION LXAMPLLS 

Two examples will be given of the use 
of inductive techniques in the industrial 
environment—their use in British Petroleum in 
the design of gas-oil separator plant, and at the 
European Space Agency for the design of expert 
.systems in satellites. 
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Use of mduenoit by engmern 
ITie gas-oil system assisiN engineers lo design 
gas-oil separators The uiulerlving hydnKarhon 
productiiin separation prtxess is quite amvpli* 
caied, relying on a variely of knowledge Miurces 
such as manuals, cix'es of praeliee, space 
hmitations, and on the crude oii quantiiy and ihe 
gas quality required Kev taclors incliule the 
delivery svsicm, a user fnendiv inter taev 
unolving graphics design, and iruerlacing to 
cxisnng FORTRAN routines tius oil is large 
svstem-x'imiaimng over 2MI) rules and is 
expected to eveniuallv grow m si/e lo IdO.otHi 
rules In the present ex^implc, the system used 
l(»0(i examples to creiiie an cxfHii svsiem 
(Kcupying aKmf ^Mbvies of storage I his 
coriMsied of 14.Mk) Imes of I OR I RAN ccmlIc 
generated auiomaticallv hv the inducuon pioc 
ess Ihe iiulomatie generation oj KiRlRAN 
was partieularlv useful sinec this enabled the 
s\sicm lo be inlertaeed easil\ le oilui 
engineering modules I he remarkable lael aboui 
ihe s\slem is ihal il look one \cai ol ettort lo 
create and now requires about i>iu monih |H‘f 
\ear oi rnainlenanee eflorl I his sliould be 
compared wiih the eflori required c* prothue the 
M> ( IN and \( ()N sNslenis i IfKl and ISO 
man years, respcctivclv) Much ol tins retkued 
develo[MiK‘iii and mainlemmce cost is claimed lo 
result Oom the use ol mductue techmijues 
((iui.'lovle. iMSb) 

Slocornbe of Itrilish reltoleiim iSlocombi ti 
al . b^Hb) claims that the inductive iechni(p)e is 
ideally suited lo the engineering lnny>eiamenl 
‘ riie expert is invited lo suggest a possible set ol 
solutions to a particular problem I hen. he 
thinks ol lire lactors which are involved m 

ileeidmg which cheme li» make boi evample, m 

choosing a Ivpe of vessel lor use m a refmeiv the 

expert wnuki lake into account the quality ol 
output needed, the thtougfipul ol material, die 
si/e ol the site avaikihle and so on I he last ‘-'.age 
ol this process involves the expert provnlmg a 
lew examples of real e; scs The soltwan then 
induces the rule. At if is stage, the expert s 
interest is caught, Ihe rule mav be over simple, 
so the Xpert thinks up another example to 

illustrate the difference between the two cases 
Or the rule mav separate two factors >Ahich are 
later decided lo be the same Ihis technique 
concentrates on: homing m on the psychological 
problems 

Ihe key piiini is that the domain exfxnis arc 
able to interact directly vviih the knowledge 
acquisition priKCss with nrimmum assistance 
from a knowledge engineer As Moore fxnnts 
out (Slocornbe e( ul . 1MH6). The academic 
approach . . requires a knowledge engineer with 


no expertise u\ the engineering iluniiun lo 
approach the expert and laiy i know nothing 
aKiut youi area, but would like you to tell me 
everything you know* and preferably m the form 
i>f explicit rules Ifur best exfXTts are long 
e\[xTienced mduiduals with a wealth of 
heuristics and rules of thumb I hcv find it very 
difficult to articuhte then knowledge cxpheitly 
but can reel ofi any nuinhet of examples and 
outcomes under particular cireumsuirues* BP 
combine this inductive approach with sophistt 
caied system birikiing tacihlies and iiic now using 
the md letive techniques in a munbei o( 
application areas 

Sairlhtt iitagru>sL\ 

Ihe second applieanon involves the construe- 
lion ol a pioioivjK* ondvoaid exfx^rl system kn 
dealing with fsowei failures m a saicllife Ihe 
appioach is mtcrcstiiig in lird it not only uses 
i|uakiaiive r-UMlelling and imkictive techniques, 
but also tries to address Ihe piobleiris ol 
validation mentumed earlier This latter proldem 
was. m fact, the mam reason behind (he pio|ecl 
Miuc the I uiopcan Space Ageiuy w ■ naluralty 
vciv waiv ol placing unvalidaled exfK’ii systems 
on board a salellile without validation The wank 
was earned out at the luring Institule* (Glasgow, 
and has lu en icported In Pciiice (IWK) I he 
power subsvsicm Inr ihe satellite can be viewed 
as m I ig .■! 

When the saiellik' is in sunlight, fxiwer is 
genciaicd m the solai array panels Hus (hiwci 
IS used lo drive I he payload and recharge (he 
batter v In the eclipse phase, the ballerv 
maintams tfic pavload I he Array Switch 
Hcguliitor (ASK) Cimiams switches to enable or 
disable solar piinels A compiiralor delects a rise 
or lall m bus voltage and auiomaticallv opens or 
closes A SR sw itches U) restore the bus voltage 
The riecincal Integration I'ml coniiiins swatches 
fiu main ihargmg or trickle charging the two 
batteries A reablimc numerical sirnulalnr hail 
been developed (or the satclliie to he used lor 
operator training I his simulalor enabled the 
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(Jevelopmcnis to be tested on real data. A 
traditional expert system had already been 
constructed to perform the above tasks but 
validation for this system was problematic, llie 
approach was to construti an expert system in 
such a way that the validation problem was 
minimised. 

I he solution involved three key components— 
a qualitative model of the system, the use of rule 
induction and a sophisticated display system to 
make the operation of the satellite visible. The 
approach is quite general and can be applied to 
most physical systems 

I he qualitative model of the satellite power 
system was constructed in the language 
PKOIXKi. It is a model containing deep causal 
knowledge as opposed to shallow, operational 
knowledge. Shallow knowledge is sutficient to 
perform a task but does not have the underlying 
causal mechanisms. Deep knowledge, on the 
other hand, allows reasoning from first principles 
to be carried out. The model consists of 
definitions of each component and its relation- 
ship to other components (upstream and 
downstream of it). Behaviour rules specify how 
each component affects any neighbouring com¬ 
ponents. All that is then needed is an initial slate 
and the model can be executed. I he model is a 
qualitative one m that it does not deal with 
precise values of voltages or currents over lime. 
Rather it deals with values such as low, medium 
and high. Although, at first sight, this seems very 
restrictive, it corresponds closely to domain 
expert descriptions when reasoning about the 
operation of devices, and it is able to give more 
meaningful explanations than a quantitative 
model. Of course, it is also computationally less 
complex. 

I'he satellite transmits a number of parameter 
values to the ground control and the mechanism 
for inducing a failure rule is as follows: 

- fail a component 

-run the model until it reaches a steady stale 
—collect the values of the observable parameters 
-the failure stale together with the observable 

set make up an example of failure 

repeat this for all single components; this 

results in a complete set of failure examples 
" use Mile induction to induce the underlying 

rules of failure 

the rule is added to the expert system. 

I’hc process thus generates shallow knowledge 
from deep knowledge with a considerable saving 
in storage. For example, the deep knowledge 
representation required 36 Kbytes of store 
whereas the shallow representation required 
only Although the validation problem has not 


been completely solved (is it actually solvable?) 
the reliability of the rule system has been 
improved. Since the failure set is a complete set 
the validation process has been simplified to 
validation of the qualitative model and this is 
much easier to do. The model when taken in 
conjunction with the graphical user interface 
enables the engineer to visually check the model. 
This is not possible with a set of rules. 

To enable the reliability of the rule set to be 
checked and compared with the original expert 
system, a knowledge integrity checker was 
constructed which checks a rule set for some key 
features—unreachable clauses, dead-end clauses, 
cyclic clauses, type checking, incompleteness and 
subsumption (Pearce, 19H7) The checker re¬ 
vealed that the original rule set (which consisted 
of 110 rules) contained seven errors—a type 
error, two unreachable clauses, and four 
dead-end clauses. T he induced rule set (75 rules) 
had no errors. Finally, both expert systems were 
executed on the simulator. Fourteen different 
error conditions were simulated. The original 
sy.stcm delected 10 of these (727r). I hc induced 
rule set was 1(K)% successful. One other 
important aspect to note is that the development 
time of the original expert system was 6 
man-months and the total development time for 
the induced set (including the building of the 
qualitative model) was 3 4 man-months. 

The bottleneck which still exists in using this 
approach is that required for the creation of the 
PROI.OG model. I'he luring Institute is 
currently automating this process by using 
SCiML (Siaiulardised Generalised Mark-up Lan¬ 
guage) (Smith and Stutely, 19H8) for specifying 
the model. The model is specified in normal text 
using SGML markers to identify key model 
components and interactions between them. The 
PROLOG model is then automatically generated 
from the SCiML document using a translator. 

riiis example shows the power of the 
approach. Furthermore, it can deal with multiple 
error situations—one simply creates examples of 
multiple error situations. Although this is 
computationally intensive it only has to be done 
once. For complex systems, the system can be 
broken down into lower level subsets and solved 
individually. Then, the interactions between 
these subsets can be treated separately. The 
approach is ideally suited to diagnostic problems 
in industrial systems where validation is impor¬ 
tant. Finally if the deep model is maintained 
along with the shallow model, excellent explana¬ 
tions can be provided. 

CONCLUSIONS 

Kidd (1987) has given the following guidelines 
to assist in the knowledge acquisition process: 
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-^Knowledge cngineeni siiiould appreciate that 
any data elicited have to be inicrpreicd as u> 
whai underlying knowledge or processes ihc\ 
imply and that the system knowledge base is a 
itkkIcI of the expert’s domain knowledge 
amsiructed by the knowledge engineer 
- Ric nature and difticuliy of the knowledge 
acquisition priKcss depends on the degree of 
tormalily of the human language used to 
describe the domain. 

Knowledge engineers should aim to formulate 
a knowledge level description of the selected 
problem solving task 

At an early stage, knowledge engineers need 
to decide on the appropriate modality for the 
proposed system 

In any interactive system, the user is the active 
agent. Analysing user requirements must Ix^ a 
key part of the knowledge acquisition 
If the role is decision supfxiri. the knowledge 
engineer should iilenlily weaknesses m the 
expert reasoning process and aim to comple¬ 
ment these. 

Ihese guidelines summarise what has been 
outlined and emphasised in the previous sections 
ol this paper Ihe irni^ortance ol differentiating 
between Ihe task and the impiemeniation lesci 
has been highlighted It is clear that Ihe 
cognitive behaviour and knowledge structures in 
hurn.ui problem solving tasks have to be 
understood and formalised hv appropriate 
knowledge acquisition techniques, before anv 
systems implementation makes sense Ihese 
factors are not well understood at the present 
time Equally importantly, the knowledge 
elicited Irom a domain expert must be checkcvl 
and re-checked for possible cognitive bias 

Because the only known way to test a 
knowledge base is \o execute it, acquisition and 
implementation often become closely inter 
twined This increases the danger that the 
technology used for implementation will m 
fluence the acquisition process itself One way of 
minimising this danger v to use* some form ol 
intermediate knowledge representation lormab 
ism or I inguage (for example Malsumura et al . 

however, we arc still s(»me wav from 
achieving this objcclive. This fact, together with 
the requirement for several iterations over the 
knowledge acquisition process will inevitably 
mean that knowledge engineering wall be a 
skilled and lime consuming aciivny for the 
forsecable future. 

There is clearly an urgent need for improved 
tcKils. More KkiIs should be designed which 
allow domain experts to play a more direct role 
in the knowledge acquisition activity. Tlicre is 
also a need for tools to assist with the validation 
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problem, a crucial area in the dcvrlopmcnt of 
industrial expert systems In this respect, the 
quaiiiative nuHklling appiAiach (when coupled 
with inductive icchniqurs) has shown some 
ptomise in at least pushing b^tck ihr vididahon 
prtxx"s;s away froiu direct rule validation towards 
miKiel validation w Inch is sinnewhal easier to do 
In the absence of (onnal vahdaliotu testing will 
continue to plav a rniqor role 

Some wiirkers (for example < rwsi‘inann and 
Krasemann, WKKf ha\e emphasised the need fi>r 
a thorough sv stems analysis approach (as uschI in 
siiltwurc engmeenng) in the deveiopincni iif 
cx|x*n systems Whilsi s<ime artilicial intelligence 
techniqucN are beginning n» Ik used mi software 
engineering (for example selection of ctmceptual 
structures and knowledge representation nunleis 
and the use of rapid piototyping), Ihcie are 
proven prtKediircs trom conventional vtiflwarc 
engineering whieh could Ik used to advantage in 
Ihe knowkvlge engineering pioeess Such piixc 
durcs would include requirements analysis, 
testing stiatcgies, approaches lo realising 
efficieni implementations and mainienanec 
revision techniques A requirement a*ui lunelion 
analysis needs to be {Krloimeti The eritcna tor 
testing the system have to be ilenveil from (he 
requirement anal v sis Sol iw are opiimisalKm. 
portahility lietween languages and use of Itiols 
with eflitieiM lun time environments are all 
inqHMtanl Ideallv, ( rasernann and Kiasemann 
(I9SK) suggest that the soliware maintenance 
should be left with the system user and domain 
expel I rather than with the know ledge engineer 
( an the domain exfUTts also (ake on the role 
of the knowledge engineer'^ It is lerlainly true 
that the effort required for a domain expert to 
master the teehmques of knowledge engineering 
IS less than that required for Ihe knowledge 
engincei to become a liomain e.X|Krl ( eilainly. 
ihis view IS more plausible in the held of 
indiisinal experi systems Ihan in other domains 
Industrial domain experts are fx-lter trained to 
think in systems and sofiwjire engineering terms 
Therefore ihev should more easily be able to 
express their knowledge in paradigms which are 
more ch>selv related to system implementation 
provided appro|)naie knowledge acquislion tools 
exist An example in this direeiion has iKcn 
given above m ihc cfinstruction of the failure 
management expert system However, experts 
bv ihcir verv nature are scarce and overworked, 
so it is unlikely that they will have the 
motivation to do this. There will also be 
difficulties in eliminahng cogriMive bias On the 
whole, wc do not think that this is a practical 
solution, particularly with the relatively pior 
state of current knowledge acquisition tiMils. 
Another problem which has not yet been 
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M)lvcd concern?* the conflict between the 
difterent depths of knowledge required by users 
with different levels of experlise and skill. The 
knowledge requirements for expert systems to be 
used by other high levcl experts will differ from 
those aimed at advising less expcrl or casual 
users (Madni, 19HH). Ihis conflict has not been 
properly recognised or fully investigated. The 
construction of expert systems which support 
different kinds of users with different degrees of 
experlise and knowledge will require a much 
deeper understanding of the cognitive fichaviour 
and knowledge structures used in human 
problem solving tasks 
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Decision Trees and Transient Stability of 
Electric Power Systems'^ 

I WEHENKM n am! M PAVM I At% 

A gefieral inductn’e inference methini a prt>pip\ed and applied fr> the 
automatic building of decision trees for the transient stability assessment of 
power systeim On the basis of large sets of simulations, the essential 
features of the method are analysed and illustrated 
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rediKtu^n aiuJ analysis, decision ihcois ii;uisu‘ni sUihilMs analysis sx-iimIiviiv .md ninttoi 


AbfMlrael An inductive inference method lot ilu: juiomaiu 
huildifig of dciiston trees is iinestijyaU'd Amon^- its variou 
ijsks. the spliNin^: and the slop splinm^’ entena successivcl 
applied to the mnles nt a prossn tree ,ire (ovmd to pl:i\ 
criKi.il role on its overall shafK* and fx^rfoirn.intcs Ih 
application of this pcncral method in tranMt rii Niabilnv 
>>slenKilicalls explored raiarncicis rel ted to the st. 
s['liTiini; criterion, to the Iciirriinp set and > ihe ire« ilasse 
arc thus considetcd. and (heir influence o die tree Ic.iluie 
iv Mrutmi/ciJ F vrdualjon criteria appi ipriatc it' assc 
.ucLjiacN .ire also compared Varmus irj ifis :<ri furdu 

examincil. such as cnmplcxilv w ruiinl of clasM:s t 

inisclavsificalion rale vs (n(H' tut niiscl.i sifu .itnm error 
I'oKsihle uses of the dees art: also enviS4tf;' I i itmpLitaiion 
issiuK ic'aong lo the huildinp and Ihc use »( trees are linalK 
lIisc ijssed 

1 IN I Kf)I)r( I It IN 

[in Difi.sioN IKM mclhocioinpv is nnwadiiys 
rccogni/cd lo he a generally nonparanielnc 
leehnique, able to produce classihers in order to 
assess new, unseen situations, or uncover the 
mechanisms driving a problem (Hreiman et al . 
]W4, hriedman, 1^77; Kononenko et ui. l‘fK4, 
Qinnlan, 1MH6). The building of a decision tree is 
based on a learning set (LS), compHiscd ni a 
number of slates together with their correspond 
mg known classification. The building poKcdure 
slarls at the lop node of iht tree with the entire 
IS, and progresses b\ recursively creating 
successor nodes, i.c. hy splitting the LS into 
subsets of increasing classihcalion puniy The 
prcK'edurc is slopped when all the newly created 
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nodes are ‘teiminal ’ ones, coiiiaimng ' pure 
enough It irnmg suhs<*is I he w ays o\ splitting 
the successive subsets, and even more of 
deciding when to stop sphiimg, are essential to 
the method Otien, the lack ol geneial cITieieiU 
stop split ling methods is evaded bv means of 
.illernaiive procedures, such as litst building a 
vcTv large tree, then pruning it. they generally 
rely tm empmcal jusiihcalions appliciihle to 
particular cases, but without guarantee t)f 
effecTivcness m tUher application domains. It> 

I move this difficulty, a slop splitting cnienon 
was tleveliipt'cl on the basis of a general 
statistical hvi^xiithesis lest (Wehenkcl et al . 
bJHda, b) It was designed indc|H’mlently of any 
specific application, then applied lo power 
system transient siabiliiv 

Transient siabiliiy in general is eoncerned w'iih 
the system abiliiv to withstand sc'vere eonlin^ 
gencTcs A |xissible measure of this is the entical 
clearing time (( (71 ), i e the maiomurn lime that 
a tonlingency may remain without causing the 
irrevtH:ablc loss ot machines synchronism lo 
compute (X^f s one may cither use time-clomam 
methods, which solve numerically the nonlinear 
differential equatnms describing the system 
motion, or direct methods which rely on the 
Liapunov enter urn (Bergen, I5JH6, Kibhens- 
f'avella and I vans, LJKA) Observe that the C'(7T 
IS not appropriate enough (or assessing transient 
siabililv, in that it carries partly useless and 
partly intompleie information: indeed, it merely 
provides a rather crutie “yes-ormo ' answer, 
whereas what really matters in practice is to 
assess “stability margins ' and, il necessary, lo 
suggest remedial actions (HPRI IVoject, 1987) 
Within the tree methodology, however, the (XT 
provides a handy means of classifying the slates 
ofaLS 
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The applicahon of the tree methodology to 
transient stability was initially proposed in 
Wehenkel et ai (1986, 1987), then developed in 
Wchenkcl et ai (19H9a, b). The leading idea is to 
compress and organize the information about 
transient stability in the form of decision trees 
with the twofold objective: to classify new, 
unseen slates, and to uncover the salient 
parameters driving the transient stability pheno¬ 
mena. Note that the foreseen advantages go 
beyond this objective: indeed, on-line means to 
compute stability margins and to infer control 
strategies were also suggested (Wehenkel et ai, 
I9HH; Wehenkel, 19HH), I'he hrst results 
obtained in a few practical examples were quite 
promising. The constructed trees exhibited nice 
features, notably with respect to accuracy and 
complexity flowever, to make this method fully 
reliable and effective, a systematic exploration 
was necessary Ihis is a main purpose of the 
present paper. 

Particular attention is paid to learning sets, 
"adequate ’ for building efficient decision trees; 
the way of generating their states in simulations 
and in reaMife situations is discussed, and the 
influence of their number on the tree features is 
examined. 

Another key issue concerns the splitting 
criterion. In Wehenkel et ai (1986, 1987), this 
consisted of a lest applied to various "candidate 
attributes", chosen among static parameters of 
the power system, a prion likely to drive 
transient siahility. Iheir influence on the tree 
structure is investigated below. 

I'he cornerstone of the method is probably the 
stop splitting criterion (Wehenkel et ai, 
1989a, b). Applied to transient stability, this 
criterion yielded simple, quite accurate trees in 
the few cases considered so far. In this paper, we 
determine its optimal parameters, and explore 
the accuracy and the complexity of the resulting 
trees. 

riie number of stability classes to be 
considered in the automatic building of trees is 
another question worth considering. Complexity, 
accuracy, rnisclassilication rate and severity of 
rnisclassificalion errors are all interrelated 
features Our purpose is to assess them, and to 
suggest possible practical applications, not 
necessarily to decide on a solution. 

To conduct the above investigations we need 
appropriate tools for evaluating trees’ accuracy. 
One of our first concerns will be to consider and 
compare a prion interesting evaluation criteria. 

The ultimate goal for building trees is to use 
them This topic is a whole research of its own. 
In this paper, we will merely indicate possible 
types of applications. 


2 RJNDAMiiNTAli; OF THE METHOD 

2 . 1 . General framework and basic notaiicm 

The automatic building of decision trees by 
the proposed inductive inference methtxJ implies 
the existence of a learning set, i.e. of a number, 
say N, of preclassified states. Without loss of 
generality, we will assume that each state is 
characterized by a certain number, say n, of 
ordered numerical attributes (the same number 
for each state), and that the A stales are 
classified into two classes only (T,~}. I'he 
generalization to more than two-class classi¬ 
fications will be considered in Section 2.10; the 
extension to categorical attributes in addition 
to the ordered ones would be quite 
straightforward. 

In the sequel, a learning set (LS) will be 
defined by: 

LS= {(V|,c,), (V;..c,).(Vv, Cx)} ( 1 ) 

where the components of vector 

Va = (I’u. . ",.a)' (2) 

represent the attribute values of the state s^, 
which is characterized by its n attributes; 

s* = |fli = I'ulnlti: = i';*|n ■ • ■ n |«„ =-■ 

(.■') 

and where 

(k }. ( 4 ) 

Note thal the preclassihed learning set is 
considered to be a statistical sample of si/e 
drawn from the population of possible slates. 

The test set (TS). is defined as a similar, bui 
independent sample of size M: 

TS — ( 4. , , (’v + 1 ), (V v *. ; , t' v 4 •), . . 

(v V 1 \t , t‘V + A/ ) ) (-'^) 

It will be used for the purpose of evaluating the 
performance of a decision iree with respect io 
unseen stales (see Section 2.8). 

2.2. Decision trees (DTs) 

A DT is a tree structured upside down. It is 
composed of test and terminal nodes, starting at 
the top node (or root) and progressing down to 
the terminal ones. Each test node is associated 
with a re.rf on the attribute values of the states, to 
each possible outcome of which corresponds a 
successor node. The terminal nodes carry the 
information required to classify the states. Such 
a DT is portrayed in f^ig. I, built for an example 
treated in Section 4 in the context of transient 
stability. Note thal in this case, where only 
numerical attributes are considered, the tests are 
dichotomic, and the resulting DT is binary; each 
test node is split into two successors. 
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A convenient wav to dehne a 1)1 is u\ 
describe the wav it is used lor classilving a Male 
ot a pnon unknown clasMjicalion on ihc basis o| 
its known allribules 1 his classituMlion is 
achieved bv applying sequentially the test at the 
icsi nodes, beginning at the root of the tree, and 
sysiematicallv passing the slate io the siiccess^u 
appropriate to the outcome ol the test, until a 
lerminal niide is hnally reached; the slate is 
classiiied accordingly 

The above description provides an mtertfsiing 
geometric interpretation ol a tree pianedure 
(hreiman rt al , 1^84); it recursively partilions 
the attribute space into hyperboxes such that 
the population within each l>ox becomes more 
and more class homogeneous Phis in turn allows 
one to view the classihcation of a tree as the 
partitioning ol this hvperspacc into two regions, 
corresponding to the two classes l.ach class is 
composed ol the union ol the elementary boxes 
corres[X>nding to its terminal nodes. Figure 2 
illustrates the geometric representation oi the 
tree ol Fig I (Actually, according to this tree 
structure, the states hehmging to the regnm 
labelled stable ' have a small chance (LVv ) ti» 
be unstable ) 

2 . 3 . Automalu ( (fnstructio^i of I) Is 

Por a given LS. our purp )se is to build a near 
optimal DP, in the sense that it realizes a good 
tradeoff between complexity and accuraev. i c. 
between total number of nodes and classification 

OP,. 


■zc 

^ir» 2 (fcnmctrtc rfprCH‘nir4tH)n of ih<' tree* ot I 


ability. Usual wayii of eMimating aa'unicy are 
speciliciJ in Seiiion 2 8; antictpatmg, observe 
ihat. iruuuivcly. assessing trets’ ahdnv to 
correcily classdv stales sFwvuld rely on tesi states 
raiher than m\ stales belonging to LS itself 
The ultimate objective ot the building 
priKX'durc is to (i) select the relevant attributes 
among the candidate ones (generally the niimlxT 
of retained attributes is much iowci than ri. the 
total numlK! of candidate iiitnbutcs). (ii) build 
the decision tree on the basis of these fcicvani 
attrihutcN (bis building pnxetiuic is descrilHrd 
IhtIow (Wchenkel n al . IW'^aP 

• Starting at the root ol the tree, with the list of 
candidate aiiiihutes and with ihe whole I S, 
the learning states arc analysed m oidci ti^ 
select a test which allows a maximum increase 
in purity or , cqui\ alentiv. which provides a 
maximum amount ot mtormation about their 
classiticaoun Phe selection prcHccds m twu 
steps 

(I I for each attribute, sav ip, it liiuis the 
optimal lest on its values, by scanning the 
values ol this candidate atiribui (or the 
ditterem learning stales, m out case ol 
ordered numerical ailnluiles. this step 
provides an opiimal threshold value t',, 
and defines the test 

ar (b| 

(I!) among the diflerenl candidate attributes, 
it chooses I he best one. a», along with its 
optimal value, r,,. to split the node 
In short step (ii) Jelmes the optimal attribute, 
step (i) Its optimal Ihicshohl value 

• Phe selected test is applied to the learning scO 
ol the node and splits it into rwiv sul>sets, 
corresponding to the two successors of the 
node Starting with (he root o( the tree and 
the entire PS, the two subsets 

I.S, * iv, ( l.s 

[.S:^ {>. * I.Si«. -r..), 

cories|Xinti to the two successors ol the root 

• (he sueccssors ate labeled terminal or not on 
the basis of the vtop Ap/rrrmg entenon 
described below 

• Por ihe nonterminal nodes, the overall 
procedure is called recursively m order to 
build the corresjHnuJmg subtrees. 

• Por the terminal nodes, the class probitbililicv 
p. and p are estimated on the basis t>f the 
corresponding subset of learning stales there 
suircd. and the class lalxl of the majority class 
IS attached 

Obviously, the crux of the entire construction 
of a DT lies in the selcciton of the splits and the 
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of a 07 lies in the Mricction of the splits and the 
decision whether to declare a node terminal or 
to continue splitting. I’hese two questions are 
examined below, after the introduction of some 
necessary notions of (im)purity and information, 
drawn from the information theory. 


2.4. Mathematual formulation 

2.4.1. Definitions. Denoting by; 

S the subset of all possible states, correspond¬ 
ing to some node of a D1, i.e. directed to that 
node by the classification procedure; 

p( \ I S) (resp. /;( |S)) the probability of a 

random state drawn from S to belong to the 
class 4 (resp. ~); 

T a dichotomic (candidate) test |e.g. see (6)| 
on some attribute's values of the slates; 

S^, (resp. S„) the subsets of S of slates yielding 
the answer “YliS” (resp, ‘NO”) to the test 7 ; 
these sets would correspond to the successors of 
the node split on the basis of 7 , 

/;(S, I S) (resp. f){S„\S)) the probabilities of 
the outcomes “YLS” and “NO” in S; one 
defines the following measures. 

7 he prior “classification entropy” of S 

H, (S)^ - !/>(+ |S)loj{,(/;(f |S)) 

4 p( I S) log; (/>( - I .S))). (7) 

W.(S) IS a measure of the impurity or the 
uncertainty of Ihe classification of a stale of S; 
//<(S)-(I corresponds to a perfectly pure 
(^;(4|S)- I or 0) subset, whereas /f^(S)-l 
corresponds to />( 4 | S) - p( \ S) — ' i.e. max¬ 
imal uncertainty 

I'he entropy of S with respect lo the tesi / 

///(S) -.|p(S, |S)log,(/;(S, |S)) 

4 /7(S„ I S) log; (/;(S, I S))|. (8) 

//,(S) is a measure of the uncertainty of the 
outcome of / in S; with respect to the outcome 
of 7. it has similar properties to //, with respect 
lo the classification. 

The mean posterior “classification entropy” of 
S given the outcome of 7' 

//, ,,(S) I S)//, (SJ 4/»(S„ I S)/Y, (S„). (4) 

i^(S) is a measure of the residual impurity if S 
is split into S, and S„ according to the outcomes 
of test T. 

7'he “information” provided by 7 on the 
classification of S 

/,'(S) = //<(S) -/A,,(S); (10) 


//(S) is a measure of the ability of 7 to produce 
pure successors. 

I'he normalized information gain of 7 


c!iS) 


21[{S) 


/A(S) + 7/,(S) 


(in 


Remark. The measures defined in (7)-(10) are 
expressed in bits whereas that in (11) is 
dimensionless. 

2.4.2. Interpretation. It is possible to give a 
qualitative interpretation of the relation between 
CliS) and the classification ability of the lest 7. 
lo this, first observe that the following 
inequalities can be easily shown; 

0 5 H, (S). //,(S). ,r(S). /r(S). CjiS) s 1 

( 12 ) 

/A„(S).//<S)s;//,(S). (13) 

7'hcn consider the two following extreme cases; 

1. The outcome {“YES”, “NO”} of 7' and 
the classification {4,-} arc statistically inde¬ 
pendent, i.e. the test 7 provides no information 
at all about the classification. In this case 

p(+ I SJ = p(4 I SJ = p(+ I S) and 

p{~ \S,) = p{-\S„) = p{- S). (14) 

Thus, 7/^ (S J ~ //r(S„) = H( (S) and according lo 

(9) , H( . f(S) ~ H(iS). In addition, by virtue of 

(10) and (li), 

/?(S) = r?(S) = 0- 

2. 7’he outcome of 7 provides pure classified 
subsets Sy and S,,. 7hen necessarily /7 (S,) = 
//((S„) = (). According lo (9), this implies that 
Hi ^ f(S} “ 0 and //(S) = H^ (S). Moreover, in 
this case the probability p(S, | S) (resp. 
/7(S„ I S)) w'ill be equal to either /?( 4 | S) (resp. 
p(- I S)) or p(- i S) (resp. p(4 [ S)), and thus 
Hf (S) = //((S) and 

C7(S)- 1. 

From the above it follows that the higher the 
value of C7(S), the more interesting the lest 7 
for splitting the node corresponding lo S. This is 
exploited in Section 2..S to define the optimal 
splitting rule, used in the building of DTs. 

2.4..1. Estimation on the hcisis of the sample 
of learning states. I'he information and entropy 
measures defined in (7)~(11) cannot be comp¬ 
uted directly since the probabilities involved are 
generally unknown. 7'hcrefore, we use the 
learning set as a statistical sample and estimate 
the probabilities by their empirical values 
computed in the LS. More precisely, the set S. 
corresponding to some node of the DT, is 
replaced by the subset of learning states (i.e. 
SDLS) corresponding to this node. 7’he 
compulation of /7(4- | S), p(- | S), p{S, \ S) and 
p(S„ I S) of this subset is then straightforward, 
since the classification and attribute values of the 
learning states are known. 

It should be noted that, although the estimates 
of /?(+ I S), p(- 1 S), )7(S, I S) and p(S„ \ S) arc 
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generally unbiased, their substitution in (TtHU) 
provides rather optimistically buised information 
measures, thus overestimating the actual “gixKl- 
ness ’ of the lest T Fortunately, the umouni of 
bias IS inversely proportional to the sample sue 
(the number / of states in SOL-Sl and the 
measures may still be used lor ctimpanson 
purpitses, e.g. in order lo select an “optimar’ 
test for splitting the node. 

For example, it can be shown (Kv^dseih. 19X7) 
lhat for an actual value of //<S) ~(t (no 
correlation), its estimate 

/ = //<SnLS) (15) 

has a like disiribution, the exfKxiation 

(or bias) of which is positive and iinerselv 
proportional to the number / of slates in S n I .S 
This property is exploited bndow. in the stop 
splitting criterion. 

In the sequel, to emphasize the difference 
between the purity measures and their estimates, 
we will call the latter "apparenl ’ as opptised in 
the ‘real ' unknown values. 

2.5. On the (pplimal splitting criterion 

Obviously, the splits at the lest nodes should 
bc‘ selected so as to avoid lo the extent possible 
the appearing of deadends (i c of impure 
lerniinal nodes, see the definition given below in 
Section 2.6), and lo obtain the desired degree o\ 
accuracy I his is done in a more or less heunsue 
(not necessarily optimal) lashion the best test 
(defined by the optimal allribulc logciher with 
Its optimal threshold value, sec Section 2 3) is 
considered lo be the one which separates at most 
the stales of the two classes in the local learning 
subset. This strategy amounts lo selecling the 
spill which yields the purest direct succcsmus. or 
maximizes the apparent normalized infoimaiion 
gain ( /{SPiLS) defined m (II ) In that sense, it 
may be considered to be locally, rather than 
globally optimal. 

2 6. Stop splitting method 

Many methods were pri»^M)sed For example. 
ID3 (Quinlan, 1986) slops splitting at a node 
only if the corresprinding learning subset is 
completely included in one of the classes of the 
goal partition. Unluckily, m many situations, as 
shown by our experience, this strategy lends to 
build overly complex DTs. most of the terminal 
nodes of which contain only a very small and 
unrepresentative sample of learning stales. Ihcy 
perform generally badly with respect to unseen 
situations and are unable to indicate tn a reliable 
way the inherent relationship between the 
attributes and the goal classihcalion. lo 
circumvent this difficulty we propose a more 


m 

conservative criterion, which stops splitting a 
node if one of ihe (tillowinfi two amdilions is 
met 

1 The local subset of learning stales is 
suftkicntlv class pur* Such a icrintitiil nvHk will 
l>c called a iraf in the sequel Ihc degree of class 
punt) required tor leaves is a parameter of the 
algoriihm and fi.xcs the amount of detail wc want 
Ihc 1)1 express 

Sole Actually, the dcgiee of residual 'tm 
punrv" rnjv be sfHxilied by the maximal 
lesidual entropy |scc (7)] Fhc entropy of the 
learning subset relative to a node, is inversely 
proportional lo its puiily. Iluis. m terms of 
eninqn, a ikhIc will be a leal only tl its enlropv 
IS lower than //,„ In the practical invesligalions 
re|xuied in this paper, a consliini value of 
//„, " () I bits was used I his very low value 
amounts lo building DTs us deuiilcd as iiossihlc 
Higher values could be oi interest if one wanted 
uy bulk! simpler “first guess ' Ills, for data 
exploration purposes 

2 Iheie is no jvossibiliiv to enhance the DI 
accuracy in a statislically stgnificanl way by 
spliiiing this node further In other words, given 
the optimal dichotomic split (or this node, there 
IS noi enough evidence in the local learning 
subset, that this split would aciually improve the 
real perfoimarue ol the 1)1 Such a terminal 
riwdc IS called a deadend in ihc sequel Ihis 
second cnienon prevents the building of 
unnecessarily complex Dls It is foimulated as a 
slalislical hypothesis tcvi 

ifiven the local subset oj learning states and the 
i>pfirfUil split, (an ne aaepf the hypoihestK that 
the apparent* increase in aicurfuy, as measured 
in this Mibset. provided by the spilt, is a purely 
randfort efft^( i - 

In quaniitalivc terms, the statistic A ^ <7/ 
(whcie / IS the si/c of the liKal learning subset, t 
a constant and / the apparent increase in purity 
provided by (he optimal split) is distributed 
according i<i a ;f-squarc law (with one degree of 
freedom) under the hy|X)theM% of no real 
increase m purity Hence, il wc hx the ci risk of 
not delecting these siluaticms to a given value, 
testing the value of A againsi ihc threshold A,, 
such that Prob (A A, J "■ a allows one to 
detect the cases where the apparent increase in 
accuracy is a random effect, waih a probability ot 
I ( 1 . Figure 3 sketches such X“^quarc probabil¬ 
ity density functions 

• Apparem as <>pp<>scU Id real tncrcasc in accuiacy. fiic»Tt» 
iKc increase rnciHU/cd in the LS as (»ppu«-d lo ihr iiKrcaM: 
mcAsurcU for unseen stales 
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f l(. ^ ;( SLjUHfc prohabiliiy ilunsily liinctinns of A 

Thus, the a-risk ol the hypothesis lest fixes 
the amount o( evidence we require at each node 
in order to split it; the answer depends on the 
value of the size of the local learning set, and 
the amount of apparent accuracy improvement 
provided by the lest Ihe question of "how 
much evidence should be required to allow the 
splitting of a node ', is related to the degree ol 
representalivity we impute to the learning set 
and the risk that this degree is overestimated. 
Iherefore, the degree of cautiousness of the 
procedure is fixed by the user via the selection of 
the value of a. This value ranges (rom 1 (the 
criterion has no effect on the splitting procedure 
anymore, and (he tree grows according to the 
above condition I) to zero (no growth is 
allowed, the tree reduces to its root) 

T he value of a has indeed drastic effects on 
the resulting trees characteristics as illustrated by 
the following example (borrowed from Section 
4, beUrn ). faun l)T s were grown for o assuming 
the values 1.0, 0.1, 0.01 and 0.(KK)l; they were 
built on the basis of a LS composed of 5(K) states 
and evaluated on ihe basis of an independent 
lest set of 15(KI other stales. T able 1 reports their 
complexity and accuracy, i.e. the number of 
their nodes and the percentage of correctly 
classified test stales. These quite impressive 
ligures illustrate that the larger trees are less 
accurate than the smaller ones and on the other 
hand that the appropriate selection of a allows 
the building of small, yet belter DTs (see also 
the discussion of Section 2.0 and the simulation 
results of Sectiim 4..V2). 

2.7. Compansitn v\iih the ll)?s meOunt 

The proposed inductive inference method 
originates from the 11)3 algorithm, from which, 
however, it departs in some essential respects. 
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Below, we collect the mam differences between 
the two methods. 

Application domain, ID3 was initially in¬ 
tended to handle mainly symbolic and 

deterministic learning problems characterized by 
very large (almost complete) learning sets 
composed of objects described by discrete (or 
qualitative) attributes only. Thus, it was 

essentially designed to handle large sets of data, 
in order to compress rather than extrapolate 
their information (Ouinlan, 19H4). On the 
contrary, the proposed method is especially 
tuned to handle mainly numeric and 

nondeterministic problems, where the learning 
set has to be generalized in an appropriate 
fashion. T he method is general enough to handle 
at the same time numeric and qualitative 

attributes and can be tuned to the degree of 
"representativeness" of the learning set, via the 
appropriate choice of the threshold a (see 
Section 4.3 below). 

Stop splittirif^ criterion. IL)3’s slop splitting 
criterion amounts to building DTs which classify 
the learning set as correctly as possible, which is 
indeed the best approach if the latter is almost 
complete. The proposed method, on the other 
hand, sli^ps splitting earlier, as soon as the 

statistical hypothesis test alows to conclude that 
no sif^nificunt improvement of the tree's accuracy 
would be achieved by developing the node 
anymore. This is quite different, and enables the 
method to lake the best advantage of learning 
sets which are only partly rcpresenlalive of the 
possible objects. This is further discussed in 
Section 2.y below . 

Optimal splitting criterion. 11)3 considers the 
best lesl to be the one providing the largest 
apparent information gam //. It has been found 
that this measure is biased in the favour of 
those having the largest number of sucees- 
sors, especially in the context of randomness 
(Ouinlan. 1986). Note that this is supported by the 
fact that the number of degrees of freedom 
of the distribution (and thus its bias) 

increases linearly with the number of successors 
of a split. The normalized correlation measure 
Cl evaluates the tests more objectively since the 
number of succcsors is compensated by the term 
Hj tn its denominator, 

Straret^y ID.Vs strategy, embodied by its 
optimal and slop splitting criteria, amounts to 
building trees which maximize the apparent 
reltahiliry, regardless of their complexity. On the 
other hand, the strategy of the proposed method 
is to build DTs maximizing a measure of quality 
which realizes a compromise between apparent 
reliability and complexity. The latter is more 
effective in the context of incomplete and 
random data (Wehenkel, 1990). 
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2.^<. EvaluiiUon cntena 

The crilcrui described below (e g. see Touvs- 
aifU. 1974) allow assessing ihc accuracy of a DT 
sn general, or equivalently, its misclassihcation 
rdic ()f>scrvc that these are only csiimaics, smee 
in real world problems it is seldom |>ossible to 
scan all ihc pi>ssihle slates, even in deterministic 
lypc problems 

Hesuhsmunon esttmaie. /?*' ohiamcd b\ Cim 
viJering all ihe states belonging lo the IS, 

dropping them through the 1) 1, and a>mpuung 
the ratio of misclassified o\er ihc uHal number 
{A ) oi stales; 

It'sr sample estimaie, obtained bv con 
sidcnng all the stales Ix'longing ihe IS. 

dropping them through the 1)1. and computing 
ihc ratio of misclassibed over the total rnnuxr 
j \1) of stales; 

( rosi-valuiatUif\ vsi\mau\ H " tibiained by (i) 
dividing the total number ot learning slates into. 
sa\ V'. equally si/ed subsets. using one of them 
as the test set and the union ot the remaining 
T I as a learning set: (ii| building a I) I based 
on (his learning set and assessing its accuraev on 
ihc basis ol ihe lesi set; (in) repealing this 
procedure V limes b) considering successivelv 
each of the 1" subsets as test set: (iv) taking the 
a\erage of the I individual cslimates as the (inal 
accuracy. Ihc validity ol the procedure implies 
that V is quite large ( 10). so that the DIs 
constructed on the basis of tlie iV 1) subsets 
are (almost) identical with the iinlial Dl 
consirucfcd on tlie basis ot the loial number of 
stales (V’ subsets) lor V - A this is ihe so called 
leave-one-out ' eslimalc 

Remark Ihe above delined measures can be 
considered as more or less accurate estimates ot 
the true probabilily o\ miselassilyjng a new siale 
Ihev have the following eharaclCMstics 

IS easy to compute and requires no 
additional samples but is generally oplimislieallv 
biased, underestimating l le real probability of 
error. Intuitively, for fixed V, the larger the Dl. 
the higher the correlation beiween the Dl and 
Ihc LS, and Ihe more biased R . 

A’" IS the most tellable and unbniscd eslirnatc 
and is easy lo compute Moreover, if M is 
sufficiently large its variance is small. Ils mam 
drawback is that it requires additnnial stales in 
sufticienily large number, which cannot he used 
in the learning set. Another advantage (d R' is 
lhal one can easily estimate its variance and 
therefrom compute confidence intervals In Ihe 
sequel we will consider this estimate as ihe 
benchmark 
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combmes advanugci> of the two prec^rding 
measures, since it is generally less biased than 
R*' and does not require addilional suites On 
the other hand, tis vanarux' can be very large, 
and ceriamly '.k^yends strongly on the chiirao 
icrisiics of the problem at hand In praciical 
situaiHHis. when the numlKi of samples is 
limned, u is an intcicsimg allernaovc to 
Notice als4v lhal the computational burden 
required toi H' can Ik vers heavy, since it 
needs (he building o" i additional Dls 

Ihc .ilH>ve consider aiions are illusliatcd m 
Section 4, on a real Wf>fld example 

2 ^ ( hi the ni^hi \t:c of trrr\ 

The slop vpIiHing melluKj miioduccs the 
slatisiical threshold paiameter n Varying its 
value allows to modify Ihe si/e of a lice llul 
how :o choose ihe nghi tree si/e ' 'Hie choice 
shoLilil Ih guidet) b\ the observaiion lhal 
large a Dl will yield a highet misclassilicalum 
rale and hule relcvanl leladonships, wli< leas hvo 
small a Iree will not make use of some of Ihe 
mfoimiihon available in the I S Indeed, Ihe 
terminal nodes ol a loo small Dl have noi been 
expanded enough and (Ins prevenis from gelling 
the puier subsets and ihe corresponding msiglil 
about the n>le thal the alinbutes would have 
plaved in this expansion, a loo large 1)1. on Ihe 
other liand. results liom the spliiimg ol 
stalisiically unrcpresenlalive subsets; therefore. 
i( IS hkelv In cause an increase in the 
niisclassitnaiion rale when classifying slates nol 
belonging lo Ihe I S Slated olherwise. a tr;ulcofl 
apfxars beiween ihe iw(» lollowing sources of 
misc:lassihc4Uion hius (overlooking signifiianl 
intormaiion in ihc I S) and ranarue (badly 
intcrprcling Ihe randomness m the DS); lo(» large 
a Ircc will .utter from variance whereas loo small 
a irec will present bias 

2 10 Huildon* muRalass 1) !\ 

Ihe al)4)vc description ol Ihe mducUve 
inference meth<xi made m the case of two classes 
. f, IS general enough to handle (at least in 
principle) an arbilrarv number, say m ot classes, 
provided that m remains negligible with respect 
to the si/c A of the IA 

Indeed, on one hand the information theoretic 
purity measures defined m (7) (II) may be 
generali/ed lo m classes, on the other hand the 
statistical hypothesis lesi remains applicable, 
provided lhal m 1 degrees of Ireedtrm arc used 
(instead of 1 m the iwrr class (or hiclass) case) 
for the ^f-square law. 

Under these condilions, ihc method will build 
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PTs cla'i.sifying directly the slates into one of the 
m specified classes. 

Another indirect possibility would be to build 
m ~ 1 biclass D'fs and to combine them in order 
to obtain the m-class classification. 

In the investigations of Section 4 we use the 
first, direct approach. The obtained DTs arc 
simpler and easier to interpret. Moreover, 
preliminary investigations indicate that they are 
at least as good, sometimes better, from the 
accuracy viewpoint, than the indirect multi- 
biclass trees. 

3 IM:( ISION I Kl l HASI D I RANSItN I 
si Aini ri Y Ai*rKf)A('n 

Two main conjectures underlie the application 
of the tree method to transient stability 
assessment. First, transient stability is strongly 
dependent upon the contingency type and 
location; hence the idea of building a tree per 
contingency. Second, transient stability is a quite 
localized phenomenon, and is driven by a few 
number of the system parameters; hence the 
idea of proposing candidate attributes selected 
among the parameters of the system in its steady 
slate condition. 

These generally well-accepted conjectures, 
have also been verilied in the few cases treated 
by the tree methodology (Wehenkel et ai, 
1989a, b). The case study of the next section 
attempts (o further validate them by means of 
exhaustive simulations. It also provides answers 
to questions raised by the overall decision tree 
transient stahility (DTfS) method, whose prin¬ 
ciple is recalled below. 

3.1. Principle (if the 1) I PS approach and related 
questions 

This may be formulated as follows: for each 
preassigned contingency, build up off-line a DT 
on the basis of a learning set and of candidate 
attributes, fhis tree is then used on-line to 
classify new, unseen states in as many classes as 
desired; for example, in a biclass tree, a given 
state would be classified as either stable or 
unstable, whereas in a three-class tree, the same 
slate would be declared stable, fairly stable, or 
unstable. 

Below, we identify questions relevant to this 
definition and suggest answers, often anticipating 
the results of Section 4. 

3 1,1. C^iiCAnom' about the LS. 

(i) How to obtain the learning states; 

(li) How to classify them; 

(iii) How many stales should be used for the 
efficient construction of a DT; 

(iv) Whether the “right ’ size of LS should be 


dependent upon the size of the power 
system. 

Tentative answers, 

(i) Either by considering plausible scenarios 
and running a load flow program to get the 
corresponding operating states, or by using 
past records of the system real life: 

(ii) According to their CCT values, computed 
via a time-domain or a direct method as 
appropriate; 

(iii) TTiis question is explored in the next 
section; 

(iv) The answer to this question is pK)slponed 
until Section 5. 

3.1.2. Questions about the list of candidate 
attributes. 

(i) What kind of candidate attributes to select 
for test (6); 

(ii) How many; 

(iii) What would happen if the actually most 
relevant attribute were for any reason 
masked, i.e. discarded from the list; 

(iv) What if additional relevant attributes are 
further considered. 

Tentative answers. 

(i) Parameters of the system in its steady state, 
pre-contingency, operation; 

(ii) When no prior knowledge of the system can 
guide the selection, it is advisable to 
consider as many as possible candidates of 
the type just suggested, confined in a 
relatively restricted area surrounding the 
contingency location; note that the increase 
in computing cost is insignificant (see 
below); 

(iii) It would generally lead to somewhat more 
complex, yet quite accurate DTs, provided 
that other relevant attributes are still 
present in the list; 

(iv) See results of Section 4.3.4. 

3.1.3. Questions relating to the number of 
classificati<?n patterns. 

(i) Which are the main differences between 
trees of small and large number of classes; 

(ii) For a given misclassification rate, which type 
of trees provides narrower misclassification 
error. 

Tentative answers 

(i) One can reasonably conjecture that the 
smaller the number of classes in a tree, the 
less complex and more accurate this tree; 

(ii) Provided that the inductive inference 
method is correctly develop>ed, it is normal 
to think that the larger the number of classes 
in a tree, the less severe the misclassification 
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errors; indeed, in a well designed ircc. 
misclassificalion errors will result m adjiiient 
classes; it is therefore less severe tii tlctiarc 
fairly stable a state which actually is stable 
(three-class tree), than to declare ii unstable 
instead of stable (two-class tree) (see 
Section 4. 3.51 

3 14 QueJitums relating to cominitutumal 
aspects 

( 1 ) Which is the most expiMisivc task of the 
DITS approach: 

(ii) How dixrs the number of candidate 
attributes affect the compuiin^f iimc of a 
DT; 

(ill) How' d(H^s the number jV of learninjj slates 
affect the computing time ot a 1)1 ; 

(iv) How' ^expensive" is the sloraj»e of D ls; 

(v) Mow “expensive ' is iheir use 

Terttatii'e unsvirrs 

(i) The generation of a I S is undouhtedly the 
most demanding task, and (he more refined 
the system modelling, the mote expensive 
the task; 

(ii) According to the splitting cnienon proce¬ 
dure described in Sectuni ? V the time 
required by a I) I fniilding vanes lineatlv 
with the number of c indid.iic atirilintes; 

(ill) In terms of the si/e of the learning set. the 
computing lime is upper bounded by .uid 
generally much lower than V log/V, i c 
the time required to sort the I S according 
to the values of the n candidate altributes, 
(iv) The storage of a l)I is genciallv cxtrcmelv 
inexpensive: indeed, it is proportional lo 
the number of its nodes, which is found to 
be quite small (see next section): to lix 
ideas, a compiled LISP versn-n ol a 
DL-classifier composed of Z'S nodes (which 
can be considered as an upper bound for 
the D'lTS method) takes ;iboui 
machine instructions, meaning that in ihe 
context of mcxlern computer architectures 
thousands of I^Is can be stored simuL 
taneously Into mam memory; 

(v) The mean classihcaiion time of a stale by 
means of a D7 is almost negligible (about 
O.bms for a I)T comprising 2> nodes) 

3.2. f^issiblc types of uses of the D ls 

V^arious uses can be inferred by following the 
pattern of the general DT methiKlology (e g see 
Section 2.2); many others are specific to the 
DTTS approach 

The un^ ^ ■ nsnicilialclv mines to mind is 
the classification of an operating .state of a pnon 
unknown degree of stability with respect to a 
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given a>ntjngenc>: amsidenng the appiopriate 
DI . and applying to this state the test (6), one 
succestMvtiy directs it through the vanous mxics 
of the tree, until rciaching a terminal mxk. the 
stale IS classihed aca>fvhngly One could ob|eci 
that the information thus obtained less refined 
than the CX^Ts used to classify the states of the 
LS. this however is not surprising, since the 
precise WY values of the Icariung states are not 
fully exploited during the tret building Weh- 
cnkcl et at and Wthenkcl (i9KH) 

proposed a means to approximaich cstimaie the 
CX"! of the stale one seeks lo clavsifv. by using 
the notion ot ' drsiance to a cLtss". whose 
dehmtion lakes into account the (XTs Lhis 
disiana\ inferred from the geoinetric inicrpreisi- 
non of a D'T outlined m Scctmn 2,2. is 
Sihcmalically illustrated in I ig 2 One can see 
that the operating stale (or point. OP) labelled 
OP„ IS stable, whereas the stale OP, iv unstable 
and ()P; IS very unsluble. Mtireovcr, it shows 
that to (relmforee stability, one should suitably 
direct the OP in the aitribuic space, i e suitably 
nuHiifv the values of its relevant aiinbuies 

I he above short dcss ripnon suggest.^ that the 
DTIS appioach can provide three types of 
transient stability assessnieni analysis, directly 
linked lo the da.ssihcaiion ol an OP. scMisihvitv 
analysis, linked to the “distance of an OP to a 
class and control, linked lo the way one can 
act lo modify such a distance Moreover, since 
the involved compulations are likely to lx* 
exlremely fast, several reaLtimc strategies may 
be conceived Lor example, one inav priHced in 
a wav similar to the siandan! conimgency 
evaluation of steady stale secuniy assessment, 
nir ; draw up a contingency list, and build 
off-line Ihe corrcspiinding Dls. then, in 
reabiime, scan the fist, hxus on those 
contingencies which are likely lo create prob* 
leins. and if necessary profxise mrrechve 
aclKuis Ol course, care should l>r lakcn S4i as lo 
avoid incompatible actions liul for the lime 
being this question is beyond our sio|>c 

Lmally, oftserve that the Dls provide also a 
clear, straightforward insight into the complex 
methamsm of transient stability Ihis is ni>l the 
leasi interesting conlnbution of the 1)17 S 
approach 

4 (A SI viiinY 
4.1 (jeneral description 
ITic investigations aanduclcd m this section 
aim lo answer the questions previously raised, to 
assess the salient features of the 1 )772S approach 
and lo test the c<injcclures underiying it. 

Idle p<iwer system wc have chosen is small 
enough to avoid unnecessarily bulky compuia- 
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tions, but large enough to draw realistic 
conclusions. It i.s composed of 31 machines, 128 
buses and 253 lines; its total generation power in 
the base ease amounts to 39,(MX)MW. I'his 
system is described in l^e, (1972), and sketched 
in Fig. 4. (The rationale of its decomposition is 
discus.sed in Section 4.2.1.) 

In this first set of large-scale simulations we 
adopted the standard simplified system modell¬ 
ing, i.e. constant electromotive force behind 
transient reactance for each machine and 
constant impedance for each load. 

l o assess the D PI S methi>d as objectively as 
possible, we have generated 20(K) operating 
points (OPs). Two sets of simulations were 
considered, corresponding to very severe contin¬ 
gencies, ctinsisling of three-phase short-circuits 
(3(^SCs) applied at generator buses (one at a 
time). The first set concerns thorough investiga¬ 
tions carried out with three such stability 
scenarios, of ^<pSi's applied at buses #2. 21, and 
49, arbitrarily chosen. This implied the 
compulation of btKMKX T values. Part of the 
OPs along with their classification have been 
used in the I.-S, the other part composing the T'S. 
A large numlxir of D I s have been built for the 
above three eontmgencies, for various sizes of 
LSs, varying values of the threshold a, and three 
different elussihcalion patterns, namely two-, 
three-, and four-class classifications. In the 
two-class case, one distinguishes stable and 
unstable OPs, depending upon whether their 
C'CT is above or below a certain threshold (XT 
value; in the three-class case one distinguishes 
stable, fairly stable and unstable OPs (two 
threshold (XT values are used); in the four-class 
case one distinguishes very stable, stable, 
unstable and very unstable OPs (three threshold 
values). The threshold (XT values are a priori 
chosen rather arbitrarily, but so as to avoid a loo 
important imbalance between the populations of 
OPs belonging to the various classes. 

The second set of simulations is described in 
Section 4.4. 

4.2. C onstitution of a data base 

The data base was randomly generated on the 
basis of plausible scenarios, corresponding to 
various topologies, load levels, load distributions 
and generation dispatches. Mcrcaftcr we de¬ 
scribe the way used to generate them, to analyse 
them from the transient stability point of view, 
and to build the attril'Utc files. 

4.2.1. Random f^eneration of ()f\s. To gen¬ 
erate these various slates, we grouped the nodes 

* In ihf sc^ikT, comingcncy will often be spccitied hv 
merely ihe luimhci of the gcneiaU>r bus ai which it is 
supposed lo apply; c omtinpeney (or fault) #2. #21, #49 


of the power system into five internal zones, and 
one external zone composed of the boundary 
nodes of the system and its external equivalents 
(Fig. 4). The internal zones were defined 
empirically, on the basis of the ‘electrical 
distances ’ (number and length of lines) connect¬ 
ing their nodes. The OPs composing the data 
base were generated randomly according lo the 
following independent steps. 

1. Topology; it is selected by considering base 
cases (with probability 0.5) and single outage of 
a generator, a load or a shunt reactor (each with 
probability 0.08), a single line (with probability 
0.16), two lines (with probability 0.1). The 
nulaged element is selected randomly among all 
the tTemenls of the power system. 

2. Active load level; the total load level is 
defined according to a (iaussian distribution 
(with p - 32.(KK) MW and o ^ ^XKK) MW). 

^ Distribution of the active load: the total load 
is (irsl distributed among the six zones according 
to the random selection of participation factors 
(sec below), then among the load buses of each 
zone homotheiically with respect to their base 
case values, The reactive load of each bus is 
adjusted according lo the local base ease power 
factor. This results in a very strong correlation of 
the loads of a same zone, and a quite weak one 
among loads of different zones. 

4. Distribution of the active generation: in a 
similar fashion, the total generation is first 
distributed among the zones according to 
randomly selected participation factors, then 
among the generators of each /one according to 
a second selection of participation factors. T tins, 
neighbour generators are less correlated than 
neighbour loads The reactive generations are 
obtained by a load flow' ealeulalitm To avoid 
overloads, the final active generation of each 
generator is constrained lo 90^r of its nominal 
power. 

Note In order to avoid overloading or under¬ 
loading the slack generator, the total generation 
is defined as the total active load plus a 
polynomial approximation of the active network 
losses of form: 

Network Losses (MW) 

- 1336 - 25.5/'/^^ 19T[ ~().7T; 

T().()I2T^-().(KKK)7P- 

where f] denotes the total active load of the (TP, 
in (fW. and where the coefficients were 
determined by a least squares estimation on the 
basis of 11 OPs of different load levels for which 
the network losses were computed by a load flow 
program. 
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S. Load flow calculaiion: lo check the feawbility 
of an operating point and compute its state 
vector, it is fed into the load flow program, and 
accepted if the latter converges properly. (About 
9(1% of the stales were accepted.) (Remember 
that the power system has 12K buses and hence 
each slate vector has 2 x 128 - 1 = 255 
Cl nn pone fits.) 

Par(i( ipatuni factors. I’o distribute a given 
amount of active (generation or load) power (say 
f\„i) on a number, say E, of ‘elements ' (zones, 
loads or generators) we use the following 
procedure, 

Let /'f*. {i - \ , , E) be the “nommar' 
power of the elements (for zonal loads we use 
the base case total load of the zone, for 
generators their nominal power and for zonal 
generations the sum of the nominal generations 
of their generators), and A,, (/ = L . . , /i). 
positive coeflicients selected randomly, accord¬ 
ing lo the procedure described below. The 
individual participation of each element is 
defined by: 

[ 16 ) 

V A 

/I 

Ihus, the A, coefficients act as a distortion with 
respect lo the homothctic nominal power 
distribution, riiey are selected randomly in the 
following way; 

One third of the cases are defined by 
A, - 1. (/ - 1, . . . i e. no distortion with 
respect to the nominal distribution; 

f'he rest of the cases arc defined by A, - 2. for a 
randomly selected value of j, and A, = I, 
(/ ■ 1. . . . / 1. y f 1, . . . , E), i.e. a higher 
participation of the /th element. 

4.2.2. Transient stability (prc)analvsis and 
attribute calculation, lo use the data base for 
investigating the DITS approach, we carried out 
the following preliminary calculations: 

1 Approximate calculation of the CCl of the 
2(MK)()Ps, for a 50SC at each one of the 31 
generator buses, using the extended equal area 
criterion (LLAC) (Xue et ai, 1988). This gave 
us good information about the relative severity 
of these contingencies in relation to the OPs 
represented in the data base, and allowed us to 
select three “interesting" ones for our 
investigations. 

2 Precise calculation of the CCTs of the OPs, 
for the three selected faults, using the step by 
step (SBS) method. To accelerate the iterative 
cut and try process delimiting the precise value 
of the eXT, the approximate values supplied by 


the fiEAC were used as an initial gue&s. 
Incidentally, these latter were found to be in a 
very good agreement with those computed by 
the SBS method (over the 6(XX)C(JI^ values wc 
found a negative bias of ~0.(X)7s and a standard 
deviation of 0,032s of the CCTs provided by the 
EEAC as compared to those computed by the 
SBS method). 

3. Generation of the files containing the 
attribute values for the 2(KM)OPs. About 270 
different “primary" attributes have been com¬ 
puted. comprising zonal statistics on loads, 
generation and voltage, voltage magnitudes at all 
buses, voltage angles at important buses, active 
and reactive power of each generator, and 
topology information for each OP. Other 
attributes, such as line power flows, could be 
defined as simple algebraic combinations of the 
primary attributes and did not necessitate to be 
stored explicitly. Ihc attribute files were 
constructed on the basis of the load flow data 
and state vectors 

Overall, the data base contains about 3(X) 
values per operating point, in addition lo the 
input files required for the load flow and 
transient stability analysis programs 

4.3. Simulation results 

Over 4(K) different I) Is were built for various 
scenarios: three different contingencies, about 15 
different classifications, distributed almost 
equally among the two-, three-, and four-class 
patterns, learning set sizes ranging from 1(K) to 
l5(K)OPs, more than KKI different candidate 
attributes, a values ranging from 1.0 to 0.1XKK)5. 
The DTs were evaluated on the basis of 
independent test sets. 

The resulting observations are organized and 
presented in six parts (Sections 4.3.1-4.3.6), 
although they are interdependent in many 
respects. The first part analyses general DT 
features, such as complexity and accuracy, with 
respect to various classification patterns, while 
fixing the other parameters (size of the LS, value 
of a, list of candidate attributes); this provides a 
good insight into the overall D FIS method. The 
second part focuses on the influence of a on the 
resulting DTs, and suggests how to select good a 
values in practical situations. The third part 
explores the way the size of the LS affects the 
DTs, while the fourth part discusses the 
influence of the candidate attributes on the DTs. 
The fifth part examines the influence of the 
number of classes on the misclassification rate 
and severity. Finally, the sixth part compares the 
different accuracy estimates defined in Section 
2 . 8 . 
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4 ?.l General tree charoi ierLshcs Dl s cor¬ 
responding lo three different classifkations 
patterns (of two, three and four classes) arc built 
tor each of the three different coniirigcncics 
under the following conditions: the data basc^ 
(20(X)OPs) IS divided in a LS composed of 
V ,^0() OPs and a test set composed of the 
IMM) remaining OPs (this fairly large si/e 
provides a high precision to the R'' estimate), 
[he value of a is fixed to OJKMll (the justification 
of this choice will be found below ), and the list 
ol candidate attributes, the same for each DT. is 
composed of HI static variables. 

Ihc results are summarized in Table 2 I hc 
first column specifics the faulted bus number of 
the contingency. The nine following columns 
sfH'Cily for the indicated contingencv and 
number of classes, the characteristics o{ the 
resulting I)T:iV,, the total number of its ncxles 
(which measures its complexity); R'\ its test 
sample islimate, representing the percentage of 
misclassified lest slates; A, the number of 
different retained attributes among the 81 
candidates This is repeated for the three 
contingencies, providing the features of rime 
DTs listed in the table. 

The same set of investigations was repeated 
three more times, with three other learning sets 
of the same size (each of .‘iOO stales), in order to 
delect the variability of the DTs with the LS. 
The obtained results arc very similar to the 
above, and induce the following conclusions 

T he complexity increases from the very simple 
two-class trees to the nro Jeralely complicated 
three- and four-class ones; 

—Their accuracy is quite satisfactory especially 
in the two- and thrcc-class cases; the four-class 
trees are less accurate but, as we discuss 
below, their eirors arc less harmful, 

—The error rate varies only moderately with the 
fault location; 

—The total numtver of retained attributes 
remains overall very small. 

TTiis latter aspect justifies the conjecture that 
transient stability is a localized phenomenon and 
highlights the ability of the method to select the 
relevant attributes, (A worth mentioning fact 
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which diKTs not apixar in the table, is that the 
selected attributes are esscnliallv viirtablcs 
related to buses very close lo the faulted one ) 

4 3.2 impart i>f the parameter a Lor a given 
LS. attributes list and classification pattern, the 
principle of the Mi>p splitting cniciion suggests 
that the lower the value of n the snuillei the 
resuilmg 1)1 Although this reduction m 
complexilv IS ceriiiinly mteresiing fiom many 
vicw|HHnts. It could also cause tlu‘ DTs tii be less 
accurate, as indicated by our eaiher dissussions 
Hence, the necessity i)t sciimm/ing the effect of 
Cl on the complexity and accuraev of the DTs 
These observations were cxtensivcTy invcslig 
tiled using different laulis. numbeis of diisses. 
and learning sets Thev yielded the lollowing 
com lusions 

• Lhe most nTi[>orlanl reduction of a Dr’s 
complexity is obiaincci as soon as a enters ific 
range 0(KI1 lo (ItHMIl, quantitatively, this 
effect IS more marked m the three and four 
class cases. 

• Although lower values oi a still reduce 
(sornclmics significantly ) Ihc si/e ol the DTs, 
the effect is generally less s|>cclacular. 

• The DTs coriesfxmdnig to ci 0 (XHKjS can be 
tw'i) to ten times smaller than those cor¬ 
responding to (i IT); besides 

• When a decreases from (ITX)S lo (ITKKM)5. the 
accuracy of the DIs vanes very slowly, and 
gcnerallv insignificantly (cf the stalislical 
uncertainly of /if” ) 
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F igures 5 and 6 illustrate graphically the above 
observations in the two-, three-, and four-class 
situations. In each class, the curves represent the 
mean relative variations of the size, (iVj, and of 
the misc'lassification rate (W' ), of 132 DTs (each 
point of the curves represents the mean value of 
12 different DIs built for the corresponding 
value of a ). 

ITie following example provides an insight into 
the way the value of a operates in the particular 
case where the attributes contain less informa¬ 
tion (i.e. the ‘less separable” case). This 
corresponds to a I.S of StK) states, a biclass 
pattern, and seven values of a ranging from 1.0 
(the nodes are split until they arc all leaves) to 
O.fHKMKS (extremely “cautious” behavior) Seven 
D'Is were accordingly built, for the contingency 
#2, where the most important attribute (P(il22, 
the active power generated at the bus #112) was 
removed from the list of candidate altributcs. 
l able 3 summarizes the results C olumns 2-.5 list 
the number of respectively test nodes, leaves, 
deadends, total. (Note that since the DIs are 
binary, they always have as many nodes as the 
double of test nodes plus one: 
rhe following three columns of Table 3 provide 
the misclassificalion rale as appraised by 
respectively the resubslitulion, the lest sample, 
and the cross-validation estimate; incidentally, 
observe the optimistic character of and to a 
much lesser extent, of H'\ 

One can sec that decreasing the value of a in 
the interval [ 1.0 . . . 0.011 not only drastically 
reduces the complexity of the DTs but it 
moreover significantly improves their accuracy. 
On the other hand, in the interval 
[0.01 . , . 0.0(KKIS| the size of the D'I’s decreases 
moderately, whereas their accuracy remains 
unchanged. Figure 7 is an eloquent illustration of 
the decrease in complexity: for a - I, /V', 
amounts to 63, whereas for o^O.lMKIl N, 
reduces to 5. Notice that the two DIs have the 
same structure nearby their respective roots. 

The general conclusions are the following; 

1. The statistical hypothesis lest is able to detect 
and identify the deadends in a very efficient and 
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reliable manner, provided that the value of a is 
lower than 0.(X)1; 

2. Using a values below 0.(K)l provides the 
twofold benefit of reduced complexity and 
improved reliability; this effect is even more 
important in the less separable cases, where the 
“variance” effect can be very important; 

3. The preci.se value of a, realizing the best 

compromise between what are called “variance” 
and “bias” in Section 2, lies somewhere in 
between (J.OOl and the lower the 

number of classes, the lower the “optimal” 
value; moreover, the higher the contribution of 
the variance effect (e g. the lesser the informa¬ 
tion contained in the candidate attributes), the 
lower the optimal value of a: 

4. Anyhow, the bias effect remains very low (it 
would probably appear markedly for values of a 
much lower than O.fKMKLS); thus the precise value 
of a is practically of no concern, as long as it lies 
in the range [O.OOl . . . 0.()(KHI5|; 

5. Hence, considering that for a required 
accuracy, the smaller the trees the better, it is 
advisable to use a”().(MK)I in all cases; 
sometimes it is even preferable to sacrilice a 
little accuracy for simplicity of the tree structure. 

Remark. Although the above conclusions arc 
drawn in the specific context of transient 
stability, preliminary investigations indicate that 
they correspond to the very nature of the 
statistical hypothesis test, and should remain 
valid in general. (Wehenkel, 

4,3.3. On (he size of (he l.S. One may 
distinguish the following three questions; 

How does the size of the l.S influence a D I s 
complexity and accuracy .^ 

What is the minimal number of learning slates 
required to achieve an acceptable accuracy? 

iiow “stable” is the DT when the LS changes ' 
or staled otherwise, how' sensitive is the 
structure of the DT to the changes of the LS? 

Ouaiitalively, according to the principle of the 
inductive inference method, one can say that, for 
a given value of a, increasing the size of the LS 
will generally (although not necessarily) increase 
the complexity and the accuracy. 

Quantitatively, the answer to the hrst two 
questions strongly depends on the particular 
application of concern and especially on the 
intricacy of the underlying relationship between 
the attributes and the classification pattern. The 
more intricate this relation, the larger the 
sufficiently accurate DTs and the larger the LS 
required to build them in a reliable fashion. 

As regards stability, we generally found that 
the nodes near the root of the DT (which 
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express the most relevant relaiinnships) clti not 
change much when A increases, whereas the 
lower nodes (expressing the details) can change 
more significantly. 

To illustrate and support these considerations, 
we conducted the following investigations tor 
the contingency #21. a “ If and in the 

four-class pattern, six DTs were built with V. the 
size of the learning set, varying trom Idf) to 12.M! 
states. Each DT was tested on the basis of the 
remaining M = im) - N test states The results 


arc represented graphically in f igs K and One 
can see that for increasing values of N the error 
rale decreases from \2 f to . whereas the 
num^H'r of the trees nodes increases from 9 to 
43 At the same time, the number of retained 
attributes is found to increase from 2 to 11. 
Figure lb provides two f ) l s. built for N 25t) 
and 750, and having respectivdv A, - 9 and 25, 
and A~2 and 7 Observe the stability of the 
DTs 

These and many other similar results indicate 
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Fu. 9 Inllucnic ol Ihc LS size, S. on Ihc number ol nodes 

lhat a size of learning stales seems to be a 
good compromise, allowing the building of 
sufheiently reliable and moderately complex 
I) Is. 

4.3.4. C andidate attributes. What would hap¬ 
pen if the most relevant attribute (i.e. the one 
selected lor the lest at the tree root) were 
removed from the list of candidate attributes? 
and what if additional candidate attributes were 
provided to thrf procedure? 

Removing from the candidate list the most 
significant attribute, causes a decrease in the 
accuracy of the D'l; however, if “good ' 
alternative attributes remain in the list, this 
degradation is rather restricted. A ground of 
comparison has been given by I ables 2 and 3. In 
Fable 2 a I) I composed of 7 nodes was obtained 


for the two-class case corresponding to contin¬ 
gency #2, when a sufficiently complete list of 
candidate attributes is used (including in 
particular the most relevant attribute for this 
case, namely PG|, 2 , the active power generated 
at bus #112). Table 3 indicates the effect of 
removing PG,,^ from the list of candidate 
attributes: the tree corresponding to a^ = 0.00()l 
reduces to 5 nodes and its probability of 
misclassification increases from 2.27% to 
8.80%. This is further illustrated in Fig. 11, 
where the two biclass trees are presented: 
obviously, removing the best attribute, has 
caused a degradation of the tree’s accuracy 
which, nevertheless, remains quite good (8.80% 
vs 2.27%). 

Conversely, providing additional relevant 
attributes will generally improve the DT 
accuracy; however, if the most significant ones 
are already included in the list, only the lower 
parts of the DT will be affected, and the increa.se 
in accuracy will be almost negligible. 

As a conclusion, if the important attributes are 
not known a priori, it is advisable to use an as 
large as possible list of candidate attributes. I’he 
first constructed DT identifies it.self the relevant 
attributes, which can be used for subsequent tree 
constructions, possibly in addition to new ones. 

4.3..^. Misciassification errors as related to the 
number of classes. In Section 4.3,1 we observed 
that the larger the number of a tree classes, and 
the larger its complexity and misclassification 
error rale. This is not surprising though: for a 
given LS, the more detailed the information one 
wants to extract, the larger its inaccuracy; as a 
counterpart, one may reasonably expect this 
inaccuracy to be less harmful. 
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Fu, n ERccl of removing ihc [\c\\ iiMnhuu* fH» 
(contingency ft2, ti (HXMK»5. \ SoHi 

All our investigations corrohtnate this reason 
ing. A typical case is considered in 1 uhles 4 and 
:S, which collect data for respectively a two and 
a threc-class tree, built for the contingcncv 
rt^0(KKK)5. /V = 5(K) and M ~ The true 

classiheation of these 1S(K) test slates is reported 
in the columns of the tables, where the labels 
\l^ U, S, VS stand for lesjxcOvcK very 
unstable, unstable, stable, very stable Ihcir 
classification as provided by the (biclass and 
four-class) trees, is reported in the rows o( the 
tables, an additional row' provides the misclas 
silication rates rhese latter arc overall quite 

lAlllI 4 rVIMTAl MIS(. I ASSII It A MON IHKtlKS ru a |V.<> 

11 ASS IHi.i n - 0 IMKKIS, ,V - S{|(|, \t I Slid 

I RK* clilSSltK illlRn 

All 

1 .-' 723 :s T4H 

, ,, S “ill lrf>t 7S: 

cirissilicalion 

All 77d 721 I sun 

Errors (^'f) 3 73 1 d7 s 4 


reasonable, as is alvv» suggested by the sliongly 
iliagonal dominant characicr of the ‘ keener' of 
the tables 

Observe alv) that the total etror of the bicUiss 
tree is lower than ol the fouf'clavs tree: but the 
latict error is less mislcailing than the former, 
(or example, declaring unstable a stale which is 
atiuallv siaf'k is less misleading in (he four class 
than 1:1 the biclass tice, lH*causc of the finer 
definition of the four classes Stated olherwist*, 
m the (our-class tree, a large majontv of errors 
appear among neighiniring classes (e g %ee Eig 
\1\ the error diMnbuiion concentrates mainly 
around the true class and the numbei ol 
outliers almost (H not totally) reduces to zero. 
Observe alsti that a finer expUnalion and 
identification ol the misilassified Males indicates 
fha( in the biclass lice these latter mainly 
concentrate in llu' vicinity ol the stable unstable 
borderline as well: hence their misclassificalion is 
not totallv misleaiJing, alter all 

4 Vfi On ihr an urui \ 0 / r/ie and R'' 
estimates lo quaniily the considerations of 
Section 2 K. we have compared the accuracy id 
the and W ' estimates with res[K‘Ct to 
considered as the benchmark, because of its high 
reliahilitv 
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With respect to we observe the following: 

• In all cases, it is strongly optimistically biased; 

• The bias varies from almost 1(X)% underes¬ 
timation for the high values of a to 
apptoximalivcly 4fJ% underestimation for 

■ For a fixed value of a, the bias decreases 
slowly when Ihe number N of learning states 
increases; 

• The bias could become acceptable only for 
values of a much lower than 0.(Ki(X)5; 

• 1'hus, (or ‘good” values of a resulting from 
our earlier discussion, this measure is of no 
practical value for the estimation and com¬ 
parison of accuracies. 

Regarding the accuracy of R'\ we observe the 
following: 

• For a given [)T, its precise value is almost 
independent of the value of the parameter V, 
as long as this value is larger than 10. 

• sometimes overestimates, sometimes un¬ 
derestimates the I)Ts actual accuracy, de¬ 
pending on the particular DT of concern; 

• Defining ihe error of hy tr = - H" we 

found that the mean value of F/"" over 14 
different DFs and for different values of V, is 
-0.17%, whereas the standard deviation of 
F"'' is 2.15% (for the purpose of comparison 
we mention that the variance of is about 
0.7%» for A/“I5(K), and about 2% for 
Af ^ 150); 

• This corroborates our earlier statement that 
(he variance of is rather high; 

■ As a conclusion, this estimate is particularly 
interesting when the total number of observa¬ 
tions (jV 4 M) is too small in practice to be 
split into an LS and a sufficiently large 
(M .S(K)) test set. 

4.4. A global set of simulatiofu 
Another set of simulations concerning a less 
refined but more global investigation than that of 
the previous Section 4 .. 3 has been carried out 
using the same data base of 2(KK)()Ps: 31 
contingencies of the 30S( type, successively 
applied at each generator bus of the 3l-machinc 
system which have been pre-analysed via the 
extended eiiual area criterion. 1 able 6 collects 
information for the two-, three-, and four-class 
patterns (N^ and A stand for the total number of 
nodes and of selected attributes). Its last line 
summarises the mean characteristics of the DTs 
in terms of the number of stability classes. 

Note that their complexity and accuracy 
depend almost linearly on the number of classes. 
Observe also that in terms of accuracy, this 
global assessment is certainly pessimistic, un¬ 
favorable to the method. This is due to the fact 
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that the candidate attributes used to conslruci 
the trees have been chosen so as to cover the 
whole power system; no particular care has been 
taken to consider a more refined list of attributes 
around the contingencies locations. (Remember 
that for the 31 contingencies, only 83 attributes 
are u.sed, often not close enough to some of 
them.) Another, although less important source 
of inaccuracy is the fact that the C CTs used for 
classifying the OPs of both the l.S and the IS 
have been computed via the FiHAC' and not the 
numerical integration method; this, unavoidably 
introduces a small bias in most cases. More 
detailed information may be found in Wehenkel 
(199(1). 

5. DISCUSSION 

The questions posed and the answers given in 
the preceding sections are reorganized so as to 
draw general conclusions. Some pertain spccifi 
cally to the DTTS method, some others apply 
the DT methodology in general. 

The statistical test used to stop .splitting the 
nodes of a grown tree appears to work vctn 
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satisfactarily Iis threshold a provides an 
effective icx>l for controlling the complexity and 
ihe accuracy of the resulting tree It is 
particularly interesting that simplicity and 
accuracy of a DF are not contradictory 
ohjectives, at least in a rather large range of the 
a values Indeed, in this range, decreasing a 
Joi-s not significantly affect the accuracy. 
Kvhereas it contributes to drastically decrease (he 
number of nodes of the tree Incidentallv, this 
t’xplams a posteriori the gtK»d pcrlormanccs 
(ihiained in our earlier mvesiigalions where a 
was fixed rather arbitrarily to 0 (11 Overall, the 
simplicity and accuracy of ihe trees provided by 
(he methvKl are quite remarkable. Ihis seems lo 
be a general feature oi the inductive inference 
method we developed to build DTs 
The particular D n S approach proves also to 
t>e very effeciivc m many respects, and the 
underlying conjectures fully justified For ex¬ 
ample. among Ihe large number of aitnhutes 
proposed to the method, onlv a few are retained 
as the relevant parameters driving the iransieni 
stability phenomena Moreover, increasing the 
number of classification patterns of a tree 
provides additional relevant attributes: this 
allows to gel a more refined insight into the 
mechanism of the phenomena, and to offer 
additional means lo control transient siahilitv 
Ihe interplay bclw/ecn biclass trees with 
extremely simple structures and reduced number 
o) relevant attributes, and mulliclass trees - with 
rnerre complex (yet tractable) structures and 
larger (yet restricted) number ol attributes, is 
another attractive feature of the method, which 
thus shows to be very (Icxible and stable. Ihis 
stability of a tree with respect lo the attributes is 
a very interesting aspect, indeed it arnouios to 
svstemalically using the same, more relevant 
attributes nearbv its root, whatever the number 
ot its classes and its complexity 

Fhe tradeoff between hi- and multiclass Dls 
appears thus to be a great asset of the DTFS 
method, not a drawback Various solutions, 
supplementing different, ctmiplemenlary infor¬ 
mation extracted from a LS, may thus fu: ex¬ 
ploited for various purposes, even at the price of 
a somewhat lesser accuracy in the multiclass case. 

Investigations relating to the construction of 
an "adequate" LS have pointed out another 
interesting aspect, namely that reasonable sizes 
of LSs are sufficient to build reliable Dls, On 
the other hand, the slates comj^Krsing the LSs 
were chosen on a statistical basis, the purpose 
sought here being the objective assessment of 
the D ITS method. Note that in a real world 
context, this choice should lake into account 
requirements imposed by the power system of 
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corKTrn, specified in collafx>raiton wnh the 
enginfeers and operators m chairge of the system. 
Reamsidenng the "right size ' of a LS, one may 
wonder Hi which extent this should depend on 
the size of the power system lo answer this 
question, one probaoly sfu^uld speedy whether 
the purpose is lo build trees for amtingiMUies 
spread throughout the whole system, or whether 
one seeks to expUne Mime pariicuhn cunHn- 
gcncies In the former cast*, a I S covtniig the 
whole |H^wer >yMcm with .sufficiently deluded 
informal urn. would indeed be* needed, its si/e 
would iheiclorc increase with that ol the pi>wei 
system In the laiict tusc\ the LS should 
esseniiallv coniam deluded iniormation onlv (or 
(he regions of concern for ihesi' contingencies 

One could object that ihe uUive conclusions 
rely on the pariiculiir, very severe lyjx' i>f 
conimgencics considered solar, and also on 
[sarticularly simplified system nuHlelling How 
ever, our objective was Ihe validuiion ol the 
method as such, we believe ihai this objective 
has been encounleicil 

C criamiv. lo be mieresimg a method has to be 
ctunpuiationallv iraclahle I he Cimsideraiions of 
.Section 314 nulicale ihai the mam, and m fuel 
sole, rcallv burdensome task is the construction 
of (he liaia base Hut this has [o be done only 
once, then (Kcasiomilly uj>da!cd Tht construe 
lion of Ihe Dls, although aKo oft line, is a less 
demanding task; and the belter the knowledge of 
the |>ower svstiMn. ihe faster the consliuclion ol 
ns trees Once eonslructed. Ihe sloiagc and use 
of the Dl s aie cxtrcmelv incK|H*nsive. thousands 
of D l s could be simullaricously sloied into mam 
memorv, as lor llie mean classification tunc, it 
was assessed lo be idxnii (Omtis, l e almost 
negligible 

nie wav ol using the Dls was not considered 
in this pajxr onlv ilasses of |>o\sihle uses were 
enumerated, and |)iospccis for (heir real-time 
applications lo transient stabdily analysis, 
sensitivity analvsis and preventive control were 
suggested Neverihclcss. other interesting aj>- 
plKations of the D LI S approach may be 
foreseen as well, in the context of tiainmg 
simulators, and id planning studies 

U (ONtllSinN 

I wo main objectives have been pursued in this 
paper First, to get in-dcpfh knowledge of the 
inductive inference method designed in our 
previous studies, and more spccdically of its Mop 
splitting crilenon Second, to scrutinize the basic 
features ot the decision tree Iransieni stability 
(D'n^i) method, i c of the inductive inference 
method as applied lo transient stability of fwiwcr 
systems 
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To encounter these objectives, a large-scale 
investigation was conducted, using a realistic 
power system. The obtained results are quite 
interesting. As regards the inductive inference 
method it was proven to be very efticient, 
indeed, appropriate to yield simple and accurate 
DT's; and although it would be hazardous to 
compare methods used in different application 
domains, one nevertheless may say that it 
appears to be among the very effective methods 
reported in the technical literature. 

Concerning its application to transient stabi¬ 
lity, the devised D'lTS method has exhibited 
very attractive features, with manifold potential. 
Kor example, it was found to be capable of 
treating the three aspects of transient stability 
assessment, viz. analysis, sensitivity, and control. 
It could therefore be exploited in planning 
studies. At least as interesting are its real-time 
aspects, and its capabilities in on-line transient 
stability assessment and preventive control. 

Admittedly, many other questions still remain 
unexplored this study was the hrst, indispen¬ 
sable step towards real world application of the 
DIT’S method. 
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. 4 b«lf»cl -A one-step opiinr.al nicihiKl for comiH-nvitimg loi 
any form of input saturalion m discreic lincai .onlrollcr^ iv 
Jcvfloped. T'hc algorilhm is straightforwiinl to implcnunt as 
an analytical correction operating on the LliJlcrciice txivircn 
the past taltulaleil control inputs and the inputs atuiallv 
implemented A further correction lor muliisiiriahlt 
controllers is nevessaTV to simullaneouslv adjusi iht 
rt nvaimng control inputs il .v>me inputs sal urate The 
algorithm IS illustrated by simulation on sevtoai SISl) and 
MIMO examples, 


1 /ntn^ductum 

Om oi mi most comrram problems cncounlcrcd in conhol 
111 process systems is Ihiit the coniroi iuiions cakulaied I'N ii 
omiroller cannot be implemented m lull, thai is ihe nmtrol 
input siiturHlcs Linear ciuiirollcrs onl> meei thrir design 
sjKCihcations when the system is m its lineari/ed oiKraimg 
region il a calculated control inpul lo the system violates a 
saturalinn limil then the subsequeni control will noi in 
general be satislactory 

(uRKivsin (l*n2) presented a one step opiiinal saUiralion 
aunpcnsalioii algorithm lor single uipui single tiuiput mini 
mum variance controllers Ficn/anson ( L/tH4) extended ihis to 
more general SI SO one-slep oplim.d I i)i i coni rollers A 
dificrcnl method of irnplemeniing one siep optimal lonirol 
Icrs for SISO systems was presented bv ( larkc (l‘t»Kl) 
Makila (I9H2) atiempied to implement the result o( Oooctwun 
(1M72) and lo extend il to a multivariable one step conirnlkr 
loivonen (l‘^H3a,h,c) presented an approximainni to the 
rnultistep 1 OCi problem with saluratinn of the lorm 
A H. and Parrish and Hrosilow (19H*') prcsenit I Mime 

empirical rules for saturation cirmpensalion (or what they 
refer to as inferential eontrollers 

T his pa|x*r presents a new one-step opiirniil torretiion lor 
any form of input saturation in multivariable controllers A 
further simultaneous correction is developiMl which causes 
the remaining control inputs to compe:nsale for saiuraiion in 
other inputs 
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revised 23 May 19H9; received in final form *1 Mav T3tc 
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July. ]i)H7 The published FTcKCcdings of this lf-A< Miciing 
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Hail. Oxford 0X3 OBWL U K llns paper was recommended 
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t Xerox Research Centre of Canada. 26fifi .Speakman 
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2 I hr at^onlhrn 

Ihis secutin pfcscnis the defhat»*»n of a i»'filiolki which 
mimrni/es ihc one str|' ofifcctivt function 

I ■ 

i ii/ r''nr'u, ■ \ V, , u, . c to 

sub)t'ci id *iri\ vi. I ol lime varying conMiaints imi Ihe control 
vcciiir I , Q .Old M arc n • n weighting maiiu'cs «nd O is 
|i>»Mtise drlimtc Ihc lonind nlgoitthm can rtouly twr 
gTiu iiduM d i» miiudf mure genri til t^dynofiiiHl maiiux'S 
o^H'ruiMig on V,., . , and I' in ihr ob|eclive IuivvIumi ill 

this ininiini/aitori is Mibieii i«> the iiimlition that past 
lnpl»<^ \T' max, (ui .iin fiasun wfmiMK'xei base not ficen 
iinplcmentcil ax calltul liM No asviiniptiori is ii*v .U* in this 
drfo.ilion alnnit ih(‘ form of tfic vaiuraliori lirtnls on the past 
I', Ihi ilcfivaiion follows the siiigU v»in.dxle denvaiions of 
( larkc and l lastiiigs lamex f l‘>71» and ( larke and < iawthn>|i 
anil the niulltv anablr drnvation of Kon n (lOHD) lot 
the lavc of no fiard lonsitaints 

Ihe KV\lcin IS assumci) to 1 h; a Inirai inultivaiuitxlc svsirin 
which IX moildli d in the ARMAX form, 

Ale/ ' IV, li(i/ ’ i 1 r(</ ' f€, <2) 

where V , is an n dimensional vex tor nl princss output 
deviations from Ihe m’Ii’miiiii vi^cior V,^. , oi (roin siraviv hfalr, 
r, IS an n diriHMsional vtuiiii of tiOKCss input deviations 
Irorii sicativ slate k is the rnimix'i ol whole (scmihN oI 
poHess delay and c, is an dimensional vcilor of zero mean 
white noise pimtsMs A. B and i arc n « n (xilynomial 
rn.iirKC's in ihe fi.ukward shift ojH'r.ilor </ ' H,, is assumed 

noiningular and A. C I Iht' roots of the deteimmants 
of the A{</ j. and ( fiy ') f>«ilvnomiid niatiices all have ihnt 
roiits on nr uvadi ibe unit urclr in </ f3n’ Afr/ *| and 
iW(</ ) matnus may haxc a common scahir fiiiloi V*^ where 

V ix ihi hatkw.aids iliffncnce o|H*iriloT 1 i/ ’ fhis allows 
for nonsiafionan?V of tin dtsturbami , tmd ti (usually /no or 
one) IS the digrec of non'datioiianly Mactiiegur rf nl 
()'^K4) show 111 ! duality between ARMAX models h»r 
siiKhasiK arnl delcrminislK ifisturfianirs and for setpoint 
changes M> till xxstrrn moelef mav M'lecic'd for rrguitttion 
I ir for servo < onirol 

Suhsliluimg Ihr model (2) into the ob/eciivr function (1) 
gives 

MinffjA fi/ iBtiy ^)li, A '{ff 

I , 

v|A '(</ ')ll(t/ ')l', + A 'fry ‘lifry 'f«. .*,tl 
+ {.'! v-'R (3) 

'Htc effect of the (lisiurbarKc A '(3/ ’fCfry Vma i 
equation (3) tan fsc separated into forecasubk nnd 
unforctmiahic parts by solving the Imeai f>io(>hantinc 
equation 

I'iq '» ')!■■(.( 'M'V ' 'ia</ ') (4) 

liir Ihc lc»sl (Jc^icc viluimn will) rc«t)«i.l U< Kv 'l The 
degree of ¥lq I will Ivc k and E,," * SufnIri ding for 
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4 'tq ')C((/ 'j in (3) using Mj, and taking conditional 
ux[>ccta(iuris gives 

Min ((A '(-» ')B(v ')IJ,+ A '(</ ')e,|'Q 

I I, 

X |A '((/ ')B(r/ ')IJ, + A '(</ ')G(</ Vj 

+ L,'T'H y''U,) (5) 

'It> minimi/e the LjuadratK cost lunclion (5) wilh respect to 
only the current control iiclioii IJ, expression (5) is 
dirfercnlialtd with resjH’cl to IJ, and the result is set to zero 

J,„..2B'Q|A '(. ',B„ 

♦ A '(-■/ ')<;(</ ')e,| + 2Kr'lJ, (6) 

when- J, „ IS llii' tIcnvHlivc (tl Ihc objctnvt (unction wilh 
rcspccl lo II, riiminalinf! *, usinj; (2) anil simplifying using 
(4) gives 

J,„ 2B,'0A ')<;(</ '!'<■ 'Ui ‘)A(i/ ')V, 

t 2B,(QK(i, ’)(' '(</ ')BU/ ')l), I 2KV''ll,. (7) 

Lqualion (7) is now siinplifieil using Ihc relationship 
(Aslrimi, l')7Hi 

Ui/ 'll' '(1/ ')A '(■/ ')G((/ ') 

(i(t/ ')F ‘(t/ ')A '(r/ ‘)C«/ ') (H) 

giving 

(■(r/ ')f '(,/ ')Q 'B„''j,„.2(;(v 'IK '(V ')V, 

+ 2B(</ 'll), a2(’(r/ ')»■ 'U/ ')Q 'B„''Hr'll, (9) 

rite current control action is one-step optimal il it is 
chosen so that J, „ is zero Define IJ/ as the control action 
which would set J, to zero m the ahseiiee ol any saturation 
lirriil.s, and 11, as the control action that is actually 
iinpleniented; that is, 

,, f 11/ i( no Imiit is encountered 1 

Ur satflJ/}. ■/ ,, . , 

I l 11 a limit IS eneountered I 

l( the calculated control action cannot he implemented due 
to saturation in any lorm then J,,, will not he zero. In this 
ease il can he seen Ironi (M) (hat J, will he given tiy 

J,, + H|ij; (11) 

where li,' is the ummplemeiited portion of the control action 

called for at lime /, that is 

i',' Ur* - U, (12) 

So, m solsing lor the control actions which set J, lo zero, 
the past values id J, ,, rnay not he /eii> and arc delined hy 
equation (11) 

lo produce a controller which can he implemented express 
K ’(</ ') as Ihc adjoint F'iq ‘) divided hy the determinant 
|F(i/ ')| I he determinant is a scalar polynomial and thus ii 
can niultiply equation (^J) Setting J, „ 0 and suhstiiuting (or 

past values of J, „ using equation (11) gives 

Ciq ')F‘iLf ')U, 

1 C(i^ ')r(i/ ‘)Q 'B/Kr'U, 

4 |i (•((, ’)!'■((/ ')||b„4-q 'b„''rhj; = (i (11) 

I qiiation ( M) can now he used to calculate the control 
action 11/ which would minimi/e (I) if it could he 
implemented, that is. if no saturation limits arc violated (it 
calculates the globally iiptimal input which may or may not 
he feasihic) The actually implemented control action can he 
calculated il the nature i>l the saturation limits arc known, or 
rnav he obtained hy direct icadhack from the actuator if this 
is available. 

If the system being controlled is a single-inpul 
single-output system then the opiinud control input suhjeei 
to the saluralum limns is either thal calculated from equation 
(l.M lU the limit if a saturation limit is violated. For SISC) 
system FUq ')-! and \¥{q ')1-F((/ ') If the system 
being controlled is a miilti-mpuT mulii-output system then a 


further correction is required lo hnd the current one-slep 
optimal input suh|ecT to the saturation limits A simultaneous 
correction for (he case where the saturation limits on the 
current input are of the time varying form U„,,„ ,:sU, 
Um.,g, i-s derived in Appendix A Tlic procedure i.s iterative 
and converges in at most n steps. 

If there is no saturation, then U,' will always he /ero and 
equation (13) defines the same one-step optimal controller as 
Koivo (it^Wf) and Makilii (1^182) which is a generalization of 
the single-input singic-tmtput controller of Clarke and 
Hastings-Jamc.s (1971) and Clarke and (jawlhrop (I97S) 
liquation (7) is a multivariable generalization of the one-step 
controller with input limits of (imKlwin (1972) and Bezanson 
(I9H4). It involves rational polynomial matrices in q ' which 
can he implemented either hy expanding as infinite 
polynomials or hy introducing auxiliary stales. On the other 
hand equation (13) presented here allows the controller to he 
implemented easily using a finite number of pa.si values of 
Y,. LI, and U^ Clarke (19HI) presents a univariate saturation 
correction which involves three equations; a prediction, a 
control calculation and a revisc-d prediction Miikila's (1982) 
implementation of the saturation correction of CitMidwin 
(1972) failed to rearrange the rational polynomial mairices 
correctly us shnwn in this paper His algorithm is lacking the 
correction term involving past U,\ appearing m equation 
(13) loivonen (19K3a, h. c) presents a solution to the infinite 
step optimal control problem with saturation conMiamls 
which IS based on expectations over all future lime This 
off-line design does not account for the actual history of 
saturations which has oiciirred. nor ilocs it allow' for lime 
varying conslramls It csscnliallv results in a reduction ol the 
coiUrollcr gain so (hat the saturation limits will not he 
Violated 

There is no guaranieee that a one step optimal controller 
will fH' stable, or thal the closed loop system using a one-step 
optimal controller will lie stable For this reason it is 
necessary to check the fxiles of the controller and ol the 
closed loop transfer lunclion lo ensure .slahiliiy The 
eonsirainl parameter H can he adjusted to obtain stability 
Furthermore, il the eonirol actions are strongly oscillating, 
velocity limits on (he conliol action can lead to instability 

I hc best policy is to ensure both siahiliiy and acceptability of 
the control actions hv an appropriate choice (d R at the 
design stage before applying the one step optimal conlrollei 

Ihe eonlrollci (13) is shown m Segal er ul. (19K6) lo also 
provide one-step optimal corTection lor past inpui saturation 
(or Internal Model C ontrollers ((iarcia and Moran, 1982), 
Dahliii controllers (Dahlin, ]9fi8). and pole placement 
controllers 

Ihc controller with saturation eorreelion derived here 
provides a elosed-lorm solution to Ihe oplimr/ation ol the 
one step ohjeelive function I’his controller is optimal in a 
one-step sense it calculaies the input which mmimi/es the 
objective lunclion (I), taking into account that the past 
calculated control actions may not have been applied in full. 

II does not account tor whether any luture inputs are likely 
to violate a limit However, Wong rr al (1987), showed by 
mathematical programming that npiimi/alion with this 
objective function performed belter than any of the 
anti-resct windup methods which they considered 

3 . \imnl(Ui(tn rc\ult\ 

This section presents a simulated example of controller 
saturation to Llemonstraie the proposed algorithm. The 
simulation shows the servo icstKmse to a step setpoint 
change 

The system considered is an over-damped continuous 
second-order process which is made up of two cascaded 
first-order processes plus deal-time. The gam of the process 
IS 1, the dcad-time is I minute and the two time constants arc 
1.44 mmules and l.fl9 minutes. With a control interval of 1 
minute and a zero-order hold between intervals the ARMAX 
model with step disturbances or step changes in setp<iinl is 

((()-(i.'»i/ ' + 0 . 2(1 -'ivi; ..((I, (,sy + i(. (((,/') r(), 

4 ([ ((-(mq ' 4-(l,2q -’)(■, (14) 
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[u, 1 I )eiid“bi‘iil nr miniiTUim \.iriamr uwitrnl fm 

sCkonJ (irtler syMcni Step change in \Lij>nmi (mm ‘>0': u> 
N)'V ai iirfK' I ininiiic 1 Nn S4ihiranr)n limn ^ J 
S.Muralinn limif nn inpul al llH)^r Saluniinn ininiHni\ 
.ilunriihm used ^ Reset wiiuliip pmiceimn nnl\ uses past 
.ktuall\ unplemenled 4 Nn saturaiinn enrreitinu uses 
past ealeulaled l\ 

fht eontrnllcr ec|uatinns iv 

(II 41 ) ‘ 7 (I iih/ -’i vr, 

(1 (t (' ' - n :.tf ■)>; 

(0 1«M)( (1 %i ' . n if , 1 

1 he respnnse In ii step ehanf,H at iiiiu 1 ruinuli Imm Me. 

tn fid'r m the scipnini is shown m f i|' 1 I he irnlial sU ads 

stale input is KO'y I he li^nm’ enin[iaies the enniinuovis 
pineess respnnse when iheft is nu saturalinn limit nn the 
input (lahelled I) to the resjmnsi’ when there is a saiui.iiinii 

liniit at and the alj.'nrilhin pieseiiled here is used 

(liifK-lled 2) In addition, Inr eomparisnii, the res^iwinse n| the 
vcieieilN foini iinpIcrnenLitinn nl the ennirnller ^Imti sniifiK 
prevents reset windup hy using the .lelual past values nf the 
Li. in the ealculalions is shown (lalielled M as ts the 
iniplementaiion of the controllei where saluiaimn is ignored 
and past values are used as ealeulatcd (labelled 4| 

4 Muin-inf}uf-miiltt-(>ulf}u{ stmuiatufn rcMtlh 

Ihis section presents a simulated example ol eonlroll:i 
saturation m a multivariable system tn dernnnsliate Inilh the 
coireelion loi past saturation and the sniuilianeous 
saturation correction the sinmhiiion shows the sersn 
response to a step setpoint changr 

the system considered is an exjx’nmenial two tank gravnv 
feed process v/ilh heaters in each lank and a tonslani reevele 
flow from the iHitlom tank the top lank 1 he stale space 
model lor the system is (Hugo. 



() ()1?1 

0 tiS27 

T,U) 
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0 ()20h 

- (1 fl2dh 


df 

(Mil 13 
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n (Kiw II 
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where / represents the temperature in degrees ( elsms and f 
refers to the heal input m volts at the computet ouipui 
(range V) and the time r is in seconds I he subscripis 7 

and B refer to the top and btuiom tanks, rcspectiveU llic 
steady slate values are Tj ^ Mfi . 3r< , f V 






'N 

IS 


1 Mull IN .'inahh ikad be.o ni nnimmum \anaiui 

cunin*! Su p * har»c:e oi tkUloni t .uik lemjv i-iluii u i |siin[ 
biun ^1 I in t \ iinit .h*'*cii, • »Hd>* Stepv bangi ui Uiiitun 
tank l( ii,|H T.iii.iv M‘i |hvini lo»ni ^4 t t<» h' ( .it iinu 400 
stuond^ S.iUnahnn limits nn Inuli mi'uls .it t'V amJ Hl\ 1 
S.nui.itinn miut, tinn .dg^'iillun nmiIj Miiiuli,iT»eonv uUmu 
imn 2 Snluoihnn 4,*n irt ooii wilhnui vimull.inmus loitu 
turn t K<.sr! wmdup (nntiiinm '»nl\ Usr ‘ |.i ailmdiv 

iinpU im uh «l f 

and t V 1 he iliscM U k.oulri>lli i uus .» .'d Munnd 

i.ontf n) mu IN ,il 

t irmt sliiiws Oh* ies|MmM nl tin ssstem in prnlniiged 
f>i.'iioii nl \.itui;tlinn Mu si ijntini u ni{Neiaiuit' m ifu: Isf iiinin 
lank r Miailged m On unallainahli N.dm nl ^ r ( at time 20 
sCvoihK At lime hdOseiniids, iht srl|>nim is i hanged in the 
iiU.umibli v^jUk nl 12 ^ ( I he saluiahon hrmis aii at llu 
high arul hiiA saliM-s <d |0\' ami o\ Mvi iisfMHisr using Ihi’ 
eninidete algonilim •lesiobed ht it is l.dHlIrd I, ilie tespuivse 
using die uurectinii fni past saturation but not the 
simijh.in( nu'. tnnci iion o laN lied 2, and the res|Hmse using 
nnlv ii sei windup [iintniion is lalu llrtl 

'n ( nnt /uimm 

IhiN jiajHr h/is shown ihc derisaiion nl a nne Me(^ ojitrmal 
k.orf(Miiim fm saluralion m disireli' rmwlcl tiaud eorUr^d)er^ 
Ihc rcsulimv toniroller ledutts In ihi vuigU input 
single (‘ui[>ul <Mu step tonlmlh r ol ( laike aiul Hastings 
lame'' tiu7)i ,nui its sell inning w( rsnm tt laikc and 
(lawlhiofi and Ou rnulii input multi oyljml nm step 

contrnilei n( Koivn l|0HO| m the i avc itial 0»e conindlei dturs 
not sahjraie Iht algoiilhm is rasv in impleniciM as a 
lofieehon op-fating on ih< dilleieinc I'Kfwcen (uist 
takiilatid mpuiN . 011 ) inputs arliiallv irnpleiTirri!rd It iv valid 
(nr (inv lorn\ of mpui saturation A lutthcr tbui usuallv less 
im^xirtantt correetion for multivariable (tuiooileis Is 
dcvrIofHul which Nimultancously adjusts the rernaining in(Hils 
for anv cofUrtil inputs which saturate I his ctmlrtiller is fully 
etpnvalcni to the iiiaihcrnatK;d programmiiitf s<»lulion with 
this ohjeerivr tunction with ihe same saOiratnm limns on the 
inputs the algofithni is equallv afr^slicahlc tn itie Oahlin 
eonoollcf amf Internal Model t onirollers tl,Mf ) tnuauu" ol 
their equiviileme to a special cave of the minimum vartaittc 
controller A simulation namplc shows the |K‘rlorniiiince 
improvements using tins algorithm for i<mtrol of a 
multi input multi output svxftm 

At knfU^lrdumrnLi f he irM aith work m this paficf hws 
been earned out with th>; support ol the N.iiural Science and 
t'npmeering kccearch ( ouncrl of C'nniida Htrs siipprirt is 
graiclully acknowledged Tlie authors also thamk l>r ( M 
( rriwe (or many helpful suf^jiestions during this work 
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Appendis A. Stmultanetfus correction for M!MO systems 
lujuaOon (13) m .Section 2 describes the saturation correction 
to the controller triiiisler function using pa,sr unimplemcntcd 
control actions lj,‘. When any inpul.s in a multivariable 
system saturate then a further simultaneous correction is 
required to calculate the one step opiimal settings of the 
conirol inputs subject to the saturation limns 
(.'onsidcr equation (9) rearranged using equations (11) and 
(12) as 

0 =2G(</ 'll '(1/ ')Y,+ 2B(f/ '111, 

+ 2('(<, 'll’ '(4/ ')0 'B„‘'Rr'LI, 

+ 2|I- C((/ ')►' '{q ')||fl„+Cf 'fl„''R|U; 

(9a) 

where the J, „ is ihc gradient of the pusiiive derinile 
quadratic objective function (I). TTiis equation can be 


rewniicn with obvkxiK Kubstitutions as 

I, . “ Icdq ')Y, ^ 2/3(1/ ')U, + 2r(9 (A1) 

All of the past Y,, U, and arc known and their 
contribution to the gradient can be lumped together as K, 
giving 

= 2K,. (A2) 

When there is no saturation the optimal control inputs are 
calculated so as to set (he gradient of the objective function 
to zero 

vr -Pu'K ( a . 3 ) 

Because the obieclive function (1) is positive definite and 
quadratic we know that equation (A3) defines a globally 
optimal inpul 

The saturation limits are assumed to he .simple, though 
possibly time varying, bounds 

ij„ (A4) 

which define a convex box shape. In order to find the 
constrained optimum an iterative priKcdure for determining 
active constraints is necessary. In order to determine which 
of the constraints (A4) violated by (A3) will Ik* active the 
gradient (Al) must be evaluated at the point IJ, ~ .sat (U*) 

It the component of the gradient is in the direction ol the 
constraint then the constraint will Ik active if the component 
of the gradient is into the feasible region il will be inaclive 
'Htis .simple active set strategy is due to the constraints being 
bounds on the inpul.s (Gill et al. 1981). 

If one or more constraints are active then those 
components of the input arc fixed at their limits and the 
corresponding compenems ol the J, will not be zero al the 
next calculated value of the input U, lo solve for the 
remaining unconstrained comfHmenls of IJ, and the nonzero 
components of J, „ equation (A2) must be rearranged to 
collect these terms on the left hand side 

For example, if only the ilh input vanahle will be 
saturated, we can rearrange (A2) as 



where is the rlh column of and U[, J] ,, and K] are the 
ith components of V,, I, and K,, respectively, e, is the /th 
unit vector and (/, is the saturated value of the dh 
component of the input. Equation (A5) can be solved for the 
remaining components of the inpul U, and the free 
comp<.incnl of the gradient When more than one 

component of the input is saturated the rearrangement 
shown in (A5) is performed for each component. For 
computational purposes the inverse of the /3,, matrix can be 
updated using a rank one update formula for each saturated 
component of the input. Tlie control inputs calculated from 
(A5) now become the new iterate for U,. 

The algorithm for finding the constrained optimal input is 
then: 

(i) Calculate the globally optimal control input LJ*. 

(ii) If any of the components of U* violate their saturation 
limits set those cx)mponenls to their limiting values and 
calculate the gradient (A2) of the objective function at 
that point. 

(iii) For each component of Ihc gradient which is in the 
direction of the constraint, that constraint is active. 

(iv) If all of the constraints arc active or if no inactive 
constraint becomes active and if no active constraint 
becomes inactive then the constraint optimum has been 
found. 

(v) For each active c(.mstraint set the input corresponding 
to (hat component to its saturation limit U‘f and 
rearrange equation (A2) as (A5). 



Brief Paper 


IW 


ml Solve- L-L|ualuHi (A51 Kh ihc (icv- ^om|x>rKlll^ iht- 
input anil the free Ci>mjx»m:nis m| ihr fir ulu ru 
,viO Go U) step {u) rhis alponthni cuumt^^s ki ar « 

<lCps 

IV Q and Bn marnces heavily mfluener ihe nuiurt oi the 
MinuJiancouv correction Tlic inoic ink-raciivc the B . matrix 
js the larger the cflcci of the MruiltaneouN correction will V 


AltfHHjgh the <1 matrix hiei no eftcvi on the Minimum 
\ ariaiKv C oniroltcr (B * (U ol ei|iiaitK>n (IK), >* ian have a 
''cr> ^igniheant eflcct at valurAlton wtirn (he <i>fecA*i.l of the 
ouijHjt cannot V vancelkd cxacih TV nngho in the Q 
matrix lirtieiminr the relative imjioriaitce of the various 
output ilcviationik, lahcn cakutaitnii iV MnvuitAooHi5 
airreciKMi 
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Modeling of Uncertain Dynamics for Robust 
Controller Design in State Space’'^ 


AL.TUCi IKT AR’ ind I MM O/CU Nl Rl 


Key Hordi -Robuslncvs, r< bust ..umtol si.ilt im-iluxiv 

diMurbancc rcjcclmn. nmdtl ivducuaiv Ik'iibl. mukuih-^ 


orMru! ikVvK'rn vuSiUry 


Abstract—Structured nuHlehng of unccruiin (ivnan\ivA tof 
robust coiiirollcr design in stale space is disAiisHiLl h iv 
shown that, under mitd conditions, it is |x»sMbtv in obtain ;» 
rational transfer function matrix (TFM|. possibly dcptndrni 
on a parameter vector which vanes over a subsi i ol a timit 
duncrisional real secioi space, lo reprckcni uncciiam 
dynamics Furthermore, in many praciical lascv. uruenani 
dynamics can he represented by a iclalivelv bm ordtr II M 
even if the actual dynamic's are ot very high ordei The 
prckxdure of determining such a FFM is discussed It is 
shown that a amtrnllcr which stabili/cs Ihe nominal system 
including such a representation ol unceiiain dynamiss. also 
siahilizes the actual system Furthermore, tl? sired per lot 
mance or relative stability ean also l>e guaraniecd the 
presented approach gives a unihed (ramcwurk tor ihc 
kolulion to the robust coniroller design pmbkin loi sysicms 
with tioth parameter uncertainties and umiri.nn dynarmcv 
■An application to a robust controller design prohlem lor ,i 
large flexible structure is also presenicd 

1 /ri/roJut fion 

()m Ol nil fundamental issues m fecdluick (.ontroller tlcsign 
IS robustness Since an exact model ol a (ilivMcal '.sstiin 
would be yerv complicated if noi impissihlc to ohiain, the 
designer should has4- the conirollcr design on a Piurriinnl 
model and should require ihe controllei lo (nrlorm 
satisfactorily under possible deviations from ihe rmniiniil 
model At this point, modeling of such devi.iiions (i c 
li/T(rr/urnfrrv) becomes a crucial issue the unccri.unties in a 
mathematical model of a physical system arc basic.div due lo 
iwc) factors; unknown values n( ccriain svsiern [vuamcicrs 
le g resistance of an electrical comixniend and loialls 
unniixlclcd dynamics (e g. high Irequencs modes o( a tlexibit 
structure) It has been generally accepted ihai stale sp.KC 
models arc more suitable lor representing uruertainiics due 
to parameter variations, while unmodeleiJ ilvnamics can lx 
represented easier in the frequency domain 

Most of the Ircqueney domain approaches introduced s(» 
far (c.g Francis r/ al., 19K4) are designed lor linear systems 
With truly unstructured unecrt.iiniies and tannoi take 
advantage of all the available int< rmation More spccificalls 
these methods assume only a known uppt‘r lx»und i»n the 
magnitude of the pmssible perturbations Ihe appro,uh 
introduced by Doyle (19H2) can acciimmiKlale some known 
structure of the unccriamiy by putting the system into the 
so-called ' standard form", but again only known magniiudt 


‘Received 1 March, 19KK, revised 1-4 Novemixr. 19H)S. 
revised 22 August, I9K9, received m final form 2fi I cbru.iry, 
The original version of this paper was not presc’nied at 
any fFAC meeting This papc:r was recommcndeii (or 
publication in revised form by AsstHaati f dii^u K V Paid 
under the direction of Editor 11. Kwakcrnaiik 

Department of Eiccincal Engineering I nivcrsity of 
Toronto. Toronto M5S 1A4. Canada Author to whom al! 
correspondence should be addressed 
+ Department of Elcctncal Engineering. Ihe t)hio State 
Cnivcrsiiy, Columbus, Ohio 43210, I' S A 


fxHinds ian b< uidt/cd on riwh uni'ef'iiui blikk ilowesri, in 
pracinc iTx>fe intormatirm is genemliy asaiUbk lor 
esamplc, ip ihe tasa.' ol flixibk \irucluic'.s wiih lo kKWled 
aifuainuy and Mi-nsmg ii kni^wii Ihw! the phase Ihc 
uruert,un itvn,times always lies iHrlwerii d amt 1 H(I‘ Kwch 
addiinmal mfcurnation rnav rrhix ihc lobusl conirollci deM|rn 
problem coi\Mdeiriblv and would in general, lead to less 

coiivcrs ato f vorUotlU i ilcMgii 

Mam phvsual svsuiii\ fsossess txilh paiarneiers with 
aiiknitwp txiui s.l^ue^ and uruertain dynamics W’ei nod 
>ciiavalli profXKed a cornbinrd lic-queiH) domain 

and stale span approach for such svstenu liovd (WHId 
coiisilcfi d u [>resenltng uristiuctured unicilainlv in a 
siiiiclurcd Innn and hence lomlnning Ixuh cUssc>, ' r a slate 
space design Howcvei his approach is restnclcd lo systrito 
which tan In tianslormrif inlt» tlx \«t called standard hum 
f urthi'imofc only magnitude Ivmnds on those hloi ks can fx 
utilized in flu design prixes'' 

In the [Mcseni pa|X'i a unified appio;uh in sluU' space 
which tan he used lor lineal systems with Ixilh tlasM's ol 
urn eiimntirs ami wlm h t an utilize am mfiumation iiNnit the 
uncertain dsnamus iv mirodtuetl I’he main result, prcsenieil 

1 Section tleinouMr.iii's that, undn nuld conditions, ii is 
possddt Uy obtain a latinmil tianslrr lumlion niatnx (FI M). 
fv^sMbl\ pararm inzed In a tinue dimensional vet lor, to 
leprcseni urn eitain dsiianiks and design a tnntroller 
actmdnigly in saiisfv sialidiiy and liesned jk rfoi inanee Ihc 
vniderlving idea here is to represent fxissddv very high 
dimensionai uiisiim tined nmert.uri dy namics irt a relalivrly 
low order vniKiuicd lorm The preserilrd approach is 
applied to .1 rnbusi ninirollei design (>iulv|rrn tor a large 
flexitdi slim line in Scciion I Flu: sirutUire under 
mnsuleration [x*ssesvts txilli parameteis with unknown rxiict 
v.ihics amt unriiodcled (high frrqwem vl dynamics 

in the sequel f di noirs Ihe space ol lomplcx nurnbeis. C " 
denotes ilu iigfn h.dl c nriiplt s j'lane. It denotes the 

spac< Ilf real I’urntxO'- H deiuucs the m :1 of rHnMn'galivt 
real nuridxfs denotes ibi k dinunvional real vector 

space. I dr Unit s the identity matrix of approtTruile 
dimervions ju hj d<notes ifie slosed inte rval ol K Irom u to 
h and i ), . and ( ) denote. res(xct»velv. the eomplex 

i.«m|Ug,iU ihi rn.igmiudi ,md the jdiaM' cd ( | 

2 ftrtitr moJe/i /rn nm rzr«ji#/i thn^^mu^ 

Ihe imceriam dvnatmes of tnieai svsletn. noinin^llv 
modeled by fdc) «,afi fx reprcMmicd at the input by 
at the output h\ A,,(ri or addilivelv by A„(i) as shown m 
I ig 1 Eir breviiy, here we eimsidcr onfv unecrimniics 
leprescnicd at the output Similar results tan be proved for 
other tsp's of rcfiieM:nlations along the Viune iinciy Wc will, 
111 fact, apply theiM. results lo «n addiiivcly modeled 
unecrtainiy in Sec non 3 Mcnccforih wc drop the suhiycripl 

o of .A.,(y I 

y\lthoi:gh Al V i may md lx: known exactly, w>me 
information about it is grnerully iiv.iil,d m Furthermore, 
A(c) mas not K representable as a /mile dimensional linear 
system with a rational l”FM, or such a represenuiion may 
require an unmanageably high dimenwonal model 

f iur purp'>^sc is lo dcrrmiine a rational ITM / ) to 


HI 
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Ki(» 1 Hcprc.seiKalion of uncertain dynamics 


replace A(i) m the model, such that a feedback controller 
ATf v) designed for such a model stabilizes the actual plant and 
achieves desired performance Here E(s\[)) is p<lissihly 
paramein/ed by a vector p which is taken from a parameter 
set fl The following theorem dcmonsirates that once a 
suiiahle TPM and an aS8<K:iatcd parameter set are found to 
represent the uncertainties, such an approach would, in fact, 
guarantee the stability of the actual closed-loop system 

Thvurcm la {Ahsolutv stability). Suppose that A(v) is 
analytic in (he closed right half complex plane C'. except 
fvissibly at some isolated singular points which constiiuie a 
total ol m poles with due count of multiplicity/ Let /^(.v;p) 
be M TPM which is rational in v and continuous in p and fl be 
a subset of a finite dimensional real vector space with the 
properties: 

(a) for all ta f R there exists p,„ c fl such that 




J ^ A(jfu) 

(la) 

if A(.v) IS 

analytic at ,v - jn) 

or 


lim E{j 0 ) 

r Wl 

^ ■"" ^itii A(j(u + re'^') Vff e 

n jrr 

2 ’ 




(lb) 

if A(v) is 

not analytic al .v - 

jw. 



fb) there exists f fl such that 

lim lim Afrc'^') f 

and 

(c) E{s\p) has exactly m poles in C' for all p c fl 
Por a given rational 'PPM (/(.r), suppose that a rational IT'M 
K{s) is chosen such that the closcd-IcKip IFM 

Tf iwp) ^ (/ f T(v;p))C;(.r)A'(.r) 

X (/4-(7 4 /■(.v;p))0'(.v)A(.v)| ' (2) 

docs not have any poles in C ' for all p c M Also assume that 
det |/-f (/4 A(.v))r/(i)A(.r)| #0 on a dense subset of C 
Then the true closcd-liHip TPM: 

/:^(.0 » (/ i A(,v))f;(.OAi(v)(/ + (/ ^ A(,OK/(.<)A'(.v)| ' 

(- 1 ) 

IS analytic in C'. 

rroof llirnughoiii in this proof we drop the arguments v 
and p for notational breviiv l.cl n denote the number of 
poles ol (/-I A)(#'A in CV 111011, since A and A have the 
same number of poles in C , (/ t E)(iK also has n poles in 
('^ for all p e fl Purthcrmorc, since Tf does not have any 
fwlcs in C\ by the muliivanablc Nyquist stability criterion 
(Mucf'urlanc, i'^70), the map del |/4 (/+/OfiAl as v is 
varied on the standard Nyquist contour y encircles the origin 
- n times lor all p f f l By the hypothesis, A is analytic on 
C\ except possibly at isolated singular points The same is 
also true for G and K. since they arc rational ITMs. 
Ihcrcfore, det |/4 (/4 A)(7Aj is iinalyiic on C\ except 
possibly [it isolated singular points. Furthermore, since 
del |f 4 (/ 4 A)r/A| #0 on a dense subset of C, is well 
dclincd on such a set and we can apply the multivariable 
Nyt|uist stability criicrion Note that, the conditions (a) and 
(h) imply that the loci of det |/ 4 (7 4 A)(i A], as s is varied 
on is a subset of del [/ 4 (/ 4 A)(/A| IcKi as r is varied on 
if and p IS varied on fl (see Fig 2). F'urthcrmorc. since h is 
continuous in p, any member of the former set must encircle 
any jxiinl on ihc complex plane that is encircled by ihc 1 alter 



Fif. 2 (a) A representative det |f 4 (/4 A(Ci'A'l Uki; (b) 
region of all possible dci[/ 4 (7 4 A)GA| U-ici. (c) del [/ 4 
(/4A)0A| Pxi as k IS varicil on the half Nyquist contour 
and /) IS varied on fl 


set the same numtH.‘r ol times. Ihus, det (f k (/4 A)f/A| 
encircles the origin n times as v is varied on 1 /, which, by 
the multivariable Nyquist stability criterion, proves that 1 
does not have any poles m C’ Hence, the result follows □ 

Remark 1 Nine lh.ii represenls a physical sy.siem 

whenever A(-v) docs, since all other terms that appear in the 
right-hand side ol (.1) are rational ITMs, F urthermore, 7',^^‘ ) 
represents the actual closed loop system whenever A(a) is 
the ITM represenlmg the actual iinmodeled dynamics Ilius, 
whenever /’^(v) is analytic in C*. the actual clused loop 
system IS stable 

In many practical cases, absolute stability may not be 
sufficicnl Instead, lor example, one ma\ wish to coniine all 
Ihc closed-loop eigenvalues in <i region ft of the complex 
plane Note that the irnaginery axis and the right-hand 
semi-cirtlc of mlinile radius together define the boundary of 
C'. Hence, if the conditions (a) and (h) ol I'henrem la arc 
met, we say that T(.s.p) and A(a) are mauhcii on the 
boundary of ('* F urihermore, we say that the two I FMs are 
matched on the boundary of a region >9, il the obvious 
generali/.iiions ot the eoiuiitions (a) and |h) of Iheorcm la 
hold. The Inllowing result can be proved as Iheorcm la. 
with an obvious modilicaiion ol the Nyquist contour 

ThfDren] lb {RvlaniH' siuhiltn) Let .// lu- an open subset 
of V .Suppose that A(>) is analvlic m ^ except 

possitily at some isolated singular points which constitute a 
total ol m fxdes with due count of multiplicity Let 7 (s; p) be 
a ITM which is rational m s and continuous m p and 11 he a 
subset of a finite dimensional real vector space such that 
Eis. p] and A(v) are matched on the houndarv of .>9' and 
/;(v./>) has exactly m poles m .y?' lor all p e II For a given 
rational ITM (i(s). suppose that a rational IF'M Kis) is 
chosen such that the closed-loop I'bM (2) docs not have an\ 
pole.s 111 .#9' for all p f II, Also assume that dcl|/ 4(/4 
A(.s ))(/(.v)A(V)| # (I on a dense subset of C Then the true 
closed-loop VrM (2) is analytic in [ 1 

It is well known that (Safomiv et al . L^Kl) most of the 
widely used jKolornuincc measures (c g disturbance 
rejection and steady slate error) can be related to the return 
difference matrix. For example, to achieve a certain degree 
ol plant disturbance rcjcclion at the output, one may require 
the return difference matrix to salisfy." 

[/ + (/ +A().r>))(;(ji.-)A,(j»')r-e((u) V(»€a, (4) 

provided that the left-hand side is well delincd Here C7(fu) is 


(Ic) 


'Note that, one needs to know ihc total number of *'ITic more widely used criterion is defined as a lower 

un.stuhle poles of A(.r). llieir actual locations need not be bound on the singular values of the return difference matrix 

known However, note that (4) is a more general condition 
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, piftiiive definiie main* foi all e u, O c K » ih, 
fittiuencieii where disluibances are effective. (or anpremn 
jielv dimensioned mairKCs 4 and fl. a' = 
ihc cximple* evinjugale iramipose of A. and .r ^ » meam 
,, H IS powiive scmnkfiniie The following iheorem 
^monsirafcs that if a avntniller is designed lo saiisl> such a 
performance cnierion for the design model iihr model in 
*fiKh A IS replaced by E). ihen ihc aciual closed loon 
r^vstem the saamc criterion 

77 ,<Mrrm Ic (GW prrformmce) Under ihc conditiorib o( 
Thtorem U, su(>pt>sc Kis) is chosen such lhai 

j / * (7 > f:(j(ir./7))G(jtu)A:(j(ir)|' ,> 

t n 

fhen (4) IS satisfied provided that the icll-hand side «i| | 4 ) is 
1*71 dclincd lor all w e Q 

/Voof K the ieft hand side of (4) is >fccll defined, then AG) 
IS jdiilytic al s - jci> By (la), fur such io there exists p ( || 
such ihai 

I A ( / ^ f:()fif./r,J)G(jtn)A:(|ijO 

/ -1 ( / t A()uO)G(|iii)^)j(ii| 

Hence. Ihc result follows. 

I nder mild conditions on A(v). the exiMencc vd a TI M 
/ (\,/)) and a pariimclcr sel II, satisfying, the ciinditiuris ul 
Ihc rilxivc theorems, can Ik* ensured lo avoid noiaiional 
Lumpicxny. we prove this only (or the scalar case Ihr 
cxierision to the multivariahle case is posMhIe alon^i similai 
hues I urthermure, here we consider only uhsuluie siabiliiv 
\ similar rcsull can be proved for Ihc rclalivc siabilnv i.asc il 
ihc region .rJ is symmelric ahoui the leal axis 

Iht'ftrvm 2 I a.’I 


Af.s) ^ ' A,( \) (h) 

^here is an mlh order monic (xdynomial with rcros in 
(' and IS analytic in (" (i e (actor out the unstablf 

fHilcv o! A(^) as \l(ijs)) rurlhermorc supfxisc that Alx) 

IS such that Aljin) - A( prO lor all at t. H. and that 
lim, .. Afrtd'^) IS a (mite real constant* lor all 
i t^ 2 , . 1 / 2 ) Then, there exists a function ; p) toniinuous 
in p and proper and rational in v, and a subset fl <il a hnuc 
dimensional real vector space, such that conditions (a), (h) 
and U) ol Iheorem la hokl 

/Vf»f// Let p - (a, fl) - (o,. . . , Ol,. fl,, , fl...) and 

where e(s, /]) - .v"' i fl, i'^ ' 4 + fl„, ,i f and 

, a) ~ X - j V ^ 

i -♦* o,.v^ ■+ o >,i ^ a,v + O 4 I + 0 , 

hoi any nr e R' , let C be the sei of all pfissible 

values of TTten it is possible to find a suhsci Aft m l of 

R"’, such that 

(i) the loci of e(jm; fl) hs fl is varied over Af(m) contains 
and 

(iif e(t. fl) has m zeros m C" for all fl e Aflm) 
f^or any lo e H\ let !f^,(m)c 7 C be the set of all jxrssrblc 
values of A,(j(ir) t Then il is possible In fiml a sijf>scl Aioi) 
R". such that 

(i) the loci of fc,(jar; a) as a is varied over A)oj) contains 

d^,(m). and 

(ii) o) IS analytic in C* for all at i Aia*] 

l-et -CcR be the set of all possible values of 
Imt, ,, Alrc'"*). TTten it is possible to find subsets A. of R 


ITic actual value of this cnnslani need nol be known 
^ ^Jw) IS well dehned since A,(0 is analytic on Ihc 
imaginary axis jR c: C‘ 


wwi H. ol IT such that 

(i) the kxii ol hm, f as n v«ne^ ovci A* 

aiwl fl IS viUKStl met Al,, umtaim 
(Ml f Jr AnAlytic tn C' f<« 41II t 4 * and 

fill) ri^. fl) has m j-ervn m I'' (or aH fl i H. 

Ut 


A ^ Cl I i I 
1 .' 


A [ m )) 


fl fl ' i ) H («« I 

and 

[1 ^ 4 Af 

Ihcn f (A p 1 IS KMitinuous in p and and miKimat *n 

11 IS u suIhci ol a finiic dimcmioiul real vetioi sifxiue 
(R*‘* ) And the eomhUons (a), (h) «nd (t ) of Ihcortm Irt 

hold 1 ] 

Hrmark 2 In ixiam eases, lirfsrnding t»n how much n known 
ahiuii .MO the minimum required dnncitsion of IT (1 t the 
number of piiiamriersj can. in (»ei be lens than the luimivef 
preduted in the bIxht pixml (>n the othei hand, in certniii 
other cases one prelri U^ work wdh a htghei order 
ITM and a Kighei dirnrnMonal paiariirtrr set. lo letUice Ihr 
possible coiiserviilom involvctl in representing A(i) 

fleffwrk I Note ifut A (i.p) miuI At*) may Ik matched by 
using diflrreni ft » It ul ihHerrni (xiinls 1 on the fxMjndafV of 
C' (or (d A' 111 the itiw of irUitive stahiliiyT However, this 
Ucl diKs not t>niig unv rrstriciums in saijslyirig projHrtirs 
such absoluu siuNlity, rrl.il ive suibilriv. 01 gixnl 
perlorniance of ihr arliial sy stern (see I hi' prcxils of 
Theorems la am) Ici 

The following exarnplr illuMtuIrs ihf poKediiir of 
determining A (i,/») am) 11 


t.iamplr 1 Suf>(xise all Ihgi |s known ;dv»ui Ah) is that ii is 
anuIvlK in ( Ai lur) At Ion, AtM;'”) •! foi all 

tn I . 1/2 .7/21 


Uf , 

i j</> 4 IM, 


(A( )i;^ H 


jra ♦ tri, i 


V.i* r R ' , 


ami 


. ( I ■ . (A(|<i/)|- . ( ■ I Vr,. , H'. 

I f»* 4 IH , I f'f ^ ; 

where i) and ttr, » ru, >tJ are known nurrilvos 

The gain and phase rd all gtosMble A(i|, togrlhn with a 
reprcvenialivc .\(i) art: depicted m I ig ^ l et us rhcHwe 


A. t r . /h 


(7) 





uj . 

dog'w:aii«) 



FTc* } Regions of all ^Kmiblc magnitude' aiMl pFuiie of 
AtjuH and a repTCM:niai.ive A( )or) (or Uxamplr I 
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€ Xw-j, 

h^u, 

y 

f i(p 4 I he parametei sci II fi»r 1‘xample I 



where // - (y. i) hn ciiih frequenev OJ ( H \ 

• hy Viiryiiif^ y wiihin ihe interval |n»,, at ,] wc can satisfy the 
phaMT Kimlilion / p)) / (Afjn^)) anil 

- fur a fixeil y fc Ity;,. n) ,|. wc can meet the nYagniluile 
euiulitinn |/,()oj. p)l lA(|nj)| hy varying i within the 
interval ^V^y] 

fur all jHissihle A(v) lienee, we ubtain 

fI ‘ My. ')! "h ■ ( ' <V/r} (K) 

which IS a huiiruleiJ siihsei uf and is depicled in Kig 4, ['] 

Remark 4 Nule that, Ihe tighiest //' nurni hound for A(.v) 
deserihed in the ahovi* example is Siifipose that a 

coniroller was to he designed, say lo achieve rohusi slahiliiy. 
for a plant with uncertainly A(0 hy using Ihe //' approach 
(hrancis e't ill . I‘^H4) Then il would he necessary to design a 
controller to stahili/e all the plants with uncertainty A(v) 
satisfying 

ll/M.OIL - i\r. w 

where || ||. denotes the usual fl' norm This, however, is a 
larger class than the one deserihed hy (7) and (K) Iherefoie. 
a coniroller designed hv using the //' approach wiudd, in 
geneial, he more conservative than a controller designed 
using the pieseiil a(>proaeh It is, of ei>urse, possible lo 
modify the nominal ff M and reduee the hound in 
however, it is apparent that In using the norm hounds alone 
(as in (he H approach) one cannot get a tighter 
representation (ol the actual uncertainty) than the 
representation obtained by the preseni approach 

( onsider a system modeled by a nominal I F M (i(.\,p,,). 
where p,, i II,, is a vector denoting possible values of some 
system parameters .Suppose that the dynamics not modeled 
by (r can he represented at the output hy an uncertain IFM 
A( v) satisfying the conditions of I'hcorern Z. I hen, one can 
obtain a rational I FM / (v, pf ) imd a corresponding 
parameter set FI, . satisfying the coriditions of Ilieorem la 
(or ol I heorem Ih when appropriate 1. as ihseusscd above. 

I bus. a design model described by the I FM (/ + 

^ (V i p, ))(» ( V; p, ) IS obtained A slate space reali/.ation. 
which IS paramelri/cd by p {p, . p,.) r 11 II, x IF,,, can 
now be developed lor this model Once such a model is 
developed, existing methods (e g Karamarkar and .Silpik. 

Ackermann, FlHO, Yedavalli, Keel e/ u/ . IMHS) 

can be useil to design a coniroller K{\) to achieve robust 
slabihly and/or good perlormanee lor all p t M Fhen the 
actual closed-loop system, shown in Fig. has the desired 
robust stability arul/oi good performance prof'Krrties 
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f i(. <1 I russ structure 


1 Applnation 

We consider the application ol the presented design 
approach to the planai buss sirueture shown in I ig b T he 
truss is made ol identical unilorin aluminum rods that can be 
displaced in the axial direelion Ihe sirueture is lixed ai 
nodes 1 and 2 11 is controlled by a linear force actuator 
located at node lb, acting in the hon/.onlal direction The 
liKation of the actuator is chosen such dial ii lias ihe grealest 
efTect on the first mode rcTaiivc lo the higher modes 
MeaMircments are taken hy a co-locaied linear acccTero 
meici Ideal sensor and actualor dynamics are assumed The 
nominal values of the relevant material parameters foi die 
rods are given m I able I 

The slruclure has lb free nodes, each having two degrees 
o( freedom Hence, it exhibits 32 flexible modes It is 
assumed that a ecrlain sliuciural damping is associated with 
each individual mode These assumptions Icatl lo a b4th 
order stale space model Due lo variations of material 
properties (such as modulus of elasneiry and mass density) 
the exact values of structural frequencies nr, and mode shapes 
h, arc uncertain Nominal values of these quaniiiics (based 
on the values given in Table 1) for the selected modes are 
given in Table 2. The actual values arc assumed Lo he within 
1 Kr of these nominal values. The damping ratios 
s (r - I. 2. , 32) arc assumed to be between U.d()5 and 

0 1)1. 
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Fiii. 5 Onsed-liHip system 


Tahi I I Mah kiai pakamfti rs 


Rod cross-section area 
Modulus of clasticilv 
Mass density: 

Length of a vertical or 
horizionial rod: 


4 X 10 '* m' 
b KV44 X 10"'N/m^ 
2750 kg/m' 

1 m 
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r^BUt 2 Modal frkck FNnts ^si> 

SHAPILS 


j u*,(rad/sec) 


1 

131 

(1 3927 

1 

633 

0 1403 

3 

K43 

0 11223 

31 

15923 

-0 |7K 

32 

16602 

(1 311S 


Ii 13. desired lo design a conlrullcT to aciivdy damfKTi ihv 
first mode wKilc mainiaming lotal sysitm siiihilih ihc 
modeled dynamics are assumed to he asscxiaieu v^nh the jirsi 
mt>de only The uncerlainhes in Mi,, h, amJ jrc itemed 
here as paramcicr uncertainties and the part ol the system 
assoaaicd with the higher modes is treated as urmuKklcd 
dynamics 'Ilie Iranslcr function dcseription o( this nnHiel is 
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Pt, 
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hrh, 
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I he Ixiunds on the individual parameters arc rt.idiis 
obtained utili/ing the previous assumptions i ac lltai lOKh 
[or details). 

[he transfer [unction ol ilic actual svsuni is (.iv| 


^ ri',(' ). where 

I I 

(iAs) 


h ; v' 
-v" 


r I,:. 


IK') 


rhcrefi'ie i[ we let (/(v) - A('') then we obtain a 

description of unmodcicd uJiiitn't’ dsnarnics ,is A| v) 

t: 

The magnitude aruJ phase o( A(|M>f, lor ivpiea) n> 

b, and are ilcpieled in Fig 7 Although the exact fdots 
depend on specific pararnelcr values, the general shape ol 
these plots arc the same for all fxissihlc i/i, and values 
We choose 
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Mthtuigh fess eonvers alive fs^mmh t»n can K' gefiemied «( 
the exfxnse %«( mote nvvoKeil cakiiUtHsns we fkMiiui theu' 
Krufuls satolaslors foi oui jnrr|>i»scs We note that the 
trarish i lutktu>n t I M Utgriher with the h i 11, given in (U) 
saiislies the ionditions d Iheorem la 

Wc oht.nn n design model as u rrali/ation of 
i • / (> ./?, I This miHiel drjH'mls on ihi: paramriei 
vector /» (/», /', ) whiifi lan \aiv over the MM tl IF, * 

II, A hrsi order i iuiliollei 

(irx*) 

X 1. 11 I 

IS vlt.signed hasrd on this inmfel file cnrtiiollci (noamelers 
an cfu'ven U’ be a k) and X 700 In salivtx the design 

goab Hu \K>Mi)fiH>p iigensalues loi the nominal system 
an : VI 7; IS ss \ i;,, vt, 4o om * v;4:,; )i 
ofiseived that moo than 17S dampnig has been achieved in 
ih{ Ml si mode 

lo ('line the siabihtv ol ifu ailual closed lo.^; system it 
siilluc'' to show that the i loved loop design riuufel is stahle 
for all [>«>ssddc paraineier sanations lo .'niornplish that we 
corivhfei tfie iharaitensfn (Vilvno'tnal of this nuwfel and form 
IIk (oui Khanlomu jVtdMionuals tKhantonov 1M7H) as a 
him turn Ilf f-»^ H> applvitrg Kooih s siabihiv Cfitenon , we 
show ifiat eaifi ol ih< sr loin polsnoimals is slvildt foi ;dl 
( 11 ^ (sec I liar K>K.K lor details) Heruc, Mine 

n.W In Mtaraiimn s Fheomn (Kharitonov, P>7hb 
»se vonclutK that tin closed hMiti design model is siahU' lot 
all paraiiKlci values m tl 1 hfs guaianieis tfie stahililv ol ihe 
actual loiiirollcd svMcm I In ifu exti nsion n( I hcon rn hr lu 
(he L.isc ol additive urn ri laintv ) 

Ihe cigenvaUu s ol ihr Lloverl hHip vsstCIll with the 
eonliollci (l(»al (IMd applied to the bdth oidei liuth 
model an also c ih ulan d loi veninatron (urrjwwrs Selected 
eigenvalues an; ; V) 7 i, IS Sf. t 1 ,’(> VS* <. 7(n 1 

nU 7;./ 17? 4 4 K*';77./ I V4 7 t |f»r4il/} It is oli 

se rveil that the dt sned damjung m (he hist miwie and ovcndl 
si.ibililv an b.>ih athn ved 

4 ( MTM/mroM 

Modeling of uni.iTiani iKiiimtis lor robust loniroller 
elesign in stale space ha* l»ier» disciissiol li has been shown 
that, under rrnld coaivhlMMis on uncertain dyrnirriKs. it is 
fxjssible to obtain a rational I FM possibly dependent on a 

paiainctei vnior whufi vanes ♦>\« i a subs4 I ol ,i finib 

dimensional real vett 'i spai c to repn sent unceiiain 
dvnamic'^ I uithcrmon m nianv praclual eases uneettain 
dyn.irnies i an lx leprestnb'd )n a relaiivcb low order IFM, 
(ven if the a«,i\ial dvnarnres are ol very high order Ihc 
pnweduic of determining saeh a II M has Ivecn diM ussed h 
has Inn n shown that a conuoDt r wdmfi siiil»rfi/cs lire nominal 
system, nnluding such a repreventatron o| uiKcrtwin 
dynamics also stabi!i/ev the aslual system I uTlhermoie 
desired fXMformaryet. or relutivr stability can alvo Lie 
guaranteed 

(mec a paramcicf depcmknt rabonal IFM is O'fMairii'd fo 
describe the uneertam ilvnamics, a piirarnctcn/cd slate space 
dc’ijgn m<xjcl lor the overall svsiem can be obtained Ihen, 
alreaiiv imsting mrlhixls can bi' uv:i lo design robust 
Cfmirollers Fhe picsenteil a|*proach gives a unified 
framework for the Mdiifion to fhe rohucl controller design 
problem for s\ sterns with Urth parameter urKer tain tics and 
uncertain dynamics 
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Robust Absolute Stability of Lur'e Control 
Systems in Parameter Space* 

A TESll ami A V|( INO^ 

Key Worts— AbM'lulc suhiluy, control wMriiiN. I’ofHn ciiKiMni. lohnM 

variations; uncertainty sets prrsitivc rralncvs 


\biiml—r*"’' P*P" ‘**^“*’’ prohlein ol robust 

bsoluic stability analysis (or nonlinear Lur e conir.il syslems 
' the presence of system parameter vanalions Ihe well 
n Popov criterion (or itbsofule stability is used in oidci 
i„'charaeicri/.c the boundary o( the te(!ion ol uKoluic 
i ihilitv in the parameter plane when the eoetltcicni-. ol ihc 
iranslcr (unction of Ihc linear plant arc polynomial luiKlioiis 
I ihc uncertain parameters Kor a scalar parameter, a 
"n-ilHHl is Riven to delcrminr Ihc maximal interval o( 
l ,nalion around a lixed nominal value ptescrvinK ..bsoluu 
Si'ability This result is also used to derive a lcchnii(uc Im 
rhcckinK absolute stability of 1-ur c systems will) parameters 
•n Kiven planar uncertainly sets Numciical examples 
shovsmt! the application of Ihe melhod ate re|>.iied 

1 InirtKiuction ^ , 

1,11 KFNI WM) inlcrest in the problem ol Imeai 'VMcrns 
siahilils analysis in parameler space in Iasi years has bioutihl 
,„,o lashion much of Ihc work done since several decades 
a^.o in linear and nonlineai syslems ' 

Uce CB Ncimark (l<t4<» and in pariicular Sil|ak ll ^ . 
IWni) for extensive lists ol relerences on " . sub,eci| \khi . 

I ureal number ol eonlrlbulions ha apfKareil rceiillv . 
Robust siah.l.ly analysis ol linear syslems aBu.nsi 
(Knurbalions. there has mil been a similar v'l« h 
,re. ol n.mlinear systems analysis and control One ol Ih, 
mlin ,1-arons is eertainly ihe fae. tha, while (or Imea. svviems 
necessary and sufitcieni conditions lor asyrnpumc stal 11 y 
arc wcll known and rclalivciy simple, on the whole, in ihi 
nonlinear ease usually only sullieieni 
asvmp.olic slabiliiy are known A ptaei.eal '"^h ' 

ihis (act IS that in general il is not possible lo ^ 

exact region of absolute slahiliiy m paramrki spas 
However, rclalivciy less eoinplieatcd is Ihe ^ 

subsets of Ihe domain ol absolute sUbiliiy In ins 
,e-eogni,ed as a widely open problem) lo " Z 

extern these subsets approximate the m.e ^'*7 ''I,,, 
d.,ma.n, i.c how far the available abs,)lute siab.hu sulbsteni 
kondihons arc from being alsi) ncccssar> 

An imptnlanl class of nonlinear eontrol 7 

l ut e I’ostnikov syslems |sce e g mlials " siab.liu 

svslcms, several sallicicnt condilnfns Inr ri ^ 

have been given since ihc beginning ol '|'‘■77•nnmbul.ons 
Narcndra and Taylor (107^), also very tenn 
can be found in the lilcralure. e g Voronov ( Hi ht 
most widely used sufTteient condition u undoubudlv Ihut 

• Received ,M July 1MK9; revised 7 

in Itnal form 9 April 7'. P/" Wmld < ong.ess 

pa|x*r was prcscnlcd al iht Inn ir ‘or 

lallinn, Estonia in 1990 This paper vsas r 7 mmc 
publ.eal.on in revi.scd form by Assoeiau I dib- 
under the direction of Editoi H Kv»a s'^7'7 1 jriiversiia di 

I Dipartimcnto d. Sistem. e fnlormabu • m|vcr 1 

Tiren/x, Via di Santa Marta.-I-Slll-^ '''^I' nee should he 

t Author U. whom all " \„..ea c 

addressed: Prof. A. Vicino, ijcgli AhruCTi 

Informatica, Polileen.co di Torino. ( so f>uea ilcg 

24, 10129 Torino. Ilaly 


slated bv llK lelebuiled P.M’»' ‘'denon (Poj*ov, 1%.) Il'"' 
eond.iion leJutes the abstvlute sMbil.iv pudvten. b' pox>ti''e 
lealness ol a vu.lahle l..iKl.on of IreMOemey Tcw 
amlr.bulioiis lo the sludv ..1 |>.Mli\e lealmss m ihe pixscnte 

ol paiamemt unecilainU .an I'*"'"' *^77^0, 

li.e.a.uu Host ,,..tl I'clanskv ll9«9. give easy 
cheek |v,s,l.ve icalness ol a .al.onal '“'blon wh.am 
m.men.10. and I)r..o.n.i.alo. |k.K*, 
,v,lv,«..nials li, suck II IS shown •"’* 

the tlom.iii) ol |s,silu.iv m (vsivnoin.al voefluicnl 4a 
.dlowv on. 10 t bet k ,h.s.i.v.U ol « iw'lvlof^ ol I"’ 
bt c.mM.le.mg only lU vcit.ees In pinoeulm. .1. Ihw woi 
impbeat.o.iv ol ihis lesv.ll on ihe sludv ot -hUM alvwolM c 
.ud'il..con.) tlavsev ol ,w.lurlH-d 1 u. e wslems are 

'' hi'On! papr. we eoiuide. t uT.- Uim eonliol svxlemx in 

uhieh eilL. Ih. Iinea. pml .s afloU-d by 

un. erla...l.ev o. ihe lec.lbaek m.nl.imanlv sritoi <s 

To, these easev we give an analvbeal n.elhotl to *lU‘1v ibe 

robus.ncss ol absolute s.iib.li.v in the late ol 

when one tu two phvs.tal paiain^e.s 

Ou* uwHrf.l vvsiem Miwc p^Ciisrlv. wr u.bi fht lo|lowiH|it 
pn'bicms 

. ( onsi.lei a I u. e svsui.) woh lee.lbatk nonUneanly in a 
mestobe.l setlo. ami isith Iht Imeai pml liansle. lunelnm 
.. Slab tt,u..lu.n inal.ix 

cc ,|a. pl.vMtal ..nte.lam pa.aineie. .utoidmg lo (a lynmn.al 
luml.orts l.ivei) a nommu/ value ol Ibe paiamelei loi whuh 
Po-.o .„.,..,oii U s„l.vlie.l lantl hem. ibe sys.em is 
'bsolu.tb labit . .umpule ibt max.inum i.iU.val around 
ihis value lo. whuh Iht I'oivov erib-.u... tv s..l,sImt 

The soliilion ol ihis p.oblem p.ovutes a .cgi»» ' ' V 

cabil.u winch ,.) . .. md Ih. out one tlue i.jhe 

k .,, .tf Li»nvcjv.invriu 111 llu' uiirrt<m A um 

I nii ic'l out s wbt n Ibe nonlttieaitlv set bn irprcitenl* 

c|x-e,al,nb.cs. a.ut-wn . „i,,„ *,oth can be 

'gtn'a gl'phn':i ;‘oM .. le.mv o, ibe wt:., known Po,k.v 

f I Ou im. IT pat' il isvlitiwii how Ihc pio(u*«:.l geneia 
'::;:i:;ica, ;:::ii'.b ... how .1 .a.. 1 . .merpreicd 

ic.ms ot ll.f l'■.I'os hwi.s II. Ihe cunplex i.lanc 
. I ,v.n a I m e 'u'* "' ■" 

I t.iri-irntt Ivtone Ih" '“o phvs.tal umcrUm) pataim U is 
; ; m I) X I .nu se. alt .nvolved cheek d ihe P.^x- 

" mbvl.t'f h" -11 paran..:b. val..es ibe umcrla.n 

SCl 

Ihe ..ape. .s o,gan./ct1 as loH-*' ^ prexenl. 

him. lormulation anil basic results necessary lot the 

MKccssiv.; drvel..pmcT)t Sceli.m' ' ami 4 solve "*« 

\ ff (he twf» respectively, while .SetiMWi 

“ resins 1*0 numer.cal examples showing Ihe appl.cal.on of 

the propfi^vfd mclhfKl 

a I’rMrm l„rmulali<m and hmit frau/l. 

‘ We cmsider I m e iy|vc control syslems » .ven by 
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where JT K”. AfH'* '*, h, r f R", /(');K-*R is a 

aintmuouM function bclongjng to the cK'uim defined as 
follows 

yfiy ) - ^ 0' k < x) (2) 

Ixi US introduce the transfer function C/(i) 

f.Tr)-f '(./-M) 'fr -y'- J (3) 

which represents the input output realization of the linear 
plant in system (I) We make the assumption that the linear 
plant {A, h, r) is controlluhic, observable and asymptotically 
stable. Hie l.ur’e control system (I) is said to be Ahsoiuteiy 
Stahtf (AS) if the equilibrium slate x <) is a.symptotically 
globiilly stable, tor each / ( ) c 

It is well known that the furidamenlal Popov's theorem 
(Popov, l%2) provides one of the most widely used xuffineni 
con^itiKtm lor (I) to he AS in terms of the sector bound k 
and the transfer funelion fj(v| I he following theorem slates 
the Pofx»v criterion iii terms of a polynomial function. 

Thfortm. II there exists a real fir H such that the following 
inequality holds 

/'(ft)’) -■ |//()ft))|' I* ' I Re|(l + )ft)«)(;(j<j))|) -)), Va).?0 

(4) 

then system (I) is absolutely Mahlc □ 

I'hc above theorem relates AS to pootiuiry of the 
polymnnial P((r/ ), which will he called Popov polynomial. 
We recall that a polynomial fix ) is said to be jrosilive if 

fit) U. Vi r R' 

h i.s clear that the sfudy o( robust absolute slahility against 
possible variations of parameters in control systems (1) is 
equivalent to studying robust positivity of families of 
polynomials with perturbed eoeflicients We denote by 
p t H" a parameter vector and bv /’(m ;p) the corre.spondmg 
PofHW fiolynomial with eoeffieients depending on p Several 
variables can be mlerpreled as parameters in P(<ir;p). 
lypieal eomfuments of vector p may be physical uncertain 
parameters entering the transfer function eoeflicients (an 
iiiu'criain transfer funelion will be denoted by f/(.v.p)) or the 
liriciir plant Mate matriees, the sector hound k or the Popov 
parameter (I 01 course, lor a (ixed sector hound k, the 
Popov condition (4) can he easily extended to include 
parameter dependence as follows 

l or a given iineerlaintv set fm parameter space and a 
(ixed sector hound k. the I lir e system is AS if the following 
conditions aie verified Vp e ( 

(i'(v;p) IS asymplolicallv stable (5) 

9fl e R .p) ■(). V(ri -(I (6) 

W^c eonsider the case in which the eoeflicients of (i{s,p) 
dejH'nd polvntontulh on the parameters p Under this 
assumption, the PopHn fHdvnomial to fu’ tested lor ('Kisitivity 
can be exfircssed as 


Unfortunately, it m rather difficult to transform (he above 
definition m an analytical description easily usable for testing 
posiirviiy of a given uncertainty set However, if 

coefficients fl,(p) arc linear in p. then D, is convex. In fact, 
it follows from (8) (hat if p' and then 

(I - X)p‘ + Xp'" € , V e |0. 11 This consideration allows to 
conclude that positivity, and hence AS, of polytopcs m 
parameter space is implied by pcmilivity of the polytopc 
vertices. This important property for a p^ilynomial can be 
verified by a Routh-like test (Sil/ak, 1^71) Unfortunately, 
the linearity hypothesis re.siriets the applicability of the above 
result only to very special classes of problems, where 
parameters p, enter linearly the numerator coefficients of 
(jU, p) 

To investigate the polynomial dependence case, we use an 
analytical description of sets including 3D, Consider the 
envelope E(p) of the family of surfaces in parameter space 
generated by the equation /'(t/z ;p)-0 for fu 0. Such an 
envelope, if it exists, is dehned by the one parameter family 
of real solutions of the equation system (Siljak, 1%9) 

I P{ur ,p) = I) 

/ , . 01-^0 (SI I 

1 (:?/'(oi‘;p)/c?o/I) ^ 

where m 0 is the parameter. 

Excluding the special case w - 0 (which can be accounted 
for separately) and setting U - to', (9) can be written as 

/■,(li,p)- V 0,(/))tJ' = 1) 

r", . a (10) 

/;(«;/))- ^ () + 1)0, ,,(/))iJ' - 0 


The first step we lake now is to give an implicit 
reprcsentiilion of the envelope E(p) 1 his can be done by 
using a well known theorem on the rcsullant of two 
p<»lynomials in an iridLqiendcnt variable with indeterminate 
coefficients (see e g. Jacobson, 19<>4). By considering the two 
polynomials in (ID), we define the rc.Kultani of f, and F\ with 
respect to the inilelcrminale 12 as follows 

RJp) - iiel|//(p)l (11) 

where the matrix H{p) f- R ' is given by 


Hip) 



n iD'l 


*',)' r 1 



II 




■‘,,1/') 


II 

II 

iD') 

:</o 

% i(ro 

"ill 

ruj^1p ) 

(n 1 )u„ ,(/’ I 


II 

(1 

(1 

II 


laAlO 

<1, OM 

II 

II 

L n 

II 



0 



( 12 ) 


The following theorem allows one to solve system (ID) 

Theorem (sec (Jacobson, 19b4) lor a general siatcmcnl]. 
R^ip) - D if and only il one o( the conditions occurs 


/'(fir'.p) V (7) 

where coefficients a,!/’). i D. 1. . . n are jxdynomial 

functions m p 

We will assume that eontlition (M is satisfied. In fact, this 
a,ssiimplion can be checked for several classes of 
perturbations (see e g Hhattacharyya 1987; I'csi and Vicino, 
I9KH, Vicino, 1989) for the case in which parameters enter 
linearly the eoeflicients o. (i'(v;/U and Sidcris and Peffa, 
1988; tienesio and le.si, 1988. Vicino et «/.. 1988 for the 
more complicated case where these coefficients are 
psilynomiai or rational functions ol p) 

Ihe di>main ol pt)\ih\<tt\ /), , whose boundary is denoted 
by 3l >,. plays a key role 

D, ~ {;> f RVr(M/\p) >0. Via eO} (8) 


■ u„(p ) ~ 0 

• The two polynomials have a common root in a suitable 

extension field □ 

As a consequence of this theorem, the envelope Tip) can be 
described as 

T{p ) = A'^(p) U A„( p)U EJp) (13) 

where 

and BQ > 0: Ai(Q; p) 0 and E.iQ^p) - 0) (14) 

fc„(p)= (p£H“:a„(p)-0) (I.*') 

£„(p)= (/)eR‘':fl„(p) = 0) (Ift) 

Oh.irrvalwn 1 Observe lhai p t f^Kip) if and only if there 



Brief Paper 


m 


o - 0 which solves simuluiwsjusly b<Hh cou*tHJns .n 
,1,11 Since the second equation in (H)J n ihe dcrivai.ve ol 
,lvc (icTit one soih respect to B. it follows that wrespondni* 
!o p t f»(P) «»« polynomial must neccssanlv hav* 

j ,ero ol multiplicity at least 2. Moreover, il has 

a fixed p. f poMlivc real ecros (U,, ,Bj 
wiolupiiciiy {ft . ft,) 2 ) rcspccliseiy, then the 

rouliani Rolp) has at p a zero ol muliiplicitv ^ p r 


'*?. ***^ ******' I'lani IS n 2 in n ,t In lass. Iwun 

ODUrrviiKwi i i>f 2 ti {h«t for ri 2, J 

niu»t ntetkUMt) Nr Kvi n ^ V »< 

*ml imK if iHrit ctiMk n p mkH iHjh llw pi4yf«t>nuai 
0 in \lic imkftfmiiuie U hM iw imly 
riM>i muUi|iklicii\ > 

riir bii (.niitc^l Hi V,t ;' I ih hv loi iruf 

ol iIk }'Hko rouviUoft WAitmsi. 

ti\ IS. 1(S)< 


^ Hobusi siahiUty agOinxi scalar prrrurhasums 
In lhi> section wc give u wiluuon in ihc MUiwing proWern 
[x\ i Nr a fued icefor hound aivd p -^^1 P.T « vector wnh 
/I, fcprcscnling the Popov parameier 0 and P: a phvsical 
unecnain parameter entering pnlynnmiaJlv m swem miiiru 
,4 and/or vectors h. c Ixrl a nommal value of the parametri 
p. ^p'l be given (corresponding to the nomtnal linear ptant) 
such that the Popov inequality (4) is satislied 
With reference to the perturbed Popov polvnomial 
r{ur,p), wc want to evaluate the maximal amnetird 
domain of positivity ol the variable p>. containing ihe 
nominal parameter value p'l. lo do this, we coniskk'i 
equations (13)“(I6) defining the envelope containing 3Y). 
l irM of all. observe that Ihe Popov function is Imrur m p, 
and polynomial in p^. s** lhal Pfiu ;p) can N* written as 
lollows 

p{nr\p) =^/,(ci>^p..)p, ^ Uur'.p,) (17) 

where ) and /,( ) are suitable jxilynomial fuiKiions We 
select the extremal values (v| p, considering fxiinis m the 
plane belonging lo certain sets, called cnikar sets For 
simplicity ol notation, only the ses'ond components ol the 
corresfKinding fKiinls will he included in these sets, denoted 
by V,(p. ). / ^ 1. 2. 3 The first ciiticiil set .S,(p d is obtained 
In collecting fximls in the plane (Pi.p.l belonging to F(p) 
and .vatisfying necessary conditions for the existence t»t a 
horizontal line (parallel to the axis p^) tangent to itp\, i e 
such that 

I /*(ifr’;p) - 0 

3Pi<ir'\p)/3p, () (’K) 

3F(ur \ p)/3of - 0, 

H\ subsiiiuting (17) in (IS), the elements p . l>elonging to the 
(irsi critical set Syip.) can N’ obtained bv solsing the 
following I'Hilynomial equation system 


|«vi<r. p.i-" ,,, 

i p ) ■'= d 

and sclrcimg as elements ol Na p; I onU ihiivc wdutnvris 
whivh solve Ixnh tquHUOfiv (lit) vimuilancoiyvlv lor ixisiiivt 
vidur> of 

Dehm* ikiw the following sets 

3lP;l .s,i p^ L V’lp.l ‘ Vdyy ) \ 2 A) 

let us now introtvIiKc iht itelmiitnn id an ‘ cxiiemid ikuin 
of the paranieici phiiie NVr v.iv ihsii a jh^uu p tpi P:3 ol 
the plane such ifiat p .* Vip/( is cvtreinal d it saiisfies the 
(wo pfo(H'riles 11 uul 11 

I e P{iti /> I IS niumegalive 

II, 

Vi I! urbitraiilv small /j I/>, * p ) f l\ 

and /» ■ (/>,*» p ] i i>. 

I c f*(tiii p 1 and /’(ill ,/' ) J4tc not (W»siit\c 

f)bvrrvr that tbesi pTO|X"f!u> can be nisilv chciked bv 
mraiiv id algcbraii imnncg.iiiviiN (rslvtSdjak. Id7ii 
let us dcline the extremal set SJ /< ) as lollows 

) [p-f '‘UV ^ (/'1 /> ) ts c\lf (‘tiial 1 

and the two subsets S'^ip ) and N, i/'-) as 

3 j/M ip, ‘ \>P • P /'■) 

,S J// ) ip f SJ ft .) P ■ p\'l |?.b) 


I ; p.) 0 


(Id) 


Observe that, once the aNive system ha.s been Milvcd for p, 
and m. Ihe last equation in I IK) provides, if desired. Ihe 
crrrrespondmg values ol p,. System fid) can be solved by 
using the resultant theorem reported m Section 2 In 
particular, m this ease the rcsullani ol the svMcrn with 
respect lo the indcierminaie or depends only on p,, so thzd 
we need to find real solutions ol the equation 


and the following quanlMirs 

/»'’ max p' 

. \ ( /. ; t 


p T' inin p 

r ' 


(27) 

CHI 


In the aNjvf equaiions pf \ w vei to ^ ) i( the set 

A fp JfA.I/' I) IS rmpt\ Assminng liial f/h./r) is 
asyrnpiontaily stable loi p t fp'" /»'') lh<" following 
theorem follows rcaililv from the prt vnms LonsidctalM-ms 


f<„MP:) del l//(p,)l 

and choose only those which solve simultaneously Niih 
equations (19) for some p<isitivc value o)' Nonce that A/( ) is 
defined as in fl2). Of course, Ihc two special eases ut ~ 0 and 
in ™ X. rnusi be considered separately, since in Niih eases 
degeneracies of the equation system (19) (w.:cut 

rhe second critical set S^ip^) is obtained by lomputirig 
cntical points of /?u(p,. p.) - 0. i tv self intersection ptunlv 
the curve of /?o(p,. P;) - 0- I'hcse points arc obtained by 
imposing that the gradient of 

aA?„(p,. p.)/«?Pi ^21) 

3Ru(P\^ ^ 

Again, the resultant theorem allows one to solve the aNwc 
system. The critical set .Sii 2 (p 2 ) includes all .solutions p^ of 
(21), which solve also (10) for positive Q 

f^h.tfn,»aiio/i 2. The above conditions for the existence of 
solutions in become of easy interpretation if the order 


Theorem I“hc pafiimdcr iini crMinlv d<»mam ip'^' p*') ‘s 
the maximal umnrcicd domuiii of ab^duU Mabdity. 
according to the hqxis critcrum ooniaimng the fiorniiial 
parameter for a given 1 ui t* conirol svsirm ’ i 

Notice ihai maximalitv of ihc domain of atwiohilc slabibly 
computed aN^vc docs not riiHCssardv mean ihal il is not 
possibfc to extend Ihc interval fp7 , still preserving AS. 
hecause the FofXiv torulition is vufftticni but mil nccevsary 
for AS 

3 f Mastmal sfcU»r of ahs\fiutf Orrhdifv In Ihis vubwe 
lion, we hricfiv show how rhe prtxedurr given before 
vtmplifics when we umsidcr (he Sfiecial cave m which the 
parameter p, reprevenis Ihe recipriHal of the Mrcloi Niund k 
In this ease, we assume f(»r coherence with (7) that IN* 
allowed minimum k iv n and aaordingly p' We want to 
rsiimate the maximal A for which AS ix preserved according 
to Ihc Pojxn criterion 

Ilic Poprrv polynomial turnk out to N; finear in Nrth 
parameten p, ‘ i*nd p. k ' f'hc envelope equatioru 
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(10) hccoftur 

u i/<a0|/',(o/)/j, 4♦^/y«>‘)i -O' 


where fli ), t 0, 1, 2 denote *ir^l derivatives with respect U) 
to. Fnlynomial functions /,). /,. f, have an easy inierpretaiion 
in terms of the frequency respinsc In particular, 

setting 


. .. , A/,(jrii) i jjVjjw) 

I / (I f</1 ' 


(VJ) 


it IS easy to show that 




file above equations allow one to give a graphical 
interpretation of the critical points in terms of the Popov 
I(k:us in the cornpIcM plane (Siljak, 106*^) In the parameter 
plane each curve of the envelope is a straight line As a 
consequence, the set .V,(p.) may he readily obtained by 
computing the real fxisilive solutions in‘ of the polynomial 

(I ,.,2) 

and then computing the corrcsiHinding snlulions for p . 


fi', - - <J^’) 


(33) 


Notice that Irom the second equation in (31) solution 
frequencies lu, correspomi to points where the Po(>4iv locus 
cri»sses the real axis 

( omputaiion of the solutions lu-longing to (he critical set 
Stiff i) d<Rvs not simplily significantly in the s|>ecial case 
py k ' fhese solutions correspond to inierscciioiis o( the 
real axis with straight lines admiiiing possible rnuliipie 
tangency points with (he Pop<iv plot tn fad, these solutions 
represent critical fwiints o( the curve Ku(/> i. p ) - b, le 
points such that there exist at least two difTcreni values ol 
Ircqiieney oi salislying the envelope equations (2^^) 

Ihe set Syiff ,) can be readily computed because the last 
equations of (22, 23) are linear in p,. p ,. so that the solution 
of each of (he two systems requires to solve one polynomial 
equation Irom a graphical fsoint of view, these points 
eorrespond to lines passing through one of the eml poinis ol 
the Po[)Ov plot and tangent to it at that point and/or some 
other poml(s) 


OhsfrvaiKfn 3. I he feedback gain interval |(). k,f) lor which 
the linear system (V(.i) is closed loop asymptotically stable is 
usually called Hurwitz srvior for system (I) It can be easily 
checked that if p7 ^ •*'i(A’;)- pT 

sector coincides with the Murwity secioi Hence, the Popov 
criterion allows one to conclude that the well known 
Ai/erman conjeeiure is true 

An example of eomputalion of the maximum k for which 
the I ur’e system (1) is AS according to the Popov critcriim 
for a classical example taken from the literature is given in 
vSection 


4 HohiLH ahsifiulc sluhiluv /or planar unrerm/rirv rerv 

In (his section we assume that the sector bound k in (2) is 
given. We consider the case in which the components of 
vector p e R* are uncertain physical parameters alTeciing 
polynomially the eiK-ffieicnls of (iiwp) (or the entries of 
(A. h, r)). Let the uncertainty set be defined as a rectangle in 
the parameter plane 

(y,-(peR';p;-.p,-spr,i.. 1.2). (34) 


sides of the rectangle. i c setting alternatively p^^p', (or 
P, "PT)' ‘ ~ 1- 2. possible intersections can be computed by 
applying the prcKcdure given in Section 3 for each side 
Step 2 1o check for absence of envelope poinis inside U^,, 
we have to verify that the polynomial equation systems (22) 
and (23) have no solutions belonging to t/^. Moreover, it 
must be checked that the following polynomial equation 
system 

^o^Pi. Pi) ^ 

- (35) 

(or 3KuiP\ Pi)^^Pi ^ 

ha.s no real solution in V Notice that if we denote by ,Vj^(p) 
the set of solutions of (3^), only the following subset must be 
considcrcil 

S'uip)-- {SJp)nE(p)). (36) 

From a practical point of view, system (35) can be solved, 
as shown for other ca.ses in Section 3, by applying the 
resultant theorem 'fhe set 5^(p) can be computed 
immediately selecting s<»luiions pf^Sjp) for which there 
exisl.s some jKisilive real value to solving simultaneously both 
equations (^)) 

A.s a last observation on Step 2, it is worth noting that if 
for a fixed value of the Popiov parameter the lest fails, i.e 
the set slip) is not empty, we have to perform rhe lest for 
dillcrenl values ol (i Hence, in general ir may happen that 
Step 2 must be rejscuted for all real value.s 0, meaning that 
the solution of a family of problems like that solved above 
may f>e needed 

As a final comment, we notice that since the Popov 
criterion is only suRieient (or AS, the fact that the test 
proposed fails in assessing AS of an uneertainty set (./, in 
general docs not allow to conclude that system (1) is not AS 
for p f/ . A negative answer of the test would mean only 
that the Pop)v enierion does not allow one to assess robust 
absolute stability, so that other alternative enicria should be 
employed. 


Numcni dl examples 

In this seclion we present two examples showing 
applications ol the re.sulis presented in previous sections In 
the first example, a well known system is considered and the 
maximum Popov sector is computed In the second example, 
wc determine the maximum allowable uncertainty domain 
for a scalar parameter affecting the linear part of a lan e 
system, for a presenbed clas.s of nonlinear functions 

iMumple 1 (Narcndra and laylor, 1973, p 173, Safonov and 
Wcytzner. 19H7). Consider a Lur e system where the linear 
part is dc.senbed after a pole shifting by 


(V(v) 


+ i' + 25i' + ^s + 3 ' 


(.37) 


From standard arguments it follows that the Munoilz sector 
IS |(l.7) I’hus. by defining {pi.py) ■ ((^. observe 

that we need only consider values py in the interval 
(0 I42H5,*|. Moreover, it cun he easily checked from the 
structure of Pinr .p) that the point |p|. />,) - (0. ^) satisfies 
the Popov condition (4). so that we can assume as nominal 
value A>:- ^ 1 he functions /,( ), i - (I. I, 2 in (31) arc given 
by 

I /j,( w* ) - '"66iir 9 

f,(r.r’)- - 3(i»"4 72ai' (38) 

/,(aj‘) - - 49iii^ 4 h25n/ - 141 4 9. 

From equations (32) and (33) wc obtain the .set 


Assuming that >fp t the linear part of (I) is a.symptoticully 
stable and thal f/,, contains iit least one point p ^ a^" for 
which Cr(5,A») satisfies the Pop<iv criterion, absolute slabilily 
can be studied in two successive steps. In a first step wc 
ascertain if the boundary 3U intersects the envelope Eip). 
In the .second step it is checked if there exist piiinis of the 
envelope in the inierioi of V^,. 

Step I Wc liHik for possible intersections of the rectangle 
sides with the envelope E{p) given in (13-lb) Considering 


SAPi)^ {-1.0.14285). (39) 

The envelope equations arc 

( F,{a.p) = p,a^ - (49p; + 3p,)n’ + (62V.- + 72p,)Q' 

-(I4lp, + 66)ll + 9p, + 9 = (l 
Fjia.p) = 4p,tj’ - 3(49p, + 3p,)U' + 2(625p, + 72p,)Q 
+ (141p, +66)----0, 

( 40 ) 
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Pi(, 1 Popov line for maximal absolute Mahiliu secior u( 
Example I 

Since ihc degree ol polynomial h\{U\p\ m U is 4. (rom 
Observation 2 of Section 3. we can eupcct ihat !a;l! 
iniersccrion points of the envelope may cmsi In (act 
lompuling the resultant and solving; t21), we* 

obtain the set 

{~1 443,0 37} HD 

The !ict SMpj) obtained by solving equations (22) and t2M in 
given by 

S,(p,)^ {-[.()) (42| 

f rom (3y). (41) and (42) we obtain 

,V(p,^)^ (-1 443, - 1. 0. 0,142H\ 0 371 |43| 

f he extremal set SJp.) is obtained by checking pro|XMiies 
II, and FT 

SAP2\- (^ 137 ) 


Hence, we select pj '' obtaining ihai ihe 
considered system is AS lor A t [0. 2 7) I'hc corresponding 
values of and m for A ~ 2 7 are lound to Ik N ■ 0 7H1 and 
ii>, -= 1.54, fij^5 24 I hcse two values ol fi> corrcsjsond to 
the tangcncy p<iinls of the straight line dchncil hv k 2 7 and 
H " 0 7H1 with Ihc Pop<iv Iikus (sec Fig 1) 


Example 2. Consider the system described by the transfer 
function 


Gispj) 


II 

( V 4 1 )(V^ 4 P .1 + Ml 


144) 


where p^ is an uncertain parameter with miminal value 
p;“ 10 and the nonlinearity /( ) 4 with A ^ 1 From 
standard arguments, we obtain that the closed Imip system 
with a linear constant feedback with gain A - 1 is 
asymptotically stable for (I, As in Section 3. we ver 
Pi - & The functions/,( ). i - 0. 1 m (I7) are given by 

17)o/t(52 ~ ]]p:^ pl)or^ IKO 
I/|(^u^ P 2 ) - " I 1 <ij‘ 4 11 (9 4 p. )ti/' 

From equations (19) we obtain the set 

.V,(P3)- (d. 1| 

The envelope eqiulions arc 
rf,(Q;p) = U' + (p^- lip, - 17)Q’ 

+ (/?2Hp, P; - llp; 4 99p, 4 52)a 4 IKO - I) 

I F2(U;p)=. 3K"4 2(p^- lip, - 17)U 

4 (p^+ llpiP? - llp;f 4 99p, 4 52) - 0 


From Observation 2 in Section 3, we notice that wocc the 
degree of the polynomial E,(t2;p) m U is 3. the only po*wblc 
points belonging to the set ►S^fp;) must ncccssanly yield a 
triple positive solution for Q in A,(U,p ) Fhis cannol hapficn 
because ajp) = 180 >0. Hicrcforc. the vei Vdf’ 7 ) empty 
This can be also verified by computing the rc?.uliant 
^u(Pi.P 2 ) atwl solving (21) 


AJwi the sc*. S,{p A lurm out to tx empty breaUMr the 
cx<fhciefii\ a,,(p 1 aiK! a,(p► m“st‘r vani»li <.\m#ieq|«cnily. the 
-Vp.) IS to A,ip4 and ID Hence, we 

tvbtain, p“ - 1 * obiainmg ih*i iHr oouvnlered 

I ui e system i\ \S hn p * U * » fV oorrciqvittiiling valuen 
ol ff and a, ttw p , r \ ^ (t > ,* y Jfi2 

h t onc/xui^nu 

In ihts paper an MtialyixAl mertuHi u pmfxwwsd fix rssfHiiit 
absAslute siabdtty analyst' (»( i ur‘c ixmirot svxteniv subject to 
parameier vHnatxms Mk* cave where vvstlein pcrturtvalKym 
art: due one 01 iwu urKcnwin parameters has been 
vvinsitkied and a mcthiHl is gis-tn which alhtws tme 
estimate maiimal ol .;«bs44ute slabibtv *» parameter 

space, buMrd ixi the fN»|K>s ctiIciuhi I ufiher rescarth is 
needed in the direclioii id studying f«vhus( abvoluir staNlirv 
by means ihftrieni ctiU'itm which iimv lake uiu> accsnini 
more inlixmatiiUi als ut tfu^ Jeedback nonlinear IvimiHm 
than ihc vector cixiditiinn M\>tei>vcr, ellectivc ntethiHh of 
anjiivMs toi pjoblenn iiotdMng sevrral phyxicsl patameitrs 
apjx'iii i«) \k id primary inteirM lor luuire work 

Ai knonltiii^rmcntx This work w«s paitially supfxirled by 
lunds o( Mifiisiero delLi I nivrrsita c tlelUi Kurrva Stieniifica 
c I ccnologi.i 
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Urjcf I*a|xr 

On the Robustness of Discrete-time Indirect 
Adaptive (Linear) Controllers* 


f-. (ilRI.-i r M M SAAD.i J M DION: j,iul I IX liARDi 

key Hordfc Adjpuvf ctmirol kwrivcr^fcrKi -io.,ii\vis 


Abulnci ' RcniiirkAblc rcMrarch .kIiviis has Kcii avNtHnl k- 
'hc JcMgn Df ccrlainu equivalence bavcJ aiLipine uaiiio', 
krs which fierlorni well in ihove ubiquitous non iJcahurv as 
IxiunJeil (.liMurhances, lime varviii^ paTarmuiv and vmie 
c!asM.N of unmotleled Jvnaniks Hu- long stunding isnui is 
( he fvtimaied rntnlel ailniivMlnlit\ ctaulition i e ilu 
iifulcrlNirig linear eonirol law should slal>ih/t tfic isiinuMcit 
muhIcI Ilic molivalion ol this p.ifvr h lo pro|v>sc a i^cnciat 
tiariiew'ork lor lolnr.lK tJesq;iiin|^ tfu a«l.i|Mt''« liru at 
voiilrolletA. irrespeelive ol the underKiiij: nuitml law M ore 
sfHkilKully a new solution to the piohlcni oi ilu eMnnaittJ 
niiulcl adinivsihilitv using an uJ h>n rnodduaiion <i( tiu: 
s(uilrol law IS gisen Such a rnodifiealion eorisisis m .uKhng 
an internal impulse exciune scijuenii while !ree/ing ilu 
umirtillei parameters. wheiitHcr ihe t siunatcd rnodt t 
admissibilitv IS loM 

1 /nrroJui r/on 

Iminski WlMAKili develo(iinenis over ihc Iasi de< .uU s 
fiave shown that (he MexihiliU pnnided In llu adaplot 
lonlrol IS rernarkabU biuad I hi scinmal resuli- wuhin itus 
(.oniexl were speeiliealb eon..erned wut; iliriAi adapow 
lontrollers. i e model lelctenie as well a'^ single si.iet 
optimal sioehasiie ad.iptivi *.<tni 5 ollers t ouiplcu siabdnv 
and eofivergciue results were ofuaitual in ihis konU.ou anki(.i 
ideal etmdilions the plant it' be (ontreulev! iv o'lnplcieK 
desLrit>ed b\ a line.ir iirne iinanani s\slem -0 km-wn 
struelure. and the .illowahle dislurbaiiees are lhos<- rnoMug 
average ul iiulefHridefii ^'er»» rriean raiidorn variables iset- 
1 uehs ( ) and (fixidwin .ind .'sin (l‘^S4) lor an ile|,MvU 

presenlalion] Alihough these results prio ideil i>eittr 
iheoretieal Lirulerslaruhng "I ihe adaptive lohuoI timiepi 
and led ti> ecrlairi sueeesstul mduslna] .ipplu ations i \str.)ni 
iheir praeliea! mipiiiationv have Ix-en shown io lx 
questionable Indeed il has fK‘en shown that ihe usuUmg 
ehised loop adaptive svsiems tould lx made unstable in tIu 
presente of btuindi d disturbarues 1 1 gardi imik 

v.jryinc pararnetits (Aiulerson aiul lofinstone IOnm and 
reduced order modeling iloarir.ou arikl Kokoiovu juNi, 
Rohrs (’f al . fdh5| Moreover, Jh. mirufTiurn phase ilesign 
assumption involved m ditect adaptive einirkdUis o ni-ne an 
cxccplinn than a rule in the discicte tirrn (.onicit i,\siroin ri 
ul , 1 ‘^4 J 

• Received 10 August revised i June revised ^ 

Januars reecoveLl m lirial torm '' Mioh fhi 

original version of this paper vvas presented a! On IJ At 

V^orkshop On Robust AeJapialive (jaiirol Ncweastlr. 
Australia. August 1"4K,S fho paper was ha oiimu ndeij lor 

pubhcation in revised form bv \ss.o\,ian f ditor^ (t 

Kreissclmicr and M \ Mare< Is unde r the direvtion ».•! 
F diior P C Parks 
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t Now With the Ljbor.itojre d \iii''matique tt 
d Fnfnrmatiquc Induslrrcllc F cob Mohamrn idi.i 

d'Ingcnicurs, Rabat. Moroteo 


Ibt ina|of sut'sequi ni eU vTh»|»mi nts m adapbvr ct*fiUol 
theofv have Ken Uevoiet! lo the pfobletri of picivcrvtng the 
vl.'ib,)ii\ td the jd.iptivr eimltolicis in iqvrte **1 (xuinded 
evutnal divturtNano s as wall a\ him vaiving and uimKwlckd 
vlvnamus [wn rnam Nuefu-•• htm Inm adopied i*» di al 

with such a pioM< in Ihv Ivis^ one leltes uKvn the 
inijiMiriarKi ot the «»sri(r*p; of prcvof/nt r»(il 4 i/ion in adaplivr 
ithnirheviiion tiui eontrol jsea Nainulia ami Anmtswiiiiiv 
I PAS"" i aiul rrlco nivs list theirin| Vlou s|K % ilHidlv. ihr 
adai'tiVk tonli 'Hers denvtsl in ideal vrUiatioits have tven 
shown lo K liKallv stabile in rralislie situiitions provided that 
some of ihi intciruil signals are dornmanilv rich Ihrsie 
siabmiv rrsuhs liRal in naivire poo irted ne a unights alxnit 
ihi iiH.d tviduou'uf ot adaptive i,oiittolleis n- non ideal 
siiuitionv naitu b sharp IvtuiuK Joi hK.ii si^hihty mstabililv 
domains have Ih-cii given (Aruh'iMin ef ul li k 

howevei v*oiih ith nhonuig tJiat tuiutainrntal design 
uuesiions siuh as how |o i nsuo ihr involved (H ivisic’til 
( Venation .iiul tiov* n< enlarge the hn al slabdiiv doitnun 
fufst noi VI I K < n M'lveil Ihe seeoud afV(vo.nh eemArsio of 
redestjoung ifu palarnetii ael.iplateon alg>unhtns to aveeHll 
o,tHh)ie tvujnih d divlitihamcs tune vairvmg ami unnuKlrled 
kOiuunus I fus leads to what is i( (erred to as rohno 
lutramricr oronunoa whuh Ksnlrs improving the slattihiv 
ii»busU»css .dlitw iht uuevrfvuatnm o( lerlain prior 
information re garding iht plant lo fve v<mti oiled into the 
design t g sliar(> Kruml nn i vlernal distuibames alUiwsildr 
nuoit domain in ihi )»aiaim‘U i sp.ier' Ihrv ends the era of 
du fdaek t*ov afj'fUOiK.h iilh'wing anv gukuf engirieenniR 
mtuUion as well as phvMi. *il insight to K* um *1 

Thre e rnodilu ations are (onunemlv used in the rolnisl 
adaptive tienlrol liirraUiie The dead /one first gi»o|>«rvrd Ivv 
I g.ndi I fyas we ll as PetcTs-em and Naiernlra 
. .msi'l^ oi k.oiMjoum.ii upthiiiiig teivi d on prioi mfornraliori 
u g.iielmg shaip IwMiint ori ihe: deuuiteain-es uipieiKC 
■Mtheeugfi sue h a iiiocjifu ,iium provides gir air. r f 1 eriiif»ilil> in 
Oabililv aii.ilvst i SaiTivm Pih.Ti Midetlrlon t'H di* I dKlH 
Muiiflrom and (leiwxJwjn IVMH, (md er a! pyKha I its 

[X-ulual MgrniKame' n indrrel questionable parhculaffv in 
the present ( <4 vmmodeled anef linn vafvinp eJviiarnns 
Indecil the. e hoet <. (d the ri Titive dead /eme m/c is bv ri<i 
means olmous The M umd rnodiln aiion vuggeued by F gwidt 
I i'y7*y| as well as Kfe:issrInn. K'r and *s;;iretulra M‘#K 7 l i.omueti. 
.4 pmui.img du pararncter evlitnalcv m a (ertmn allowablr 
region of the parannoer vpaee In using prior kmmirdgc 
alviut the pF.ini to K' controHed flic lidter firioi information 
I*. gmeralK easier to gel rhxrn that involved in tUrad /irrM: 
rmcdifu ahon TFmt third moifdn aiion js due to loanivou and 
krvkrUoVK »P^K * j T tonsiKK *4 tontrar fifig the parameter 
esfirnates and n genetaliv rrlcrrevl lo as o miMldiealion or 
kakagt Al! tFuM moslifRateons have Ken iniriHloied to 
ihr fwrumrtrr rsum4tu*\ iJnft r/iured hv hnundrd 
dui to the tnteg/al nature ol the original 
adafMisc laws fhev aie hnw^evci not seffKient to ikal wdh 
the ubiquitous proPKni '»( unnnxlck’d dynarrms as their 
corrt’sprunfmg disturhames carmoi Fh u pnnn avMjrrird 
K>urrdrd /mv longer Such a proWem has been addressed Fry 
F'ralv ( IdK? Pik t) who mtr^iKlutev an a(if*T<i|»f ta(c data 
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rK»rmalizBiion ihai turm the probtem of untKjunded 
diftturbafR'e« mto a bounded diKiurbancei^ one 7111$ makcn ii 
pofiKjbit to unc the aNivc cited modihc^tionH in the pretence 
of unmodeled dynaniio 

C)n the other hund. ii ateful approach lur studying the 
siabtliiy of indirect adaptive cotiiroficrs has been proponed 
by Dc Larmmat (IWi), Fuchs (19WI) and SamMin (l*>82| for 
the ideal case and estended to more realistic situations by Dc 
Ijirmlnal t\gurdi and Samson (19H2) and SamMHi 

(l9H3a,b) fhis legitimates the adaptive control of 
non-mtmmum phase plants with unkruiwn and possibly 
varying time-delay Ihe aimer stone <if such an approach is 
that any /incur tonirol law can bf combinrd with a paranuter 
exftmator whuh mtixfm a wrU defined vet of properiien to 
provide a ^/o/i<j//v xtahle indirect adaptive linear controller 
Ibc only stability property which is not necessarily provided 
by the available parameter estimators is what is referred to. 
in De terminal (19H4). as the estimated model admuxihihiy: 
the underlying linear control law should stabili/c the 
estimated plant nuHlcI 

Ibrce methods have been proposed in the literature for 
achieving the estimated miKlcI admissibility condition The 
first one consists of simply restricting the parameter space lo 
a convex admissible domain ((niodwin und Sm, 19H4; 
Krcissclmeicr, 19H.S, lUHfia; Middleton ei al . 19KH) Tlic 
underlying philosophy ol the second approach is as follows; 
since the plant under control is assumed to be admissible, 
incorporate an ad hoc prmedure to avoid non admissihk 
eMtimalcd miHleli (Dc l^rminat, 19K4; Lfi/.ano and 
(iiKidwin, 19K.S) Ihe third approach aims to ensure the 
convergence of the paranicicr estimates (clo.sej to their true 
values Such an objective has lieen particularly achieved for 
pole placement adaptive controllers m an ideal case, using an 
appropriate exciting sequence (Fllioi et al , 19K5; GiHMlwin 
and Ieoh. I9K\ (bHKlwm et al 1985; Anderson and 
Johnstone, I9KS, Kreisselmeier and Smith, l9K/r. PoUkiriiun, 
IVH9) 

A new approach to provide an ad-h(H ricMness properly m 
a rion-idcal situation has Ireen projKiscd m Gin et al 
(IMH7, I9HHa) lo this cml, the adaptive corurol law is 
miKiihcd such that an appropniile internal impulse exciting 
sequence is added while the controller parameters arc frozen 
over a suitable time horizon, whenever the plant minJel 
admiHSihiliiy is lost the uniterlying results arc however 
limited from two fioirils of view Firstly the plant model i.s 
auxumed to be time invariant anil the allowable unmiKleled 
dynamics arc those which arc always small with respeci lo 
the input (lulpiil signals Secondly the stahiliiy analysis is 
specdiciilly denvctl for jHile plucemeiu adaptive controllers 
with dead zone Ihe main moiivanori of this paper is lo 
gcnerali/c rhr abirve investigations in two directions (I) The 
cluiss of the plants to be controlled is enlarged lo include both 
timc'varying parameters and unmodeled dynamics The 
cficcis ol these non-idcalitics are assumed lo be asymploti 
cally small only in the mean (2) I he stahilitv analysis is 
jicrformed irrespective of both (he control and adaptation 
laws. 

Ihe paper is orgam/cd as follows In Section 2, the 
problem formulation is stalcsl lo emphasirc the design 
as.sumptions Ihe considered class ol adaptive controllers is 
prcjMfntcd m Section .V Section 4 is devoted to the closed 
loop Htabilily analysis First the propivicd adaptive control 
law IS shown to guarantee the required plant miKiel 
udmissibihiv Ihen the uniform boundedness of the closed 
io4>|i signals i,s established using a general stability lemma 
Si^me concluding remarks crul the paper 


2. l^rohlem riatrmrnt 

The cla.vs of the pliinis to Ik controlled is first defined 
Then a unihtd linear contnil law structure is given for 
versatility purjxwc Finally, the a>nlrol oh)enivc is sialcd 
Throughout the paper, n real sequence (.^(1)} will lx said 
iUVmp(ofic'ii//v \mall in the mean (ji ASM) if 


lim sup Imi sup 


.4 



.1(1) 


The ftci of all ihc&c sequences will be iKilcd .S«(^) The 
dehntiion of ASM) tequenco allows u>mpact statement 
of ^'ftinall in the mean sequences (PraJy, 19H2) 

2 1 The assumed plant model We shall corvuder the class 
of plants whose input-output behaviour is “alriKisi" like a 
low order linear lime varying model, which can be described 
m the dtscrcic time context as follows 

y(0 “ <? ‘)^(f)+i|(») *"’** 

With 

A(»‘(i).</ '+ +a;(rw " (2.2| 

f &:(»)<? " 

where u(/), y(i) and 2 (/) denote the plant input, output and 
partial stale, respectively; (r|(/)) is a disturbance sequence 
which incorporates all factors affecting Ihe plant output; q ' 
is the backward shift operator (i c 'i(/) ~ jr(/ - i)) 

We assume that the integer n is chersen a priori m) that the 
corresponding sequences {f7*(r)) and (rj(r)) satisfy; 

Al TTierc exists a known scalar such that 

A2 Ihcrc exists a positive scalar d such that 

( |de!iVf,(.4(ff(r), (/ ^), «(«•(!). 9 ’))l)f V«( ('ll 

where '), Y{q ‘ )) denotes the .Sylvcsiei resultant 

aiisociaied with the X{q ') and Y\q ') polynomials 
A,V 71icre exists a positive scalar v such lhai 

(l9(0|/m(r)} tr \( V) 

with 

m(/) ^ - 1)4 max (||0(f)||, 

0 -j IT ' 1. AFij, ' U, m(0) * 0 

and 

^(/)-•■ I y(/- I) - V(f n), u(/ 1) u{t rl)|^ 

It IS worth mentioning that the plant model pararneiers are 
allowed lo be time varying Such a feature is more an 
exception than a rule in Ihc available liieraiurc, though the 
problem of lime varying dynamics is the prime molivaiion of 
the adaptive control concept fhe assumption A2 means that 
ihc plant model is sufficiently controllable m the mean; this is 
coherent with the lime varying feature I'he assumption 
means that the unmLxlelcd response (rjff)} should lx linearly 
bounded, in the mean, by the input-output data activity 
measure {m(r)) This characterizes a relaiivi-ly imj^)rtiini 
class of plant miHlel mismatch, namely the neglected high 
order terms and those non linear characienstics that can 
he linearly dominated by Ihe inpul-outpui signals (Fraly. 
1982) Notice that the sequence (l9(01/"i(0) uniformly 
bounded 

2.2. The controller xtructure As oui aim is lo provide a 
general approach for achieving the stability of adaptive linear 
contndlers irrespective of the underlying linear conirol 
design, wc consider the following control law struclurc (In 
the remainder of the paper the argument q ' will be 
omilted) 

/f(«*(r))u(f) 4 ,V(|4-(f))y(r)- r(<9*(f))v *(n (2 1) 


with 

«(»•(/),(? 'j'!+ -•:(/)) ' + ■ +»•: ,(/)<, 

+jM'W '+ +«: ADq (24) 

r(t»*(o.i? ') = (,:(<)+ ':('W '+ +(„•(/)</" 

where (>'*(f)) IS « user-specified uniformly bounded 
reference sequeiKc The ’). ,S(f/*(r),q ‘) and 

q ') are polynomials which are evaluated according 
to the ctinsadcred control objeaivc, e g mt>dcl reference (or 
invertibly stable systems, pole placement, and receding 
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hoTOon ItncM quMlratn: cooirrt (See K/eivwiineMM I»k< 
IWMia, h, M Saad « u/ , mS amt HiHiKat) r, aJ twt (or 
more detail) 

In ihc following, wt will introdute (he umeem of n(ani 
mode .dniii«bil«y with rc«p«i i« ,hc conirol l«» 
(2 3)-(2 4)^ To tins end. le( Kl ) ly ,ht unde,lying 

cvalualHMi function of (he conirol law (2 .l|. I c 
a: ; 


,(«)(„(ei ijfr)!' 

Dtfinaum 2 1 j'. cr .)t‘" is said lo (y an admissihk; Jonvatn 

with respeci lo K( ) if (here exists p t ji) i| sus-h that 


(I) For any We -/... il ')K((t. ') . 

q ' )S{0. q ') •- (J then ‘,q\ p 

<ii) Ki ) IS Lipschit? un 

I’hai IS, the admivsihlc domain wnh rcspeci m k{ i 
amtains the admissible plani nuxlcK. i t fhc pur.imrtef 
veciors 0. that could he &uflu.:icnMv Mabili/cd bv ibr s'tmirnl 
law K{ ) In order to ^el a well ps^sed conirol proNcm. the 
plant model (2 l)-(2 2) u>|«e(hcr with the vimirol law 
(2 3)'-(2,4) should satisty the following assumptiiins 

A4 |Vr H'iflt ;./J and i(3^ 1110/) i : 

where d{ . ) IS A given disiancc and 3J^, w the iHiundarv 

It IS wijrth noticing that is not required U) Iv txpiKiilv 
known. A condition b»r iKloiigmg lo will t^ic suftKicnt t g 
ihr admissibility condition is reduced lo a a»pririn’ncs.s icM oI 
the [xdynomiiil sequence pair when a 

ptjlc placement coiiiroi is considered I he as.sumption A4 
stipulates that the plant model under lesi is lunitormls) 
admissible with respect lo the control law 

2.3 I he lori/rtW (>hfi'<ttVi‘ I (i ^ be sin least rron 
negative scalar so that 

■ 1)|::, i; .S^,(> ) il S) 

v' ciisls according to the assurnpiion A1 Aiul letting 

u max (s V ) (' 0 | 

where V IS the non negfiiivc: scalar ilclincd in assumption A 1 
Ilie ctmtrol ohjectivt vunsisls iii designing 'Oi milnci i 
adaptive controller, irrespictoo ol the Miniiul law as 
discussx'd at>ove. lor the plant (2 1| i2 2l subjcu ifi 
assumptnms Al A4 so that 

(j) there exists a nt>n negative scalar u' such that if 
u F |(), fj*] then all the closed U>op signaK afc 
uniformly NiundecI, 

III) the performances of the underlying control law an 
asymplolicallv achiescd in the nleal tase (i r 
W’lr) -- ^rtr ■ I \ and rffM 0 lor all i) 

Such a result will be of prime 'mrHjrtancr (lom both 
stability robustness and pe r for mane jHunts of view Indeed 
the involved unif«)rm boundedness will Ik obtained m spite 
of «i relatively large class ol unmfKlckd dynamic's as pointed 
out in assumption A3, and m spite of Itme varying plant 
model parameters The latter intorfMiralcs jump »s well as 
dnft parameters "Drift parameters refers to the cave w’hcre 
the parameters frequently undergo small variations whereas 
the "jump pariimcters means that the paramclrr could 
change largely hut infrequently Such u class of time varying 
systems has been recently iiivesitgaied bv Kreivselmeier 
fl9^86h). Middleton and (yfXHlwin (I'/HK). IK* I armmat 
(1^86) and Tsakalts and loannou (1MK7) 

3. Thf flderp/n^e conind alf^onthfn 

In this section we will first spccih (he propcitics that 
should bt^ sriiisfievl h\ the parameter adaptarifin algorithm, 
bcanng in mmd the conkidcred class of plants fhen the 
adaptive amtrol law is given with a particular rmphasii on 
(he new features 


3 1. Hotman pttrmmwf 'the 

(SAfimcfei adaptitkin n utexl gcnetatc a 

pAfftmetri rstimaiei wrc^swirsctf Hk iMtimvwn 

pirimeieni I'he wsM'd lirtHiM means that 

the patatnelei adaptaiMWi afftsfiihift i» abk to aixusmnioslaie 
biMuihlcd disturhuMiMXi, lime varying fMifnincicn and utsnvod 
eied dvnamK^s In the fv4Kiwxii|, wt W'lfl drut'ii'bc the robnvi 
slabtlity which dcirrmine tlw ot the 

t'larametri algorithm loi its uiiitsstul uve in 

adopifsr contrui 

PI (Ntr)} IS utidorTnlv Kiunded 

P2 f>»civ tints a ixnitive iximiani A, fnsdepemkni cd 
such that 

liytnO I: I wvh ytn vtri 

where ^k'lvoies data mMtnah/alKvn hs the wcqucflce 

iWfftl dclim'd in assumption A^ aiwJ u is a (wnHisT 
auiKUni imkisendent of h 

P3 Wit exists a (xnitoc ixmsiaiii A„ ondc|>cndeni ol 
such that 

fbWfri ■ HU ■ nil) f 

‘fhesc pfoperiies art attaiogiHis to ihoisr given in \>t 
karmmat f uchs (bW) ami Vamwm foi the 

wteal ease as well as tn T gardi and Samson i|Uh2) am) 
Samvint tl%3a) (or the case ol txmmled disiurbamrs 
Similar siabilitv piopcitii.'s base fHxn required bv Pialv 
(l*4K2|, SantMiM IV I urminat and Dr 

( jirminat iirul Havnaud llMKK) to deal with the same coittioi 
piohlein Tht uniform Niunilednevs profieilv IM i xtiudes the 
piKsibilitv ol parameter csiimaCrs wind up AlilHUigh this 
profKris i\ Cisily vrrifK’d in the nkal vast, it may Ik lost in 
non ideal situations. |>articularlv when the signals inv ived in 
the ada(>tivc liHip art not |Krsisicn(lv rxutinp (Anderson 
ei al IVWi) Mote sficcihcallv. such a pfofKilv was the prime 
motivation ol the adaptive law nuKhfk aiii>nv ilc'M.idKd 
earlier in the inirtKluctioii On the other hand the pio|Krius 
P2 and P3 ensure that the normali/ed ailupiion eitor and the 
puiamciet esiimairs variations arc sufllcirntb small in the 
mean Ihc invoIvcAl vmiiltness" is related m rlu lolelablr 
unmixlclcd and lime saryitig dynaiims, i «: the ualar m 
N otice that, all these properties are saiishcil by the availabk 
rotiust parumcici cstonaiion algorithms U gardi Ibaly, 

1*4^2. De I arminal and Kaynaud blHHi, e g icguliiri;ri;d 
normalired least sequarrs with pj*r*imciei priqei.lion or 
conbai lion 

'2 Ihr j /1 Jitri ( aUaffdvr liftrttr law A rolnisr 

indirect iidapiive lineai lontiollcr is Minplv obtained l^v 
(.omtufiing a parameter cvinnaioi satisfying the robust 
pfo|Krtics PI P'- with the certainly equivaltnce lorm of the 
linear control law (2 3) (2 4), i e 

S(h(/)b(f) 7(h(f»)v*(D (3 I) 

The resulting adaptive (oriiroller is robustly stable provided 
that Iht cstirnated pUni nuHtcl o suftinentlv admiscitste with 
resfKci lo the UfKkflying tonirol law Mme precisely, the 
paramcret cMimaies scqurrke should salisly the (oibiwing 
properly 

P4 There exois a sutnequeme suuh tbiii 

( ^ IS uniformly tsounded) and (V It » V bfr^ lt ./ i 

Notice that (Mr) is not required to tK'long to for all / 

The mam problem is that propc^rty P4 is noi necessarily 
vaiidied by the available parameter estimators Several 
volutions have been proposed to deal with such a profrlcm as 
pcNHitd out in the introduction Tn this paper, the nttmatfd 
mtHiel admoithfhrv m ensured h\ modi/yrng fhe adapiti*r 
amirol Icii* (^ 1 ) A\ folhrws 

^ ’ 7fb^ff))v*fr) ^ fr(n 4 fKji 

(3 2) 

where the sequerwrv (nfr)} .isid arc 

evaluated as billows 

Ixitjrig / the integer sufuiet given by 

/ - |r,(i f V) Tiffr, i I arwl U, /, ,! r 4fi ♦ | ( 
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(f there cxi^h t «; N such lhai 1 r, ♦ 4« 2 | ihtn 

OJi) * ^i(Tj wjih r, - mu* {k k ' /, and ^ik)€ (1.3a| 


ait) 2n(X Ui(OJO)i)y'\ 

i for t 1, ■*' 2 / 1-1 

(3 4b) 

ft(f\ - J 

0(1) () , ^ 
lor t 

1 

4 1, + 2/1 1 

(3.;k:) 

(» 3d) 
(3 3c) 

ffjn - 

0(0 

(3 3f) 

rtll) 

U 

(3 3g) 

fiit) - 

t) 

(3 3h) 


where (f/(0} ‘iulistics puiperiics FI arc the 

eocffk-icnis of the polyrxmiial liOJi)), v* is a Itniic uppt^r 
fxiund on the reference K^uence 1 V*(0) and /j is an 
iirbilrary chosen fKisitivc scalar Note ihal N^fO) has to 1^ 
admisKihlc, l e c J\, 

In order to give •uinic insights about the adaptive control 
law moddicaiion, let t^ be the first instant when fkO docs not 
belong to (fhf)) IS not admissible) I’hen, is chosen 
as W(T|), r, t, - 1. for n |/,, 4 4/i 2) and an internal 

impulse signal |n(r) c /J(r) given by V lb and V V| is added 
ill lime r, f 2/1 1 l.et us cuiisider the first in.Miini 

/, , -i 4/1 I such thill ff(ij diK's not belong to flien, 
«„(/) IS chosen for any t * |r,. r, f 4/i 2| as the last 

adnussihle estimated parameter vector where r is 

defined in Va), and an intcriiiil impulse is added at time 
i, t 2/1 I 

Notice that is constructively admissible, le 

W,,(r)t '/,, for all /, even d 0{f) not always admissible 

Moreover the controller parameters aie liozen over the 
time interval |t,, l, f 4/i 2| llte internal impulse signal 

provules then the neu;ssary aniouni of excitation to ensure 
the estimated plant model admissihilitv as we will show 

Although the controller parameter tiec/ing as well as the 
exciting internal signal (of/) t /!(/)) may be viewed as 

technical devices to deal with the adnusMbiliiy problem, ihcy 
may have a c|uile interesting inlcrprciation Indeed the 
excilalion of the signals involved in an adaptive contiol 

system IS due to three ddfereni sources, namely the relerence 
sequence, the eonirollei paiamelci vaiiaiions and the 
urimocleled lesfHuise Howevei it is well known that these 
natural exciting eficets may cancel each other. Icailing to a 
non acIrniSKiblc accumiilalion point in the (laranieier space 
rhe uiulcrlyiDig philosophy of the profHised afiproach consists 
in compensating these cffecls and then producing an 

appropriate excitation iiriiouni which ensures the estimated 
plant miufel adinissibtlitv according to the pio|K'n> IM More 
precisely the reference signal is coiii|>ensale(l hv the sequence 
{rt(r)), the comroller parameter variations arc completely 
removed by the hec/ing process, the unriuulelcd res|^»nsc 
eflecfs are cancelled by the sequence /l(7) The latter 
produces also the icquirctl amount of cxcilaiion The use ol 
iiilernal exciting signals to coix' with the cstunaled model 
admi.ssibilily problem has fu-cn lust suggested in KrcisscI 
meter and Smith (FfSbl tn an ideal adaptive regulation 
context 

4. C losfd ItHjp adaptivr ron/ro/ vvi/e/fi anaIvsLK 

In this seefion w*c will first show that the adaptive control 
bw f.V2) h) ensures the estimated model admis¬ 

sibility. 1 e property P4 I>ien. the early staled control 
ohjcciivc is achieved 

l*he following projx>situin wdl be useful m the remainder 
of the section 

/Vopovino/i 4(1 Vhere exists a positive constant K^, 
independent of such that for all positive r one has 

mtr 4 l)/m(r)^ \ fl V 

Till* pr^^Hd of this proposition folfows /fiuriiro r?inrarn/d the 
pHxd of Proposition 2 in (iiri er u/. fIMH7) 


The main xtep to ensure the estimated modef admissibility 
pfopeny F4, coiimsLs in proving the following ricKncs^ 
property 

FrifpoMHoh 4.1 Consider the plant dcKribcd by the rrKxkl 
<2 l)- (2 2) in closed lixrp with the modified adaptive control 
law (4 2)- (3 4a~h) and suppose that the a-ssumpiions Al-A4 
hold Then there exist positive scalars X arrd (independent 
of Pi and a non-ncgalivc real sequence {;r(/)) € 
such that lor any t f I and unit vector nr 

max i(i/(^(r 4 r )iA - ;r(r) V 

4ft » « ■"' I '. ‘l^ 

Frolif See Appendix A 

The above propcwition stipulates that the proposed adaptive 
control law provides the cl(»sed kxip system with a self 
excitation capability, for sufficiently small p 

Throrem 4 1 ( unsidcr the closed l(X)p system of Proposition 

4 1 T here exi.sis a positive scalar p* such that if 0-:.. m “** p' 
then 

(a) The plant estimated model is admtssible. i e {(^(0} 
satisfies properly F4 

(b) There exists a pxisilive scalar (i' such that if D* * fl’, 
then all the closed liKip stales are uniformly bounded fin 
all initial stales, namely the plant input and nutpui 

(c) In addition, the performance quantifiers 

ejO ~ /TfU/))u(/) ^ A(fC(0)/(fijn)v'(0 
*\(/) ^ 

(with Fii^) - A{f^)R( 0) ^ H(R)S{R)) are asymptotically 
zero in the ideal case, i c fi*(r) R*{( 1) f^*(()) and 

r/(r)-(l) V 

Fart (a) means that even if 0{i\ becomes non-admissiblc 
for some /s the intervals ol non adnussibdity arc uniformly 
bounded 

Ihe poH)f ol pari (a) is given m Ap|)endix H F«irts (b) and 
(c) reatlily (ollow from part (ii) as the sequence iis 

defined in V3 satisfies properties Fl F4 Indeed, any linear 
eontrol law combined with a parameter estimator saiistving 
some well tlefined properties (F,. l*,. I\ and F/) provides a 
robust adaptive control Sec for instance. Fraly (I^H2), 
SaiTiMm (WH3ii,b), fH- I airnmat (IdW)), De I arrninai and 
Raynaud (I98.S), (iin er ui (I^SKb) 

5 ( imi liLKion 

Ihis pjqxT has iK’en written with two mam objectives in 
mind Ihe first one is to show how to design a robustly stable 
indirect adaptive (linear) controller in a unified way, keeping 
in niinsi the available adaptive control theory, which is simply 
obtained by combining anv suitable (satisfying A4) linear 
control design with a parameter esiimalor which is able to 
aceomnuHlale lx>undetl distrubances. time varying para¬ 
meters and unimHlded dynamics In particular the less 
restrictive pro|X’rtics which determine (he choice ol the 
involved parameter esiimalor have been described, i.e. the 
robust stability properties P1-P4. I’hc most crucial robust 
stability properly, which is not necessarily satisfied by the 
available robust parameter estimators, is the estimated 
model iidmissibilily with respect to the underlying linear 
control law 

Ihc second ohjcciivc is to provide a new .volution to the 
estimated mixlcl admi.vsihilily problem, using an “active 
approach ’ Ihe latter consists in ensuring that the .signals 
involved in the adaptive cloved Itxip system have a sufficient 
amount of excitation which makes it possible to get an 
admis.siblc plant mcxlcl To this end. an ad-firx miHiificaiion 
of the control law is made Such u mixliticalion consists of 
adding an internal impulse exciting signal while freezing the 
cnntndler parameter, whenever the estimated model 
admissibility is lost The propx^sed solution provides, in 
particular, new insights about the concept of pcrsisieni 
excitation in non-idcal situations 

It IS however worth noticing that the robust stability in 
question means that the iidapUvc amtrx>l system variables 
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-Grfimnc lh* stale viiua «l/) as 

i ^ in j G/ (/ *'' ' |/! / i ,1 I A Ifi) 


n follows that 


Jtfr + h /hnnn * k| / (kj'Gfv Gf i 
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1 tl 
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where wicffiocnift a( rhe p«>lym>mMl 

f l-«i A be iin integer 

lUich that In k I and ait] the equation 

(A 2) may he rewritten an 

M(t 4 k + I ) « Hiiyxit 4 A) + h\T{(yjt 4- 4- k) 

4 A))r;(r 4 k) ^ fit + A)| 

4 (//(M A) - HU)yjiit^k) (A 4) 

Thifk i». for all i " 0 

xHi A 1 14 I) - //(/)' ‘ ’i(/ > A ) 4 ^ //(O' •h 

/«0 

^ {TiHJt “4 A 4 /))v*(f 4 A 4 /) 

Sihjt 4 A 4 f))r){t 4 A 4 /) 4 fit 4 A 4 /)| 

+ V //(,)' '(«(»+*+/) -M(())J(f + *+/) 

/ .0 

(A 5) 

As the rharHcicriwlic equation of the system (A.2)-fA.3) ik 
given hy 

a“'' 4 y,(/)A^'' '4 - '4y,^ ,(/)A-0 

It hillowf* that multiplying (A 5) by V|„ ^ ,(r) and using the 
( aylcy llrimillon theorem leads tu 

*« I 

V , ,((),^(, f * ♦ , + I).« W(()|:#(( + * + 2/t - 1) 

t • 11 

* >",(( t * t 2n I) - Nji i k 4 2/1 1)4 Id + *)| (A,6) 

wiih 

Vid) * 1 

jrio* |/i. .'/i| 

rs. i(') . v,(0. IT 


Since -2/1 :!i A £• -I and using (A.13) ii follows ihai 

1^-.' : 

S yj/. - |(< + 2n - ))i''xd +* 4 -1 + 2n)! 

1 I i 

f-^2nA' max lii^i(/4r)| (A I5| 

l >r« I *ii 2 

Furthermore, it follows from (A 3) and (A 7) that 4f(/) is a 
matrix with all singular values equal to 1 That is, for all r / 
one has from (3 3a h), 

fit 4 r) - 0 for T f (<l, 1, . 2n - 2. 2n. . 4n - 2} 

and hence (A H) can he rcwnllcn as 

.f(; 4- * + 4/1 - 2)' - |0 (11 (I Oj/d + 2/1-1) 

where the I is at the (1 ‘A)th entry Thus there exists at 
least one A t |- 2/i. I| depending on the choice of v such 
that 

Iv'srti + 2/1 - )).#(/ + * + 4/1 2)1 (A 16) 

2n 

Moreover, taking into uicouni the uniform fniundcdncsA of 
the (y*(/)) and (f^„(/)| sequences as well as (A 9) and 
(3.3a-h), one has 

Hi'iTd + 2/1 - l)V'*,d + * + 4/1 - 2) '* (A 17) 

V 2m 

And from (A 10), (A II) and (A 13), it follows that there 
exist positive scalars k\ and K, mdct>endeni of o and r such 
that 

|rVAr(/4 2n - l )A,(r 4 A 4 4n 2)|A\ max ir)(t t t)| 

^rl ► ' "• r *> 4/1 2 

(A IHa) 

|i>^ [’(r 4 2 m - 1 )| * A', max |ir(r ^i )il (A IKh) 

4ri 1 J • , r --4/1 J 


:+(/ + * 4 2/1 I) ' 1/(1 + * ) /d 4 k + 2/1 - ll' (A.K) 
V'Vlr t He 4 2/1 I) « (7'(«„(/ 4 *))v*(i 4 /1) 

/(()„(( + * + 2/1 - l))v*(( + H + 2/1 l)|' (A f) 

S,(l + k (2/1 I) “ 4 k ))/)(/ + k ) 

.V(((„(/ + * 4 2/1 ))/)(/4 * + 2/1 - l)|' (A.10) 

Id + * )' X i'.„ , i(') i //(O' ' 

/ ..-II ^ .v(| 

X (ffil 4 A + /) - /7(M)4(r + k > ;) (A ll) 
Substituting I + 2m I to t in (A O) vu'lds 

V (f 4 2 m l)i(rf a 4 i 4 2/1) 

‘ ffH 4 Zn \ ^ A h 4ri Z) 4 >';(r 4 A 4 4 m 2) 

f .V,t/ 4 A 4 4 m 2)1 4 r(f 4 A 4 2/1 1) (A, 12) 

As the plant model and the controller piiramctcrs arc 
unilormlv iHuinded, there exists a positive scalar such ihai 
lor any i ^ |0. 2m - l| and anv r t jo. 4 m " 2|, one has 

Iy,(r4 Dl -^ a; (A 13) 

Premulliplying (A 12) hy an arbitrary unit vector v yields 

[ *’« I 

I ^ )■> i(' + “'i ~ + * + I + 2/i) 

-|i'' #d + 2/i - ));/■((+ * +4/1-2)1 
|r'4'(( + 2n - l)V;d + A + 4n - 2)| 

+ 2n l)A',d + A +4/1 - 2)1 
If' U( + A + 2/1 - 1)1 


Combining (A 14)-(A IH) leads lo 

,, ,, / /^oi(f f 2 m I) 

2m^ max \v 'xit 4 r)] - 

4ni;-»‘.4/i ; 2 m 

A', max |r;(/ 4 T)j A', ma,' )|f (^ 4 r)|i 

(A 19) 

On the other hand, ihe measure men I sector (^(/) in 
Assumption A3 may he c\])ressed in terms o( the partial 
stale r(r) m (2 1) as follows 

0(0' -[-//(Wd - 0) ly '"'/)(«•)( - D), 

A(0*(( - ))) 1/ '"'A(W(f' l))|d/- 1) 

+ |-1 - (/ ' -q 0|/)(/ I) (A 20) 

In order to link the vector 0(0 to i(/). let us define the 
following vector 

0dl' = 1- »(//*(( - D), . - «(((•(/ - D). 

A((C(i-l)).(/ "" A(0‘((- l))|r(i I) (A 21) 

where ticnotes the usual polynomial multiplication 
Furthermore letting A(t) = 0(r)-- 0 (t). ii follows from 
Assumption A3 and (2 b) that there exists a positive scalar 
A'v, independent of m such that 

{ll-V'(Oll) t (A.22) 

In view of Assumption A2, the (2m) polynomials appearing 
in the right hand side of (A 21) arc linear!) inde^vcndcnl over 
the reals This together wuh (A lb) leads to 

0'(O ■“ A(r)i(f) 

where A(/) IS a full rank 2m x 2m dimension matrix satisfying 
A„,„(A(0) '0 for all f;+0. A„„„ bcinii; ihc minimai 

Singular value of A(/) This yields 


(A 14) 


0(0- A10j(/) A(0 


(A.Z3) 
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Ttiif B, premuluplyiog (A D) » unit vticior h 

Lertifi* •*-(0'' = »’’'A(0/||»*'A(f)(i. ,1 f„uc«,^ 

itui “ ' 

mu + 

4m ■* «.4n -- 2 

■■ ,“^''<'*''1* IA 25) 

Using (A 19) with v = wd + t). (A 2,5) wkls (or mv 1 1 / 


V(/ + f )1 .> 

1 ' 

|rn(r 4 2/1 1) 




2nA; / 4 a. 

max 

‘ 2> 1 ■»w4n 

\riii 4 r) 

ii A; / 4« 

max 

-• 7 * 9i. 4« 

Jin 14 T)}i 


- mox ||:V(|4I)|1 

4a 4 2 T A> 4/1 

In other respects, dividing each mcnihcr of ihc above 
inequality by m(( + 4n I) and using Prop(M.ilii>n 4 0, it 
follows that there ousts a positive constant A, (independent 
of p) such that: 

max |i»>(t+Tlh'M"'’' ,v(/| iA25| 


Nn «n\ 11 I ^ i j Apfilntiii 4 1 |[ih 

<*■' H Wkmiii iKiii tin n uiflkimittv ; 


mai 

>0 

,f *S() - , 

♦ 1 r T '■ wt A " 

.'itD 


where r^. 4#i 

■ 1 and 






■' 4 yiA.ni 


iB :t 

This leads u> 





A 

mas 

♦ 1 -♦ 

S,,ftf) 

4 

(H V) 

f>n the oitH'T 

hand. 

for ans ( nikI 

anv 

mtrifer 

'0 '»*.i 

iHK fiav 





i<|njr|i 

* 4*{{ i 

^ 11 ^*0 1 I )' 

IV lih 

• V j;P(, I I) «(i . I Dn 

Hui [tom »hc [>lani mf^ilci I.N I (« ^ m 

» I ^ * T I V(l 4 I ) ♦ #) (I ♦ ! » 

whrrt 

y(M >l/< i»iul 4(frinirf(r) 




max ir)(r 9 t); 

4a V J -v 1 ». 4a 2 


4 , I S'f’j jj( 4 j jj. 

^ Ink, ' i’'«f*,4,n : 

max ||iV(f 4 r)I| (A ?.H) 


Al/) ^ iy(/ * f |[ • V y I 

y iiM(/ ♦ ii Ntf ♦ T Dll 

mrlX ;(/»(? < T ) D#(r H ■ A(f ) 


for MJmc poMtivc scaLir K; {indcpcndcni o( mI 
Nolicc lhal since ()|A/(/)jll, {|ir(D!l) and linHHl mr 
A^i-a.symplohcally small in Ihc mean h»r S4)mr K ' 0 ihcii 
maximum values cm anv fmiic micrsal art An 
asymprolically small in ihc mean, for uime k *0 
depending on K 

ilicsc being, taking inlo atcouni IA 22) and Auumphon 
A3 and properties PI and P3, there cxisis a powtivc comlani 
A', such that: 

F .SJA,m) (A 2<)) 

which establishes Proposition 4 1 with A ~ A |^o^,„/4fi A 

VVV 

Appendix B: Pnnij of Theorem 4 1 {pari a) 

The prtxif will be matle by contradiction lo this end, let 
(/^l be the time sequence such that fi i all k < N W(t*)F 
and assume that the property P4 d(K ^ not hold Ihcn the 
incrcmcnial sequence {r* 1 ; 1 ^ not uniformly 
bounded, and hence there exists a non'decreasing vuh 
sequence (such that as j ^ 

This is, one has 

0(/) I for any positive integer / r 1/,*,, |. hi\ 

And from Assumption A4, if follows lhai there cxiils a 
positive scalar r > r such that for any / f Vig,, t f*,l- 
Il^(r)|| = Ii^(r) ^ ff(/)|| r. which implies 

inf l!fi(r)| 1 ^F (BD 

'no !''' 


I'his logciher with i H M vurldv (of ,4fiv \ 1 
Au t ♦ A,,,1(0 


Cm ihr i»thtr hand il tidlows fmm Assiimptiom Al ijnd A3 
and pro|»crlv P,' !hai there fjosin a (kKiine uonstarti A^ 
(indcfX’ndeni (•! iD vueh thal 


N^umg lhal r* 
lhai 

inf lirdj); 


A(fl) f \,(A,,i^) iH D 

r.,, ,, Il Ihtrefurr |ulUn4'S from flM) 


Y ' ‘ AID ^ AM.n(f) 


Since aneJ ir^,) * " an ; ♦ il lollows Irom (B fi| 

using (h S and D3 'D lhal (or / huf1unntlv largr 

ml (H7| 


Thus i( p' IS siKh that d- o" • Ar 2fA/^ 4 A.#,A.,}, Ihcn Ihc 
right hand side of (H 7) is smaller than r/2, i^hich ermIrailiK(s 
fB 1) IVrelore. no divergent lulvhcqiitnce (r*J inn be 
cxlraclcd from f r*) lit rice (rJ is uniformly fxiimckd This 
cittaNishcs Iht part (a) of Theorrm 4 1 VX\ 
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Br»cl Paper 

Quadratic Stabilizability of Uncertain Systems: 

A Two Level Optimization Setup* 

KEQIN Clli.ti! V H ( HI N,} M A /tiUDYi and NAN K I.OIP 

Key Holds R*»hii>T (.tuttrul sl.ihiliu. acM|£n. 


Al»«fr»cl The pinhlL-in of Imumj v\>U‘ms suiMt »t 

t(» |'H>sMhlv f;is( liHK varying uiiLtr(ainlu's i*. iiivcvii]caicii 
Necessary uml suHicieni iurulitunu of quailratk siafnlii’-thiliu 
arc discussed 1 he desipji process is Itvrmulaicd as i^n U vcl 
oplinii/alioii priKcss. whkh can he simplified il ihr 
unccrMinlv is houndetl h\ a hv[K‘rfH>lvhtiiron 

1 /nirrh/ui lion 

lin I'HUHl I M of sial>ijil\ and lccdh,itk ^onirol ii{ vjiKcitain 
linear svsiems has dravm iinuh allt ntion fctcnfis Nunn 
i f ilcna have hcen ilcMsud lo v har.n liri/i ihc ui.: i ri.nniics 
cilhcf constani or lime varNiri^;. such ihai iht siahdiu o( rfn 
svsUin IS ^u.iraniccd i( the ciiicna arc salishcd {\ sl.iini and 
Kiisscll. ’Icdavalli, h, I'iSA, IVilcl d ,ii rJ”'" 

l\ilcl and Itick, P>K(i, /.hou and Kfiaipom kai iVK'f 

llovscsci. ihcsc critei ia art ^k'neialh r ilfu r :''nsi Tsad'.c 
and some mif'osc ver> leslnelive assumf^ions Hairrush 
(IVS's) |iv an clcj^iani maihcrriaiiial inanciiM.'i deiistd .1 
ncLCssars aruf siilficicnt eondition ol '■tafuli/altilirv dI a f.oiK 
L'cncral class ol unLcriainlics However ifu siahili/alMliiv 
ttnulilion IS dillitiill lo check, and die sCd'di/iru 'oniiolier 
tlesi^Mi |s tetlious I\'lersen, kliaie<’iuk.u and /hon 

[>uhlisheil a niimher ol pa|His on du Madili/ahiln v o( 
uneeriain svstenis ol ihe lollouine lotm ideieivii: inn' 
IdSK, khiiriionckai r: nl I'fHSi 

( d A d(nn t ( /O A/fiOfn, 

where 

(Ac\, \/H />/|/)(/ / ■! and /'(,'}/(.')■ / 

Mans in^emoii> rcsidls h.ise deeii denM;d A neiess.irs aru! 
siillieienl lOiuliiion ol s| al'di/ahilil v o! du ahtivt ^N'lem h,i\ 
reeeidis hce 11 ilensevl. and tfu expitssion id slahili/nq' 
eonlrtil has hceii ohiained I khareonckar e/ a/ !‘rK>o ’Alnle 
mans uneeriiiirilies can 1h expressed as a sabsel ol du' al>«'vc 
uruerlainls eX[iression h\ ihe o\ei Isnindinp ie« hniijn*- 
ihe lesulliti^ eriterioii is olien exrreriiels etmscivalive ( »n d 
ui I IdS^d proposed a neeessarv and snlliirtni toriiJilion *»{ 
quadralie slahditN, which he Hieeketl hv an cxplitii 

aljiorilhiTi when (he uneertainis lies m i hv|Kiptd\hedfon 
Ihis pafK'r externls ihe result of (o rt ul li'kHdi ho lim ar 


' Reeeivcd 23 May IdSd. revised f ehruarv 
received in final form d April The tn^qrial verMon of 

this paper was ntil presenlcsJ al ariv If A( inetiin^' Ihis 
paper was fceoi 7 imended ftu puhlicalion in oMsetl form hv 
AssTKiate fidilt^r fV Doraio under the dirctlton ol f ditor H 
Kwakernaak 

"Center for RoUilics and Advanced Aulomalion Nehot)! 
i 7 f Tngineennp and C omputer Science Oakland I niscrsitv. 
Rochesier. MI 4HM}9. V S A 

title Cicorge W Woodruff SeKotd o! McchaniLal 
E-nginccrinp. Cicorgia Instdulc of fccfinolopv Adania (rA 
3d332. i: S A Author to whom all (orresf>i>nderK:e should 
he addressed 

H’urrcnd> al the Department of Mcthamca! I ngmccTing 
Southern Illinois llnisersiiy ai EdwardwilU ( wariwi c. 
11. <1202^4 U S A 


Icrdhack ouitiol **1 uiurrl ain syTitc ms 1>U' map»i conn dm 
1 h»ii id iho (Nifiiri o (>ct.rNvar\ ,^nd sufticKnl voiKldnms ol 
tpiadraiK vi:«hdiirahilth of arhiiratv uiuxrtt4ini\ hneai 
(cedhiick eonlfii art rt fotnudated to m form »,»( two U'srI 
optirni/jirnm piAHrss whrrr (he miirr level >pitrrunii (am K 
reathed hv the vertices 1 ) the unitri«iniv set 0 a 
hvfx if»ot> hedron and anx local nutvrmum •»! the ouU i leve l 
o rtko I hr glof’id maximum 

f*trlifnifuii s 

I of the lonvio irme of i;k'vc‘lo|Sfncitl. a nuinl'vcf td 
nolaltofiis ate mlrtviliKCtl All tfie riiMUicis eumsukrcd m ihls 
pa(M*i arc teal Mn Ml id n * m maiiicrs wtll he dcnoietl as 

W' , .end Iht SCI of volumii vcclois with n voinfxvncnls is 

W IIk sei o! svmmi trii n ^ n ntiiiiices will Ih' tit n^^hrd mk 

S*’ s" ts (he M l id i>'sMivc delimit rnaUites Du tlmiiic A2 

IS i.krtil\ die set id fvosnive semi ilclimie maliKTs l oi a 
scalar f IS deftruti 10 

v:, iv V c/i s:} 

h I' intjsifiani to noine dial n a lorivei tone with Ihr 

ajH X .il #/ It t<n anv CU C* * ‘‘T . ‘"ntl n h Cl • ^f r 1, 

di II /*CT ’ll fMCU * . 'tt>‘l il ^ t/)t V", 

Alo! ioitie that for unv toinpiul sri ( < A'', iinplirs ihe 
cxislener of an r d siu i> ihiti ( ' V' , Analogousiv. A*’ is 

du sei ol ail mgaiivi dtlmiie maintrs ami 

s: ID U ' / ' A' 

I el 1 Ih: an arl'iitars set m a vttit>r spai e, ihcn e<onv(l,| 

(k rii'lto ii>4 (-»nir» fuW/ I r; 

t (iin (}„) _ 

I el ( tx a tonvv K sr| dun proitr j tk iioit^v Ihe sel ol 
pouruded pointsC of ( kor /} ^ W'’* (, t W''a hncMi 
tijx'latoi 1^' S" • S is tie lined as 

i;‘r H i( ♦ rh‘i/> H 

1'. 1% ,t'i T,. Il IN im|WHiarif In noic ih;il C tv 

ilM II ti linear map 

i'V f, N * '■-*for n,, n . r /f 

Du unccTtiiiin syslrnvs 1 oricnlrred m iho paper can hrr 

expresses! as 

» (T ♦ AAd/fi •* i/i ^ (1) 

where ji « /y IS Ihc vccioi of ctair variahlts. u t h Ihe 
vedtu of crmtrol inpuT A fis the rKxmrrtaJ lyurm 

main*, and WrAU"' is iht' ntrminal input mairix 'Die 
uncenainix is rcpicscnied by t AA(i). AW(rf), which ix an 
arhfirars Ixfxcvguc mcavurahlr mainx function xatixlying 

f AA ( r h AH(f IM U fcM all / 0 

; A prtriruded pr»mi p i>f a riel ( nr lAK'h a p<nnt for any 

iarrcai bcgmcni whrch coniaim p and i» conutneef in (..\ p n 
one of nv end points (Can rr al . IW^) 
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where U II a u)mpacl lei in ihc finuc dtmccuKmal vccior 

Remark I rypically, U ii contained in a sut-npace of 
»r«) 1 ^ iAU\ II It. idlen henehcial to eiprei.! fl) as 

/ ''! I *** 

* ^ ^ I'* * X (2) 


where {iA,.Ii,),i- \, , m) i% a net of banih vectors (they 

arc actually matrices) of the suhspace containing U, and 

ifi() " 

IS a i>cfK'h|i{ur measurable vector lunction, satisfying 


for all I H) 


( orrcsponding to the compactness of U, is alvi a compact 
set m H"*' In applications, equation (2) is often directly 
available firim physical model, with qjl) being the uncertain 
lac'lors Since is subspace, (I) and (2) arc 

equivalent expressions Although Ihc should be 

linearly inde|>cndenl, (hey can be functionally dependent 
An example is 


A/t(/) - ( 


pin 

/>•’(() 


pin ' 


ipini • I 


which can he wnllcn as 


/ 1 (K ^ /(I 1^, 

AAin <,,in(,, ,,). 

With 

IPi ’ 11 

I'he essential problem is to slabili/e system (1) (ly a linear 
feedback Wc will resirici oui attention to "quadralii 
slabilily”, which was propiivcd by Harmish (biHS) 

/>r/injr/on I. A linear feedback cimtrul u Kk is said to 
quiulratically siabili/c system (I) if there exists a matrix 
I* ( V'’ and a scalar i\ - tl such (hat 

^ ^ ^ i‘^ * > <« + 

' n ii«ir <^1 


holds for arbitrary » c H** aiul (f,. /*) r U A system ol form 
(I) IS said to Ih' quiidraticaily slabili/afdc by a linear 
Icccihack control it there exists a linear leedhack law 
M ^ K% which quatiralicallv slahili/es it 


^ Svwmiv t^'ifhouf ufn ertuinfaw i/i H 

As a first step o( ilevciopmcnt, it is assumed m this sc-ction 
that no uiuertainlies exist m the input matrix 

Ai.vumption 1 I he uncertain system considered in this 
section can be written as 

i + AAtt))i > Hu, (4) 

where A.4( I is an aibiirais I ebesgue- measurable matrix 
function satisfying 


AA(t) f a loi all t - (I. (5) 

where IJ is a coriqr^u t convex sel in R . H i R" ‘' has lull 

rank, and n -r 


Ihe slahili/ahihty conditions ol such a svsiem arc staled in 
the following theorem, which is rephrased from a theorem by 
Hollo! and Harmish (IMKtl) 


Thforrm I l et I) r s\u:h (hat 



(h) 


IS nonsingular. and let its inverse be paritinmed as 

V ' (H f)). (7) 

where fi t R'*'"' and {) t 'V Then system (I) satisfying 


Asiumplion I tx quadratH:aUy stabilizaNc by ii linear 
feedback control if and only if there exists an S e .S'" siK:h 
that 

Ti',,.V = -~D'[iA + E}S + 5U + sz ' lor all EfO 

Remark 2. If the condition of the theorem is satisfied, then a 
stabilising controller can be expressed as 

KR ^H^P. 

f 

where P .S e .S', and r *0 suflficienily small such that 

^ ‘)/3l 

'1 ')/3rf .V' hir»llf.€n (M) 

For practical applications, the above theorem needs to be 
put in a form which is more ea.sily checked, and such that it is 
easier to design the feedback controller if (he system is 
indeed quadralically stabilizablc Theorems 2 and ^ serve this 
purpose, Ihc following lemma is instrumental tor further 
development 

i^emma I If (I, V, W t .S'", (I* a ■ I. and W ~ aU -f (1 - 
o)V. Then 

(I u)A^.,dV') (10) 

where A^,„( ) denotes the minimum eigenvalue of the 
designated matrix 

Proof 

nun I'Wl 

llOi I 

- min ,1 'Inrf ' f (I ii)k' |.t 

ili 11 - 1 

- mm I a.!' f i ^ ( I n )i ' V'l | 

ii* 1I- -' 

* rr min i ‘ f-'r f 11 n) min i ’ IT 

114:!^' I ;i ,!'■ I 

oA„„„( (T + (I ft )A„,„d V) 

An immcdiali' consequence ol this lemma is lhat 

A,„„dW') ' min (A^jr^). A^„n')} (11) 

The above lemma and the linearity ol the operator with 
respect to the subscripts lead to the following theorem 

Oinnem 1. Let .S i .V", At Af"’" and U 

convex I cl 

r mm A„„JTV. / 

t r^l) 

then Y f>c reached by a protruded point of U 

Pr<H*f Since 12 is compact, the minimum y can be reached 
by some (“Hunt f ,,t 0. Let /V,, be an affine suhspacc of 
of minimum dimension such lhai U c Also lei ^2,, - £2 If 
Ti, IS a protruded point, then the prtnif is complete 
Otherwise, there exists a line segment L, such that t L, 
Li: and both ends qI the line segment arc on the 

Ixiundary of 12,, Since , f S is linear with respect to E, 
iuxxirding to (11). the minimum can be reached by one of the 
end points of the line .segment. Let this minimum end (Xiinl 
be E^ If E^ IS a protruded point, then the proof is again 
completed. ()thcraise, since is convex, and P\ is its 
boundary psuni, (here exists a hypcrplanc A/, of //„ 
suf^poning at t , (i c. U„ is in one side of A/, and e Af,) 
(l.iienbergcr, 1%^) Then ii is easily seen that all the line 
segments of 12„ which cxmiain Av, but do not end at Ai, are 
contained in AV,. uml AA, is one dimcn.sion less than AA,, Le-t 
U, - AA, n Q,,. then £2^ i.s alMi convex, and all the protruded 
points of Q^ arc alsii protruded points of Repeat the 
same pixHXSs on the inple (U,. AA,. E^}. cither a protruded 
point IS found or a new triple (Qj, AT. E^] can be produced 
with AT one dimension k>ss than AA, Therefore this process is 
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lermiiMting. and a proinided point ran be (ound, wWh i$ • 
minimuin point 

Theorem 2 alkrwtt u» to seareh onlv the proimded «Hnt^ 
(or y When Q it. a hyperpolyhednm there ate .mJt’hmtc 
number of protruded points (■ c the vcntcesi Atarther point 
lo he noticed is lhai Hicorem I n %m vaiiid if V c V* ' |^ 
replaced by S e S ’, and |!.S-!| - r , where i| .1 n iv.ra, of 
mainceii A convenient choKt in thn case is the vum of 
singular value norm, which reduces to the iraet lot posiiive 
semi-detinilc matrion. and iheirforr has the nice proprrts of 
being a linear function of ihc maim 

ll-Viiir^V), if :u r 

Tins selection of norm rcsulis m iKc folU.iMnir ihcr^irm. 
which IS imponant fvir numcncdl ctimputimon 

Ihforrm 3 Let 


lliCAHrm \ 4 an hr lephiffiaMt m texitis of ibe liini iHun ^ lit 

(I SiTsirm i i i AMhiim|i*nifi \ it tiUMlmiH 

aWv il ami onti if 

ifj •«'mat 

ii'hri'f ; IS an arhiir-air') 

Iht irymmiim o alwa^'t detine<l, umx H i« dearly 
omifuci and v,(< > *s vimlinmms H (l.?f h«>ld«, let \* I'f the 
maximum ihcn ^leariv V >* ihat 

IL'» II and iHrieltm .V*i V^] ihcrel^nT 

ihf ih vuDk icni On ihc otWi hand d the finMem i* 

quadfaiualh sUihiUiaHc then h<ddt Im Mime V lltic 
miitiix A i. an tx i< wakd lo vatisilii 

If i \} i 


0(.V) min 1 

i • Lf 

and 

y>f (.VI ^ mm i 0( V) cAA i; 
where i: O) AI.mi let 

W - {S a: If { S \ - 1) 

Tlicn any lixal maximum of v'i(Si in W o iho the 
maximum in W' 

/Vf>o/ Since (he trace oix*rauu is linear ami A" is etuivcx H 
IS alMf cunscK 1 he pmol is prixeesicd hs eontradu iii*n 
Assume that S, o a Kxal niaximuni fxiiiu nl V'l l''' aiul S o 
the global maximum [viini. vmA, )' y. I V ) let 

At .(I'V, ,A> 

Since \y Is umvex, 

(iA, Hi 0 ).S; ( IV (oi all d o ) 


f or such An A 
iinJ 


^(V) "II. 
(I 


Ihcrrhnc tl.) holds l>u (smdtiion is aIm* t%txr%K»iy 

Ihr piiianKtcf is rncrtril lo rcUrci ihi* finM ihm A iiml 
A an prfu iallv tvf ddlereni w rilc Mw iksign |>ioceduie 

fi*i a slahili/inj^* kOiUiolhr o jh hdhiws 

1 I lkk>s“ i ) c uiipuu H am) /) as in Ihmiem \ I'lnx»N’ 
It' irtWii pro|H'r sealing due Ur the muUi|diCiition of M 
■Hid A 

Mi.ximi/c the iuiKUon v\ i1 kcsfird (he mnximunng 
A am! (he MKUinuun i/, l( r/^ • II (he Si 1cm i» 
laird noi ipjadraiK ally Mabilo able Olhei winc’. 
pioceed wiih step ! 

i ( h'losf a fx>sili\r dcfiniie H I ri S ^ ('Kikik* « 
Milluicnily small f smh lhal is sjiiiNfird Ihc 

slabilinnK t onlroller is 


Hv l emma 1 and ihc lincanlv of f,, u is casiK seen 

oA| ’I ( I - fi)A; l ' fitfd/ V) ■♦■ ( 1 . S,| 

lake the miniinum o( both sides 

mm tiM /:. <iA| + ( 1 a ) ^. I 
r . u 

* miri I (1 f(d / . A,) ♦ f I brH / S. j| 

/ t u 

^ fi min f/j( / . V I I 1 1 trim f(M h A d 

f 1 IJ ’ ^ • o 


R '/f'r 

I 'ViradC^! rrprcsrni Ibe maximum singular value of the 
rnairo I ct 

"w o,,wvd/ll 
O , , fl i i) I 

o , max , , , A I, 

I P Cp 


which means 

0 ((iAh 11 ‘^l^'l ■^'<?><AJH 1 /ij<p(Sd 

Also bv Lemma I 

/lr„,n( oA, -*■ ( 1 ' alSd " • I OMn..pi(A I 

C ombinmg the (wo mcqualiiies yickL 

V'; ( uA, H (1 )A ) 

- min (i^lrtA, (I ' ti)Ad, ‘*At HI n)A ,j; 

r.emin (o^( A.) " 1(1 fT)(yi( Ad. 
fi 4 A^,„(A|) d (1 - a |£a^,JA;)( 
fi mm f 0(A, b Uro.r-l As )i 
4(1- rt )mm {(piSA i;A^.,.lA;); 

= rr^rfA,) d (1 “ nIvv i AO 
> 

which coniradicls the assumplion that >: a h*S‘d maximum 
siiKC Ck can be made arbiiranls close lo I fhe pr<Mi »s 
(hcrcforc completed 

Theorem ^ in pnnaplc has alUfwcsl one lo compute the 
maximum of yv(A) by a siandard minimivaiKm algorithm 


A ihoKC id t Mk h llial fd) »tv stilivlii’d is 

1 ^ . 

* <«'/,<*,/r/jj 

Ihr vet of urn e rtamis U is srm ial m cvaluMling (hr 
limcinm V- which involves a rninimi/ation pnxexs As 
mrnnonevl .iixisi when o a hvfxrjsojvhedron. |(his is 
olicn (hr iasr m prahiifc, for example, the unterlain svxicm 
can 'dicn U' exfuesMd m ihe (oim of (,'j wiih each unceriiim 
(at itJt iHuinikd by y, ' V ^I ^ 1 'f'*" minimum is alwnys 

rcHchrv!! by one of ils veihirs titciudmg hii llicoiem 2 ll is 
therefore suffuieni fo «r»mpuir (he sidues at the vcriicYs and 
lake Ihc minimum value hor other cases, wc sup^esi to 
U.ujnd U by .1 hypefjxdybedfcm 

The maximi/ahon r»f vdfAl is (i>mpul«iioriMMy mtenjuvr 
I ortunatelv Ihrorcm '*> punis ouf dial any kM.al maximum is 
also a global maximum Hcic a simpk version id coordinait 
roiiiimg algonihm (Rao. 1W4I is desciibcd Ibis proccM i« 
similar lo ihai used m fru er ai (IWii) I xptesi 

s (:\Mr 

where L (u , w.,» o an ortb^rgonMl matex. and 
A drag (a,. . Aj 

Then (be irKTcment of ciMirdimiics emn t>e rcaltged by 
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changing 


and only if 


X, * A, i d, A, A, rS subject Hi A^ ' 0, A^ f) (13) 

for MtnK 11 ; {\, 2. . . /I 1 / or 

lu,. ♦ (w, f.tn f) ■ Uj ?*M» M, u, sin f u, a>s f/) (14) 

for Minic r./f fl. ,n), <#/ I he dlgonthm is sum 
miin/ed as follows 

1 I - 0 C hooM: iniliul scitrching step <>,, and 0,> C’hix»c 
minimum sicp rS’ and fi* ( hfKivc initial V (/‘At/ 

(_/■/, A // 
n 

2 Alternately increment ciMirdinatts to try to incicuM^ 
t/'( V) hy usinji (1 M and (14) for 


/>! 

W) 

^ ( * )(,!, X iranvpoM: r S' for all ir^. r.) e U 

fur some .S e S\ After some algebra, it tan be shown that 
such an S exists il and only il 

.VV.„,„ VV,„,„)(\>.„„ VV,„,„) 

flic clcmcnis fd S can fx* choM:n to Ik 

- - 1 . 

'.M = (v>!,„„ + vV,„„„r’/ 4 , 


i> -• if),. H '■ i h, 

3 If V'(A) has l>eeri increased in one round of step 2. 

fC|K’iii step 2 Otherwise, if d, “ iV ami (I, ' (f*, g(' to 
step 4 Otherwise, let A,, i\/2. tf,,, - iijl, 

I * < > I, go to step 2 

4 Maximum »/, and maximum (xuni .V* have been fouiul 
slop 

Other more advanced constrained optimization algorithm 
can also be used, see loi example Kao (19K4) and Polak 
(19H7) 


A rnuk ^ A 

1 (s r, s- A , ,r, )■’ 


^ A,.rj . 

4.v.xr,r; ' 


Vv (V, , s 1 I/ * ,1 

and the stabilizing control is 


4 (ffnrralinitiom 

Wficn both syMcrn matrix A and in|>u' matrix H arc subject 
tfi uncertainties, a result due to Harmish (l‘^H3) can be 
applied 

Thfort^rn A System (I) is f|uailralically stahilizablc by a 
linear lecdhack control if anil only it the following ungmrmfv/ 
ryf/em is c|Uiulralically slabili/able by a linear lecdhack 
cnritrifl 



(A ♦ A,4(/) 

n ) A/((fi 1, 

i n ■ 

^ 0 

(1 


f or this iiiigmcnicd system, the function 0(.V) becomes 
^(.V) min A,„,„l (,4 + / ).V,, 

1/ f N'U 

where .S f A'*' *tnil A,,s arc subm-iUKcs ol A ol 

commcnsuiJiic diinensinns Alter the A maximi/mg r/\>(A) 
has been ot>iairu'd, the slafnii/ing control is 

u - A\,A,,'i 

The coircsfHniiling /’matrix in ftcfimiion I is A,/ 

Another generalization is when U is not convex l or this 
case, since Ur conv(U). it is easily seen that the nuadraiic 
stabili/ahiliiy by a linear control is implied by ihiii ol the 
same sysicrn with the unceilxiin set being replaced by 
conv(U) llowevei, from rheorems 2 and 4. this is 
equivalent to the quatlraiic slabili/abilily by a linear control 
with uncertain set being prot (ctmv (U)) Since 

plot (eonv (U)) > U. 

we can reach the conclusion that the sjuadraiic slabilizabihiv 
by II linear control of a system (I) with unccilaiii vet U is 
equivalent to that with unecrUun set conv (U). 

A fllustrativr rxamplv 

A quadratic slabili/nbililv by a linear feedback of the 
following system [a special cave of this system was discussed 
by Petersen is ctmsidcrcd 

'"io 

(r,U). f,(tH ( U Mk, X |r, r, 

13te system is quadrnlically stahili/ahir by ii linear control if 


(i ( oh{ lu.\t(fm 

I'he necessary and sufficient coruJiiions lor quadratic 
slabili/abilily ol uncertain linear systems by linear (ccdhack 
control arc lormiilalcd in a form ol two level optimization 
problem It is found that when the unceriainty region is a 
hyperfxdyhcilron. the optimization of inner level in reduced 
to comparing the lunciion valuer .it ihe corners It in 
proposed that arhilrary unceriain regions he bounded by a 
hyper|>olyficdron and therelorc the projvoscil algorithm can 
b<’ applied It is also proved that any lociil niaxiimim in the 
outer level optimi/alion is also the global maximum, and 
therelorc any standard oplimi/alion algiuiihniN can be 
applied 
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Some Majorant Robustness Results for 
Discrete-time Systems* 

DAVID C HYl.ANDi anJ I MMANDl 1 (. COlllNS, IrU 


Key Worth ~ RohuMrH*%s. '»cnsiiivjt\ diwrrtt iinw 


Abilfuct — This paper uses nia|or»ni txiuniiinp icvhmquo u» 
Lkvelop robiiM performance hounds and suhiluy uimUtumv 
for linear discrcie-lime sysicmv cxpiesst^d m a ha^iv »n ^hnii 
the stale matrix is block diagimal l^triormaiuc is me.isurcd 
m terms of the lime dependent behavior td thr svOem 
outputs Tins performance aiienon is not considered 
explicitly hy other robustness results Two vets ol robusinesv 
results lire developed The second vet is able to captuic the 
intuitive cficct that increasing the distaiKC Nrtween the 
subsystems increases the magnitude ol nondco.i»Miinng 
uncertain coupling allowed beiwccn the subsvsienn In 
addition, the develupmcnis demonsiriile (hai altcrn.ooc 
representations of a given ufuertain svMcm c.in lead O' 
signilkanlly different robuslrurss bounds 


1 Iniroducttmi 

MAJORAr^T HiniNi.iNO techniques vsere ilevcl.qx-d In 
Dahlquisl to produce bounds l(»i the snluiions ol Nvsterns ol 
equations (Dahlqmst, IVH3| Similar Ivuinding icchniquo 
have been used m the work ol reseaichers in large vale 
systems analysis (Porier and Michel, T 1 askn and 
Michel l‘^7hl More rccenllv. matorant l>oimiling leihniques 
have been used to develop rubuM Mabililv and (Xfformance 
results lor the analysts ol l.neat ..mcMitvarun. ;vs.rn,s -.oh 
structured uncertatntv (Hyland and Hetnsicoi. m J olhiis 
and Hyland, 1W», Hyland and t, olhnv 
results in maiorant robustness analysis .ill.-a '>'1" 
pertormance to tse mcasuted in two wavs Hie moia 
[Tevelopmcnls (Hyland and Hernsleiti, 1%'’, 

Hvland. WH9I allow the perloimaiue to In- nuasiiicd i 
l.rms o( the delations of the steady state •' 

selected system vaiiables Irom their nominal values 1 a cr 
developments in the frequency domain (Hvland 
l^H^^a) allow the jx-rformance lo be measured 
IrcQucncv-dcivendcnt deviations ol the system outputs tn 

houndini techniques to develop robusi aiialwis it suit 
Sly .1 considers the case m whisl. the perb-mamc 
fmetured in icrms ol the un.r Jr nr 

selected system outputs from then 

allows analysis of both the ‘ ^ ,,f 

behaviors of the system Ike syslcrns vrhich have 

discrclc-lime linear iinie invarian Hums ti» whw h 

structured uncertainty and arc 

the state matrix is bliKk-di^ona viandaid 

,t, deterministic signals Th.s -s „r 

classical analysts wh^h often 
steps, ramps and sinusoids) to measuit 

• Received 24 tklobcr IVW. 

;;riir:„:pr:s:: aiy 

v"..... 

H Kwakemaak Ae-nKnacc Svsicms 

t Harris Corporanon. A 

D-vtsKin. MS should be 

t Author lo whom all torr t 

addressed 


1 wo SCO ol tcMilts ate developed IV sccxind »r' **' 

ainuit llK mlutltvi ellcst (hat .mrraMitg the diMamx 
xiwccn the iqxvlta ol two vubsysiem. ir.cic««-» l»*e 
mafiniludc ol ivvotlrsiabiUnn»( uiufilam touplm* wllow^ 
(Ktween the subsystems Hns phciviuncna is not olssetval^ 
tiv mans siandaid analysis IihsIs suih ar veilot and 
I vapunov thciMio and singulai value analysis In aildilnsn 
the developments Ivrte tIemonMiale that iillrrnalive lepie 
senlalions ol a goen untxrriam system van Itad lo 

siaoilKantis dilUieiii tohustixvs Uiunds 

Ihe papi . IS Otganirrd av (ollowv VretK.n 2 give. rK.tat.on 
and ...mr ,mp..tianl mathrmaUsal relatn.iss Ncslron 
pirsenis and lormulales a piobleiii m lobusl *7 

ixfloimiirHc riiirtlVMN bM divrcicHint wmicm* wii 
slrusluied unserta.ntv Vidum 4 the.. 

developmrrils IV main lesulls ate lound in Vn«.n wh.sl 
uses L,o,.mi ...undiiq. .e.hn.qurs to drvi Hs to vs 
ixtlotmame isnituls and suhtiieni io»d.ii..n. lot to us 
Siabililv Veiioi. t, illusiiaics the lesiills with a miinemal 
rs.iinple I imdls Viiion ’ picM-nb. lom'liuling remarks 


and muthrmalu al rriaiufnx 
nt I riiinnt gsilivc 


%<• I 


MM 


•/ 




i/f 


A// I 


td / ) 


!!. !' !1> 


mlv'gciv 

^ 1 *. n' ^ 

iict ol (noiincgiiiivc) icwl numixrv 
f, a p ulcntii^ miiliii 

IliHliiimid piiMlun of m«liHPv 
y / of cquail diriiciiMoiH IMvhi), is *7 3 ) 
Knuuikci pfiHlud »nd vum (Uicwei, 
1 ‘> 7 M) 

.Kirnn vtm king ofxr^nor jiwMxitflcd wilb 
kromtkci pt'Hluvl (Uffwci. |SI 7 K) 

' sT,, lot c<Kh 1 «n<l / I V' wnd / Mri: icaI 
maHturv of equal diinrriMori) 
miMluluN iTOiuix of /( ' 
ngt riviiluc i«ml \[xclia’tl ladiuv of 

/ III / ■ -'I' fd/» a the lYiom 
r,HU t.f / (Vnrbi Hrimnn und 

Plcmmorn, 107 U)| 

I uishrk^n. qxtiiMl And I roixniuv normv 


live 


I Cl V' / ' ( *"’1 “ '■ ‘ '■ ’ "'*■ r“‘"iioi>ed lorms 




/ |/.,l. 


. 1’.' (2 1,2, ',4) 

where V / < ( ‘ *u‘* I 

*/„,l norm rr^m "/ / '"P'" 

It Kitowski l*abl) (which IS alvi called the » himh norm ) 
IS the ' ^ r nonncgaiiye mains 

/... <2*" 

I 11 US /, and represent respectively the bUKk mrrm 
maitK.es o| / w ith respect to the spectral and » r.dwnmk 
norms Ihe W«* norm veror of « wrrh rrtfH-rr l« the 
t.wiuUon norm (or furhdfan WmAnormI is Use 
twinncgaiivc vector « r R' dehried by 

u’ ll|U,ll,. .IlK.lbl 

SOIKX that d tV parlitions ol thr ma.ria Z aruJ vector u arc 
•k ’, seala, elements de r. «). iVn the speetft (<h 


IbT 
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hl<Kk fH»rm mutnx ami bUx’k rM#rm vccu»r art 
Mmpty miKJulus mairiccH Thai is, - /, * j/l*^ and 
u lu|^ for r n 

SubMcf^ueril analysis will also um: die lollowm;^ hlfM:k norm 
relations (Hyland aruJ ( oIIiiih, 

(li I n) “ " M ♦ f rY^/^ 

(2 1, H. M) 

/.,■■/,. \u'i’l',u’ir (2 10 , 11 ; 

The analysis will also require the matrix norm relations 

li/HK ' W^^Wf ll/'lk H/f|l, (2,12. I.n 

ll/lll, IM ■-ll^!|.J!/^lls (2,14 IS) 

where A and H are arbitrary lornpicx malrKes of compatible 
dimension |A prool of (2 l^i) is presenUd in Hyland and 
C olhris (l‘mb)l 

Ma)oranls (Dahlquisl, [9K3) are cssennally elcmeni hy 
element upper Ixiuruls foi blixk norms Precisely , /„ f idV' 
IS a muforani of / with rrvfnxi ro r/ie if matrix norm (or ' if 
muforartl") if Z^, ‘ ' /„ Similarly, u i W', is a mai(trunt tff w 
With rerper/ to the hudidean nifrm (or ' !ah hdean rnaittrant \ 
d u " W 

A matrix fN M'"'* is an M matrix (f icdicr and Ptak, l%2. 
Seneta, pn4. derman and Plernmons. if it has 

nonfXtHilivc oil diajtonal elements (i e ’ d lor i * f) and 
tMiMliv'e pMiiLipal minors It is shown m lierman and 
Plernmons (Id/^V) that il If* R"' ”'. then If is an 

Mmatrix d and only if e(/^)' I 

Pinally. note that d / t r""* and (/ /) is nonsmguiar, 

then 

V /’ (; /' ")(/ /) c 16) 

This relation is easily pmveil by postimillifdvin^ both siilcs ol 
(2 in) by (/ /) iind expaiulmf> the lell h.ind side 

1 l‘rohtem jormulaiitm 
C onsider the discretedime system 

i(C 4 I) (.4 f (i)x{k\ 4 e(^). Hd)t X (VI) 

where t ( 1 ", X > 1 " and r o a known input which is as 
sumetl to be boumled lor all time (i e siip^ l|i'U)||.' ' ) 
It is assumed that the system ( H) is cornpiised ol r (r * n) 
nominallv stable subsystems described by A with iinceitam 
interactions and dynamics described bv (i Specihcallv. 

A blmk dia^’. (.4,)' (4 2) 

wliere .4, i ^ " is asvmplotically statile (i e all eigenvalues 

he m the o|H"n unit circle) and ^ n, n t he sul>syNiems 
described by the A, ciin be eilhei physical subsystems (e g 
spaiiidly diMincI parts ol a c<imple,x Hexilde structure) oi 
malhemalieiil subsystems (e g the modes ol the nominal 
system) I he matrix (/i ^ .irul the vectors x.i t \ " are 
fiartitioned c'onlormiibly so that 

I','. m;. .''.'i 

( ' \4, M 

where (1,^ f i " "" and c,. n, c s 

In whal tollows ii is assumed that for some i* c W', ihc 
initial condition set X i.s dc.scnbcd bv 

X { !(()) t H f(t))- n (1 b) 


ibe performance of the system (4 I) is measured m terms 
of the limc depcndeni behavior of ihc scalar output v( ) 
given by 

>|i)^f'j(A) (14) 

rhe paililKmed form of c f R" is given by 

c.(,'i O lU) 

where r, t 

.Now assurrte represents the uncertainty sei or G, 
and define 

v„„„(A) 2 min vfk). " ^ ‘b 

|(U).JI ..U|*S 


Hemark 1 It should be noted that both >^,,>1^) and v„,j,dk) 
arc implicit functions of the system input i f ) Tbus. a more 
precise notation would he V„„„|i'( j. k) and k I 

However for fhc sake ol sirnphcity this notation is 
suppressed 

PeprutKot [ t he functions a ,'i», 54 and H are 

respectively /r>Kcr and upper perfitrmant e hf)und\ wiifi 
respect to the uncerlamiy set (5 il t;,„„|k I " fi(k) and 

Pepniium 1 II .4 f (/ is asymptotically stable lor all (/ f ii 
then the system () 1) is r(fhii\il\ stable over f# 

Ihc ijim (d subsequent developments is iwolold f irsl. wc 
will develop lower and upper pcrlormance bounds toi the 
svslem (4 1) In addilion, we will determine sullicienl 
eoiuhtions (or the rohusl siiibihty ol ( ) Ij It should be noteil 
that allhough the [HTlorrnanee analysis given below e.xplicitK 
considers only tfie scalar output (4 >4). the results aciualK 
allow multiple ofye(ti\>e anafvsL\ I hat is otbet (scalar ) 
outputs which are linear lunctions o) ihe stale can be 
analy/ed by sirnplv ch.ingmg Itie vector t m ( ^ ‘M 

4 preliminary de]>elopmi‘nt\^ 

Heforc presenlmg the rnaiti results in SeciKUi S some 
additional development is required 
( orisidci the nominal system 

i‘'(k > I) .4i''(k) i i'(k). ,i"(4)) MIb l4 I) 

iiru) note that the slate vector V'( ) can tu’ expresseil as 

I’U) .-r -t -CuO), -(H) (4.’) 

Also, dctine the sets 

X" 2 /V'(.): 1(b) rX|. 

i> \ II II 1 (44.4) 

X'; { i"| ) 1 (k) /IVkO), Mb) C \) 

X" IS the set (tf nominal rr.vpon.vcN while X'/ is the \e{ of 
nominal initial condition rvyportMw Obviously, d i'(A ) l> for 
k ' b, then X" \y 
Next, dctiiic 

cfk ) 2 t(^ ) i'‘(k ) (4 4) 

Then, subtracting (4 1) from (4 1) gives 

f(k ^ n - (.4 -f G)r(k) f (;,i''lk). Mb) -0 (4,b) 


W'e also consider two descriptions ol Ihc admissible partitioned lorm of e is 

uncertainty SiH'Cihcally. for some (»\ e R V or t U','’ \i 

IS assumed that cither (i € Gv br ii e G, where - U’f- p/| 


G, . u; t 1 """ * (ivV 

i;, - (c; f -- - (i, i 


(4 7,H) 


Ihal IS. the admissible iincxrrlamtv is described Cither in 
terms of upper biiunds on the spectral normx of the subbliK'ks 
of (• or in terms of upfX't I'munds on the ri(>rrFLv of 

ihc subhliKks of (/ 


where f, r ( 

/Mifimon 4 Ihc (unction is a perturbation 

hoiind with respect to the reference input i'( ) d for each 
i"( leX and (/'c G the resultant error sequence {r(k)}^,„ 
satisfies 


e(k ) “b ^(k ) 


(4 K) 
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Nt»w. the oaiput > ( \ cjin be ctprcs^ctl as 

v(A) v^A ) + Ava) 

wbe re 

AuAl-.Vui (4 11)111 

The following lernm-i u,m;» the aK.vc irharmcri/aihin .>l u 1 
to preseni lower and ufiper perlormamc bounds lor the 

sy?»tL*m (3 I) 

Lrmmo 1 ( onsidcr (he sysu-m O 1| and supjxne e( ) o a 
pcrlurbalK>n bound wiih rcspcti lo (he rclcrense^ inpu, i 
jnd lei 

a{k) - \^\k) ~ ) - v'U j ^ i'V(A) (4 \2 i vli 

Then, ft ► R iirid ^ --*R arc rcv(:K:tti\cl> l»mcr arid 

upper perl(»rmMncc Kmniis wnh rcvpcci lo ih< icIcrcrKr 
input v{ ). 

rr(H>f From (4 11). i:il) arul (4 h) n lollowv ihji 
!AvtAjf ' f ^'(A) (or cijch » C; Hu pri*ot is ihcn 
immediate Irom (4 U) 

Kohusl siahiliiy can be dcicrmmcd tn coo^idermy. ilu- 
hoiTio^^cncous sysicm 

xik 1) - {A 4 (, )x(l I. xb»,i w(!k (4 Ml 

I'hc following projxisilmn ^ivtrs an cijuivalmi lur 

robust stahihiN, 

rrttpo\iii<m 1 I'he ^vsk‘m ( ^ l | in r ilniNlb Mjihk i^vcr (; n 
and only i( (or any slnclb |>osi!ivc inilidJ condiiiori 
h|L>Lk.-norm bound i*. i haraeicn/in^’. ihc sci \ dchnrd bs 
(3 b). ihc slate ) of ihc homojiciuous sNsuin M M) 
siilislies lim^ .a /(A ) II (or each iMl) (., X and (» i (» 

N'ou, aNSuriic lliat I'fA ) (I for A ’ fi .uul (bus i ‘{ )( \\ 
In ihjs ease, lim^ .. »"(A) (l and f(A) /(A) I 'lA) It 
follows that ihe robusi siahdilv condiiu’n of Pro(v>siiit>n I is 
eqiJivalenl In link .-e(A) 0 lor v(()i' \ and r. • (• Ihr 

nexl lemma used in I he follow irif: section lo dcveli'p 
suHieicni e<indilions lor robusi slabiliu, is an immcdiale 
eonsecjuenee ol the af^ose eipiivalenee and I’ro|H»MtM<n 1 

2 Assume lhal i* '>(), \'ik ) D fi e »"l ) * X*/) am) 
i‘{ ) IS a [K'rlurfration bound lor ihe svsiein (M) Ihcn, 0 
lirrk t‘{k I (I, the system (3 1 I is rolnistU siafde 

f rom lire above diseiissioii it is appareni PkiI an iinfK'il.mi 
pari of the ensuin;!; lesults is the develif)>meni of jKrnurf'ainm 
btiunds lor the system (3 1) With this in mind, we present 
[wo expressions for the snluiion <■( ) of (4 bi wluih will laler 
Ik- used lo derive periurbaiion Ixmmls 

It IS well known ifnii ihe solution r( ) nl (4 M laii be 
expressed as 

k I 

r'(A I - y] A‘ ‘ rliij " )•> I*'! 

r' ■ (I 

This IS the first expression lor ef ) Suhstilutinp (4 I.*!) into its 
own ri)iht hand side and ulili/in^ ihi Mjb-siitulion 

I I / I > : ■» 1 

V V V N' (4 Ih) 

then gives 

e{k)^ V Mik - l.rri f ll(/|c(mi^ I’lmi] 

V A* ' '(m'I/). r(l>) d 14 17| 

I -f) 

where 

.«(* y V' (-V' ^ oiH) 

equation (4 17) ,s the vccond cuprcsM')" (or r’t ) II (. were 
known and one were actually numerKallv sob mg of e ). 
(4 IS) and (4.|7) would vield the same v.lumm Mowcvcf 
Mncc Cr IS unknown, (4. IS) and (4 1) will tx user U. 
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jMcidwcv jirrturb«tH»n Wnimis »oi iHe xvarm 0 U Ax n wrea 
iiitcf. bottndx ikrtwl (t'twi xhc C4|W4tixsfift <''m elilfcf 
wiffu^icAnih 

*'■ sj/afuk/i aPtJ 

lino fsfcwrnu rs-ibwvi peif^H'TruMVse btsainb atvd 

vutbiH^ni eondii»4ms (.>r c)4>umi MaHhix of the hvvtrm (3 li 
Ihe mjim rrxuhs loe hHiiKf in IhcvMemx \ ? IhcM 

thxoieim me ikpimknt iritx\ti\Ti> im lemmnx 4 s 
whwh goe |icnurb^ffon Knimb <oi the* sxsum (til 
Theorem 4 tsmiparci (hr (wcvious orsuflx 
Vki begin ihc pfeu^niiikon bv dialing fin imfxnuni 
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rrv|xct l^^ tht urueOainis vet (p 

f'nhtf I irsr .oAUfor ifrat f» < I*, sm h Ifial to,, ' If lb 
using 13 ‘b (3 11) and (^ ft) ii then hdlows Irnm (4 1^| ihat 
h ir r a<Ji »(t/) r \ ainJ t r » <P, 

ef* r - V * i'3/)l f'tbi o fs ‘b 

\(»w rceogni/e thai Hi »s npitvalcni lo 

» I 

,)'■(*) A\ ' V;,|,*'"(/| . r't/t) ^"'(( 1 ) II (Situ 

f rom 'b. lb) «»nd Ixrnma ^ ii (ollowv that loi all 
xPl) e X and b *■ Cr v, e( A ) •< ^ ft A ) 

Next assume G tig xuth that b, " - f^fg It then lofhms 
Irom 13 3))) lhai b\' ' b. The powif is uuicimkd by 
rcpt!atin| the aMfsc steps using b,. - ' *nx<ei»d of 
b,. “ f ' ' 

Throrrm \ ( onsidcf (he wbem (3 I) with ofcicme inpul 
rt ) and let 
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(^ II, 12) 
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where f'( ) i* defined by (5 8). fhen, af'*'( ) and i are 
re^pcctivcty lower and upper performance bounds with 
respect to the uncertainty set In addition, if 

fj{A, i d)< 1. (5 13) 

the lystcm (3 1) in rfvfiustly stable 

fVrw/ IliHl and /!“'( ) arc pcrformaiKC b^junds 

folkmn immediately from Ixmma 4 and Lxmrna 1 Now 
assume that (5 13) holds Ihcn, if the Njund i’ for the 
hl<M:k norm of the inilial state in strictly fiositivc (i.c. .f” »0) 
and 17(A) ^ 0 (i c j''( I^ X^'), it follows from (5 8) that 
lititi ^ 0 fhus, using Ixmmu 2 it follows that 

(5 13) IN a suRicicnt condition for robust stability of the 
system (3 I) U 

Krfnark 3 Iht robust stability condition (5 13) can Ik: 
very conservative since even if (r - () it is ^xmiblc that 
for stable d.p(/4J "■! However, if ihe subsystems of A 
correspond to the modes of the system this phenomena does 
not exist In general, the smaller the suhNyslems aie the less 
coriNcrvaiivc: are the rotiustnes-s results of lxmrna 4 and 
I'hcorcm 1 

3'he robustness results presented above were dcvcli>f’ied by 
using the chuiactcruation of r( ) given by (4 15) and 
considered the uncertainly sets and G,. Ilic next results 
depend on the charaeteri/aiion of e( ) given by (4 17) and 
consider only the uncertainly set G^ 

Before presenting these results for A *0 and / .-(I define 
the matrix :f(k - f - I) by 

:^(^ / n 

where I I) i,s the x n^ri, matrix with bhH:k 

partitions, 

A ( : 

:»*,(* / D- V (/>;)'«i,4‘ ' ' ■’ (MS) 

Here and below we use the conveniion that 

r 

^ ( I « 0 tor M ' u (51b) 

rn u 

LemmaS txif*' --►M', be given bv 

k 2 

f'-’H*)- X IX(* I i)*f'.,K.V|.''''(/)+ 

/-(I 
k I 

♦ ^ (/C)‘ ' '<.•,«•'■(/). <‘'■■’(1') <1 (.*' 17) 

rhen, (‘'■"( i is « pcriurhiiliiin b»iiinU ii( the system (.11) with 
irspecl to the uiu'crluinly set Uf 

/’riHi/ Using (2 7) (23^) with (5 b). it follows Irom (4 17) 
that 

A 

^ V M^{k I, m f 

UN *(l 

A I 

♦ ^ (.^^)* '(.vt'V'i). r)(i) - II (S 18) 

If (icG^, then (», - - O, which by using (2 lb) implies 
(fV " - (if Now. using (2 12). (2 14), and (2 H) with some 
simple Kr«)neckcr preniuct identities (Brewer. ld7K) yields 

\\M„{k - I, m i nil. 


gives ^ ^ 

#(*)■!. 5 X l#,(A-(-l).C,)C,|#f/) + i"(/)l 

/-O 

k 1 

2 ' ‘G,.i"(/), ()(())-() (.S 2l) 

I m il 

It then follows from (5J7), (5.21) and lxmrna 3 that 

The next lemma shows (hat the cakrutaiion of ) can 
often be considerably simplified which in turn simplifies the 
computation of the perturbation btiund ^*‘T) 

Ijfmma 6. Assume that for i e (1, 2. . /-) A, is nonsingu¬ 

lar and for i ^ j A, and A^ dt» not have common eigenvalues 
Then, the partitions of ,^ ) defined by (5 15) can l>c 
cxpre.ssed as 

- / I) 

^' *')C-o y. I-) 

(.S 2.?a, b) 

PrtHtf See Appendix A [j 

Theorem 2 Consider the system (3 1) with reference input 
ii( ) and the uncertainty set G/ Lei 

«'''(*) ^ v"(A) - (■'(''‘■’(A), /j'-”(A) = y'‘(A) + ( V-’’(A) 

(5 23. 24) 

where ) i,s dchned by ('i 17) Tben, n'^’( ) and /!'•'( ) 
arc respectively lower and upper performance Ixmnds In 
addition, if the initial condition block norm bound f* is 
siritlly positive (i e i •»()), r»(A)^0 |i e t‘'( X'/) and 

lim* .. /‘‘(A) -■ (I. then the system is robusily stable 

Proof. That o'"’( ) and iirc (KTlorniancc fsouiul.s 

follows immediately from Lemma 4 and Lemma 1 the 
robust stability condition follows immediately from I emma 5 
and lxmrna 2 [ ; 

In the final theorem of this section it is seen that with 
respect to the uncertainty set G, Lemma 5 and Theorem 2 
(at the expense of greater computational iniensilv) give less 
eonscrvalivc robustness results than lxmrna 4 and Iheorem 

Theorem 3 Assume that G - G^ in Lemma 4 and Theorem 
1 Then, the perturlialion bounds e"'| ) and e'‘ '( ) defined 
respctlivelv by (5 H) and (5 17) satisfy 

r'*‘(A)-. e'’^(A) f.s 25) 

Thus, the corresponding lower t>erformance hounds ) 
and cr'‘'( ) defined by (5.11) and (5 23) and upfxrr 
fK-rformance bounds /f''V) and ) defined by (.'s 12) and 
(5 24) satisfy 

rt"’(A)"> a''\k). /f'^'fA)-' -.TI'"(A). (5 2b. 27) 

In addition, if the robust stability condition C' 13) of 
Theorem 1 is satisfied, then the robust stability condition 
given in rheorem 2 i.s also satished 

Proof See Appendix B □ 

Remark 4 Suppose r - 2 and for y t R . 

„ and , M. 2 ,.V28, 2.) 


■'1 2 . ‘ ■" 'I 1.) M. 

(M*)) 

or equivalently 

4rv(A - 1. w -t 1) ■>. '. (A - m ~ I) ♦ (5 2(1) 

where f\k m 1) is given by (5 14) and (''15) 
SubNiitutmg (av* “ UV- (5 20), and - - f'V bdo (5 IK) 


such that 

A, ;(/V) - M, ±1*^, (5 3(1) 

Then, if A, # 0 or A. ^ 0. and either p, ^ or fl, # 



I 

(5.31) 


such that the spectral nonn of (( - A^^)0AJ ’ decreases as 
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the <1«UBC* between the etfcnvaliies i>i A, unj H loctetBe* 
Non , notice liui (5 2^b) tmpitei 

-! - l)!h 

^ ■*.< ■’ I ^ii, ,e, 

’2) 

U thet' k>lk^w^ Ju»fn f5 311. 32) Icmnu ^ ana IVvircm 2. 

ih«l the n»a^(imum ) m <3 2M) n e ihi- maiimufn urk:eriain 
a><ipiing) hyt whtd\ suhihey can he assured n f7fujx»nH»n*l \o 
rhe diMancc hciwecn the eiitenvalucs i»! and a. Thn 
phemimena, ihough iniuiiive, vaniH)i he shimti h^ ihc rc%uli\ 
ol le'iiima 4 and Throrem 1 

Hrmtifk 5 it The muial condiiH>n MOi n aciuaih kivjwn 
le g jfO^ " 0), then the mnninal sme kJ > is alni km»»ti In 
this case ti pr>iiMhle to suhstidite i|,U < k^r k,iA ) in i emmas 
A and to ohlain better i\ c viTuiler) fH'riurhiitKiu K>urHi\ 

<^’ ■1 . and ) 

^ An rtijtmpir 

i onvaler the unceriair system 

♦ 1 } - 14“ f /,:)J(A I > k a K .r(0) (ft 1) 

vU i (i 'Vj(A ) (6 

atu'fC e W'*,, 


•t hliK-k-'diBi? 

• 0), V. ! I n 

((')' - |i, I. II. (i| 

viTu! 

»ik)' |1, 1. n, n| H 

ufiio rtiiinty matru 

f f E - il. f : • 

(» (! 1 I 

n II 1 1 

1 1 M (j 

L ) l M n J 

I Cl 

i f M I i ! 1 l : ■ 

/ - h|..yk-diag i li 

\ 2 ' i / ; 1 [ / ,/ M 


(63) 
(6 4) 


I SI 


(fi f'l I 




ami make the subsdiution r(Al Txik) Iheri. the s\Mrm 
ilewnlxil tiv (6 ]) (6 7| iraristorniv (i> (hi HijJar subsyslem 

((‘TfTl 


l(A 4 I ) - + f, Hfi^ j I iflj) H f6 <VJ 

A he ft 

4 / 'a' J - chap { V, 7 v, /o*, ^ jui x. fiu.] 

(6 10) 
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Nov* )rl 

> , MS. i/i, 0 7 % K s fit (I 7 y II (IN 

(h IM 

(N(»lf lhai (of these ihnnes o| \ and m the syslein n 
f^nninfills stable i flgii^e^ I ami 2 iheri shovs the posable 
{>rff'>imame drpradalnm in On nominal output as pfriheied 
rcvjHi live IV bv Iheorrms 1 and 2 (vnth C*, <i ) 

The M matnc comiiiiMM id Ihrotem 1 pinluK ilu 
ins(:ibihi\ Ncen ni fig 1 Aloi mnnr th.il .r. (Mmurderi) by 
ih» thenrs the |x rfoirinuvu bounds of T ip 2 aic* less 
(onser\iiiivT than those' ol I ig 1 

^ < oru /uijfrh 

Ihi)i pa|x r has u%ed major am txninding iciliniq|ucs to 
develop tuiK deixndriil upfK-r and lovo,r txrlotniaiiit: 
Ktunds h»r n vIhvs rd \inceriain hiK iii diurcie iinu vyylcim 
The main (hcMrcrrH have also prev nted 'suffti u ni uindrOomib 
for lotMiv! Mabdilv I hi robustm \s K ojlt’i o| I beorem 2 
t apitirr the intuitivr rHeet that im riming the di«laiH« 
Ik I wren the cpc'ctra of nao '.ubioidemv imrcaiufsv the 

mAgniiudc of i>i»ridcsiabiti/mg nmerfain umpitrig alkrwed 
Ix-lwren the subsycierns A eomparivm of Iheorcnu 2 nfid I 
alvo denumsif,mes (hat allefnative represeniaiioiH id a given 
umenain svsirui can It ad !»» signdManily difttrcni iobiivlrir%iv 
♦k mndiv 
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ApprndiK .1 /'roo/ i>f i rmnut ti 
keeall (Brewer. I‘A/K) that 

(/I W H)(C W/)) (.‘U ///) (A I) 

11 lollow's Irom (s is) aiui (A I) 

I*./* t II ' ■) ^ 'i' (A :> 

whieh lor t / gives (s 2 la) 

Now' assume iImI / / / I hen, smee 4, and A^ do not have 
common eigenvalues, u Udlows (Biewci, l‘)7S) ihal itie 
■« npi^ maliiH (/l/c>D /l, ') does not have any eigenvalue 
equal to one I hus. (/„,, *1/ W /l, ') is nonsmgular It then 

billow's Irom (2 ltd •md (A 2) ihai 

/ l) (A, ')^ ' 'I 

* IC,„, ( 1,' 'll (A 3) 

Using (A 1) .md the laci ihal /„,, /,^ A., •> billows Irom 

lADihal 

> ' I) ' ' (A/)* '®.-C 'I 

(.'C'W.-I, ')[ . / / (A-4) 


Now «inc€ A, i& ryomunguJar, it folkitvit (Brewer, 1978) that 
(/„ ^Aj IS al«w) nofttingular. Thus 

fjk I ■ I) - (/, * a; ' ' - (A/)* ' ' ® A, 'I 

r # y (A 5) 

which U!»ing (A I) becomes 

4«„(*-/-i)-IC®a; ' '-(a,y ' ‘®ci 

xlC®A, - A;®/,J I*i (A. 6 ) 

Ihe prrKif is completed by simply noting that (A 6) and 
(S 22b) arc cquivaleni □ 

Appendix B Proof af Iheorrm 3 

First note that (S 17) is equivalent to 

k I 

<="’(*) X ''’t ' '^i,l^"’(/) + i'V)|. r"’(0)-0 (B 1) 

t II 

Substituting (B I) into its irwri righi hand side, utilizing 
(4 lb) and exehangmg / for m and m for / gives 

k 

f"'{k ) - V (,«(* I >'"(/) 4 

f i» 
k 1 

t V r'"(ii) -i) (B.2) 

/ I» 

where >9(A / I) r U'/' is given by 

A t : 

.A„„{k I 1) ^ IIA,ll*x ’ ' • l!A,ir. I./ 1. 

(H.3) 

B lollow's from (B V), (S IS) and (2 IS) Ihal 

k I 

||:('„(* ■■ I Dlls* ^ Il(/V')® A,* ' ' -|U 

I > I) 

/ I). 0) - I. . . r (B 4) 

Ol equivalently 

/ - I)' ' / ■ 1) (H M 

Tlien frmn (B and IS 17) ii lollows that 

A : 

^ |.«(* / i)*(;,)f;,|^''''(0 ^ i"(D| 

i n 

k I 

+ r'-'((l) -0 (B.h) 

Ihe inequality (S 2S) lollow's Irom (B b) and Lemma V 
The inequalities (S 2b) and (S.27) are an immediate result 
id (S 2b) and the definitions of a“’(A). /J*’'()t), rt'‘*(Jt) and 
//^■*(A) given res|K‘etivcly by (S 11), (S 12). (S.23) and (S 24) 
Heeall ihal the robust stability cAmdition (S,13) holds if and 
only if lor any a V) which is a nominal initial condition 
response for u sincllv nonzero initial condition 

bmi .. 1) Ihal the robust stability condition (S 13) 

IS a sufficient condition for the robust .stability condition of 
Theorem 3 is thus a direct result of (5.2S) □ 
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Abitncl “ A lccdfi>rwiird mclh^HJoUigv (or rapid jrackinj; o( 
^oniplen rc(crt*ncc lfa|ccunic> m shon duraiion luuai 
(fulu-slrijl prtKTvseN is projxKcil (hr nuthiKiohi^n alltms 
casv W'undinp (d ihc aclualiun signal ma^‘nitud<. Ii i\ 
hisjvallv ilcraiivc in naiurc. hul rcKinvclv Iasi o'nvrrit'nuc 
^,in tH“ achieved in (jeneral wiih n compao’ lorniul.iiioi» td ihr 
lUralion algorithm, and parliLularls Iasi ssticri du ss'-iim 
\shivh ihc algonlhni is applied has la>l dsnarnns S»nudai»oii 
n'suUv indicate thai iht mclhiHloloj^v has piojxffu’s dcMialdi’ 
jn ,t pr.iclual implemcniahon 

(n.foJui ti(*n 

\1 a»; s(. INI ouipul »•( a MiachiiH' track a liorn n.ltteru' 
ij.iiiANns IS a tominon iruluslri.il problcrti I <•! cvarnpji. . to 
['kk and place an ohjccl mill a f'trcvisi: patnrn out of a 
r ij^h woikpiccc, asscnildc .md disscmbli cijiiipmcni ri< 
»)l rcqvinc the machines invoKcil to tr.nk a rclcicnu 

ii.i|c\.loiV Tor si»rm' nl thesr prohicnis muH a-- pick an<1 
pl.icr, <Mih Ihc tinal (X siiion and oi o!irni,iiu>n ol ihc 

m.iihinr rnav be <d iiujx)rlancc and ihc m miUion iia«.kinp 

performaine is ollen o( little \alui' I nr tliesi pioblniiv limi 
.an iisutdb be traded oft (<»{ beltei u,Kkint' .iliui.h,\ oi i(.f 
naieciones m.is be cornproniisin^lN pieplanned to lo^AeT 
rhcif oTklcrs to accommodate the plant with a low order 
o'nifollei (Kim and Shin. I in and ( haiif,’. bis') 

Howcvcf il a task teepures a machine lo tiiuk i(ic relricnti 
ba)iclni\ acnviralcls durmg iiiosi part o| ihe (usiialK shiin 
daralioni task such as in assembis thssembls nt (oi 
inereasttJ prodiiciivii\, the iiminv ‘d the moiion id the 
nuivhinc is im|>oilanl Ihc abdits to r.ipidlv ir.ick the short 
rfIcreiHc traieciorv b\ the machine then bci-omes higlilv 
ilesirahle 

I loen a linear time invananl f>lant |t )j a plobaJU 
leedbiH k lineari/'cd pl.int (Hrn/\ b^a I rcund or j 

( artesian rohoij eonnected to a Iiiumi vontiollei m ifu 
stindard (eedbaek control k.onlij!tirabon .md eocn .01 
arbiu.irv reference tiajeclorv with iransler lunciion H it o 
known (Francis and \'idvasaji:;jf Jbh'l rh.ii unless the lo«^p 
tfansicr lurution is divisible hv th( hiryesi mvArian! latiof o' 
fhr demrmmator ' of fi the atji’mows Icedbaik lonirol 
svsieni cannot track the relcrernc traieelofs even 
avvmptoiKallV If the relerencc ira^eetorv o tomplev that 
R IS of hith e der. the cnnlrolier would hast lo be o( hdd* 
order as well in order to achieve |ust asvmpIolH trackin)]; 
Mihoijj;h dclavcd asymptotic iratkin)?. ()c (rackinj<‘ woh 
some eonsiani delas i mav be accomplished wrtfi a dr.idfx:al 
controller and mav be salisfaciorv lor maru applteaiions. 
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such a eoniroUri Ciin fx. designed oi,i\ (iU staf'lv inseilibfe 
plants In am <, hm: it is «uiK uomprohi Hacking vd the 
releiener rh.»' an luitononionv liiii ar Knir invariant feedbakk 
controlled swiein can achieve, at fxsi tor the Mkotii) ifass 
of tasks mrntmmJ I'Hrviouslv where short \et |Wh*Mbfv 
highb compit v u leM int trajcc tones lu ed lo be jnecrwelv 
tr;Kkeif pnlrrublv in-uantlv id (»raeluall> (*<»ssdsle) inp 
defirutcls V^^mp.llainelv loni; tx fon Ihe end ol Ihe tasks a 
vlifterent eonb.d ineihodoKigs must K tl 

In this pafHt we pio(Hist a conbol mcthixltdogv which 
m.tv emddi .* Iiiu ai divi itte liiix. planl to Hac k anv elvolt 
teftrenkC iraieiton ivirkistlv ipjieiU and imssibb imidmtv 
.md (c lake mb' aummi ^'Movsifdt konsoamic on the oorilioi 
Mgii.il Ifx t'-ok melhodologN o iiiiator 01 iiaU' * but it 
h.'i' iH’di ttumulaled such tliai itei.dions m.o be earned out 
cvpnx titiidlv last with fevfHit In iht l oinpulanon.d llrnr 
n qcno fOi tu 

Kapk/ !ttii kote o orm irno /rm 

figure I shows a basu ciuiiml svvu rn srnit.iun toe rapid 
it.ickitig fH the plant I\ when t d^rlolrs Jlie ndetetue 
Il i|c< (itis to be tnu ked and ^ denoics iiitoi illation olh**i than 
I wtiich IS isvcniial to »Ih generation of ihe lontrol signal 
In less I i«. .1 hull lion o! i m real time oyiciiihon H is well 
krmwn ih.ii Mnh open hK»p svsh Ui is Inglils M;nsilive lo 
c viernal iioim lo niimnu/c tins moimIisiIs .js well av lo 
st.ihib/c itu iiltUil III utsc H r op( n h*op uivd.d'k a 
slabiimng feeitbiuk lonliolU i ( i an be viddcd (Iiaii' is and 
Amies. b*Hl I fuiiif and l*i .usfin Vnivas.igai 

icsulling in ifie prop»s<’d (raikiiig wsirrii sirmhuc vliowii in 
f ig 2 I he signal shall lx n (t ried lo a*' ihe iraekirig 
t onfrol 

il IS f, M' v lo senfv dial mu e 1 s|;d>ili/ts tin leedlMnk loop 
ufn n (uci, isioii lonkiMg laking fdan the iiiagmiudc of i 
will ts( I lose lo ,0 TO and a sstft lx n lose lo if Ihriefon'. bv 
IxMjnding ifi*" ( oiTifol signal 1 an be krjfi small to 
f/ieilit.ilc implemrrualroii ol thi itacking ■ vstern 

' ht\fitnJ irai km>; < ouoo/ 

Referring fo I ig Z hi and : r ^ denote the tracking 
eriof and it - M'lpaent c i f \ \alues lOti t-s.^Hmdnig lo iirnr 
k I \ respeitoeb. when tlx tracking eonirol iv 

q </*'"' 1^' h ih noie ifit stncilv i auval 

impulse rcsfioiisc scipiriue /it output i dur lo a unit impubii* 
applied at A '* lo uipui q and let \i.f br ihe nvxfilK alion lo 
be made on q to ndyee Iht Mirrrrd error energy 
j-^ -V"' even luMher Since for a linear limr- 

invartard swrern the injnit signal i auvini,;’ an output einiafs 
ihe decon\<auiinn of tfir iTiilpiii signal wiih (irr wstem 
impuKc resfvonse die optimal \q rc ipiurd lor nulldving 
must saindv 

e*^ h (K .\q ‘ HXq''*' C'C eon volution. 
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hui I HaAit (racking ^y^icm Klructurc 



I fence 

(!) 

wdulil uniquely reduce ir» zero provided ihal /i, ^O. 'fhii 
can alvi h< ohlaincd hy minirni/ing ihe (racking error energy 
rcj^pcet (ti Aq We Mihail assume h^ # () in ihni 
paper unicsis nihcrwisc staled t his can be il<mc without loiks 
oi gencraiily (via reindcxing the impulse responses if 
nctcssary) 

Allhiiugh Ihe optimal (rucking control modificalion in (I) 
can thcorclically rcilucc (o zero, il is easy lo sec that il 
|/i,| approaches /er«>, (he magnUude f)f Ar/, und hence that of 
Ihe resulting control f/ '^” * </" 4 Ai/''^", will tic unbounded 
and impicrneniaiioii of will not he jxissible since there 
will always be constraints on the control signal magnitude m 
practice 

The msliint exact tracking that Aq'^"' can theoretically 
provide is fX'rhaps more than needed lor most practical 
purfxiscs however This is because most of the industrial 
tasks under corisiderahon seem to tie chuiacteri/ahle hy 
three stages of ofK-iatioii; fl) approaching, (2) ficrlorming 
and (T) settling In the approaching stage, the machine either 
approaches the work piece or simply approaches ihe 
work area and trajectory tracking need not he very precise 
at the t>cgmnmg In the ficrlormmg stage, the work piece is 
actually iK-ing worked on or maneuvered and high precision 
tracking is desired hnally in the seliling stage, the machine 
leaves the work-piece or area lo settle into a final still 
fioMtion (most likely also the initial |>osiiion). leady foi the 
nexi task As lor (he approaching stage, more tracking error 
can be tolerated as the machine moves larthcr away Irom Ihe 
work pieee or area in the settling stage However, one good 
fralure lot the control system is (hat the tracking control 
signal converges lo small (il nol zero) value luTinc Ihe end of 
the tracking task This is desirable so Ihul the plant need nol 
be driven to the linul still (xvsiiion f/v7iam{(ii//y (If the plant 
needs to be driven dynamically to the Imal still |xisi(ion. it 
Will need limil swiich(es) to keep il Irom wandering when the 
control signal is removed ) The lollowmg methodology has 
just such p| 0 |KltlCS 

4. /VopoAcd trui kirifi vonfnti 

Suppose msteacl of nuidifying (he cniiie tracking control 
vector q" at once to nullify (he resulting tiucking error, we 
modify the individual elements in i/' one at a time, 
minimizing the resulting error energy each time Suppose 
luither we rnodily them m Ihe sequence if(,. i/i. 
q>, , q^ i. then cycle until tolerable error energy is 

obtained. Hus results m a trucking control generation (or 
f/ learning) melluKlology which would normally allow a 
particular variation to take place on an element of q only if 
such variation will lead (i> the maximum pmssible decrease in 
the resulting tracking error energy Should such variaiion 
iCMill in the particular control vuliie exceeding Ihe bound set 
on q, (he variation can be simply limited to meet Ihe fxmnd. 
TTicn ihe learning process can lx* allowed to eonlinue, if 
more reduction on the error energy is desired. 

To lormulale the optimal modification to make on the kth 
control element in order to minimize (he resulting error 
energy, sup^xiM: / cycles of mmJihcations had Isecn made Let 

* denote the current trucking control (i.c. the control 
obtained after the k lih element of q has iKcn modified). 
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Fi(. 2 Tracking sy-slcm structure 


‘ denote the corresponding tracking error and Ai/** ' 
demote the mrKhfication lo be made on the kth element of q 
(With mXatKins defined as such, it is clear (hat 
' ^ \ ' ^ ‘ and Aqi, ^ ^ Aqi, ' ^ ' 

q* ‘ and ' may also be simply denoted by q' and 
e^-rcspcctivcly } TTien the control and error energy after 
Aq'/ ' is added to q^ * ' will be 




I 

A 


~Ac/l" '/I*. (2) 


where h* ~ (f) f)>i,>i, /iv *)' with k leading zeros If 

Aq^^ ’ were lo minimize * ~ (f‘ il must satisfy 


ci;'* 


-0 - - 2/i‘ («•' 




'h"). 


(-■*) 


TTiis yields the optimal /cih mmlilication 


Aq 


(h\h^) 


k U, , A I, 


(4) 


and substitution into equations (2) results in 


(h\e^' ') 
(h*. h' ) 

Aq',^ 'h* 


{h\ 

(h\ h*/ 


(M 


f;qualions (4) (.^) shall be referred to as the (/-learning 
Algorithm 1 from now on With q'^ and e‘^ now available. 
Ihe priK'css can go on it) calculate the next optimal 
modification Aq[\ , tt» yield ' and ' 

l.emmu 1 The tracking control r/-learning Algorithm 1 
made up hy equations (4)"f^) converges with ^0 and 
q‘ ‘‘ q"^"' as the ileraiion conlinues 

/*roof Since Ihe solution in equation (4) is a minimum 
point, * IS non-increasing Since ‘ is also lower Ixuinded. 
It must converge I qualion (4) is the unique minimum 
solution, ihcrcToie * taiinoi Slav unchanged unless 
Ai/i* ' - 0 V/t This implies lhal r'^ must converge as j‘ ‘‘ 
diK's. Now suppose e'^ conveiges lo c* (which need nol 
equal zero at ihis pAiint of ihc priud) Then Aq/ ‘ - OVA 
together with equation (4) imply lhal (//, v*) OVA Since 
(/i . e' ) /y'c* and // i.s non.smgiilar. lliey furiher imply 

that e* ^ 0 It was shown m Seeiion ^ lhal zero Hacking ciror 
can be achieved uniquely hy r/ ’’'' only T herelore, as * 
converges to zero, q' * must converge to q"^" LI 


Algorithm 1 can be very computation intensive when 
and/or I is large Fortunately, it can he shown ihai the 
formulation for r/'’’ and r'' ' can be compacted in lake the 
form 

/ {I - HI 'H’k' ' -(/ //I (h) 

q' H '(e" r') + - H '(/ - (/ HI 7/’)')e'' f q", 

(7) 

\ 

y. ft.fi. (I 

xm.., y. 

i KK . N .. V h,h. 


Equations (7) and ((>) together shall he referred to as the 
(/-learning Algorithm 2 

Algorithm 2 is much more computationally efficient for 
large i (more accurately, for approximately / > (A -I 2) log- 1) 
than Algorithm I This is dear since for any square matrix T 
and for / equal to some power of 2, T‘ can be computed as 
( ((T^)* 'f in log, / number of matnx multiplications 

TTiis cflicicncy will bet'omc even more pronounced with the 
advent of the fiuM array proccitsors 

Algorithm 2 can be used for as long as the resulting 
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if^-iktcs not exceed the possubk magnitude bound %ei <m lU 
valucn Suppose does not ciceed tbe bound bui q'* doeii, 
and marc reduction on ibc trackiag errof cncri^y /) 

IS desired. If / is slill small, the best approach is lo s^k^tch 
from using Algorithm 2 to Algonihm 1 after q and e‘ arc 
obtained and continue with the g leaming process If / » 
large, then since Algorithm 2 is more eompuuiionally 
cflicicnr, it may he better lo keep using Algorithm 2 lor as 
long as possible before switching lo use Algonihm 1 In ihai 
ca.se, the well known binary scaRh Icchniquc may be 
followed lo find the bcsi q which does noi exteed the 
magnitude bound. 

The result of these ly-lcarning procedures will be bounded 
iracking control q that, when applied to the system, will yield 
a iracking error e with small energy f^uc to the fact that 
in f - (eJt^ gets taken into account A: number of umes each 
modification cycle in the proccs^s, the resulting value >1 r* 
tends to he larger (in magnitude) when k is small than when 
k IS large Hence the tracking jicriormance will be 
comparatively the worst at the iKginning. then becomes 
better as time elapses 

S ConiNrrf^fnce rate of Alffonthm 1 

f quation (6) implies (hat when Algonihm 1 is applied, the 
traclcing error energy will decrease over the (* lih 
Icaming-cyclc by the amount 

\lr'\r - \\e"'r =-{f‘r\l -d- 111 'H ) \l HX '// Hr' 

- (r')'(//(I ') ( 2 :’+ i; .////|i; '// |r'. (r') l r' 


ams'Ctgenet o( Al|ei^riihm 1, d i> tleiuiabk' to dcMgn ( m.y 
that the viable Iredback ss'Stem twdet are rhise lo Ihc ongin 
of the -’ -plane 

h St^mt -friateii on thr 

Ihc <^ leanung pnxevk tutkfxivrd asjkomes the asudalHlit) 
of I/'' and r' II - 0 ibn. r' is the rnmunal iriw king ernw 
before the apptH:atHWi anv ttatling conirol Soih w^vuld 
fKirmalh Ik avadaNc in piacliu o«l\ if the tiasiiiig system 
IS used lor rejKtuive it xcking of the Mime releiem.c 
iraiectors. vuih as mav Ik Ii urid in manuliwluriiig In this 
CA%«\ the pfci|xviied navking nvntfol mcthixhvlisgy can tw,' iisevf 
for on line improvemem ol the timking performance (or 
self learnmg) 

Suppose the nominal tracking error ol tfu system is not 
avadnblc Ihcn note ibui the system m 1 ig * n.«^uivalent lu 
the sysicm in I ig ^ II this rtturvaleni syvicm is miimUy 
relaxed, then h tirislcad ol cun iK genet.ilcd using iIk* 
learning privris assuming e" - II and h” (instead of 
q*') If Then q i«n Ik ohiaincsl b\ Mibitavting / from h 
Note Ihat ihc Hacking contio) q was designed to be in|iecled 
into the system after the loritrolici ( (sci: I ig 2) nuinly lo 
fnciiiialc (he Ivninding of u (by tvoundiiig q\ If the lomrollci 
IS a simple gain, sus A, then Nnindiiig u bin omc\ an easy jofi 
whrihei q is mjcciecl allci oi befotr the conlrolltt 

I'he 1 / learning mcihodology proyioved also assumes Ihc 
asuiliihilil> ot ssimh is the impulse irN|sofisr at v due 

!«' an impulse apt lied al iiifnit q .Sue h res(i>onse can iictuiilly 
Ik likniilicd un line bn the system in I ig 2 using data 
sequences ‘ ind ( i* )*!' Iho is vleai smic 


After some manipulations il am be shown that 


/ - r Ha ')■ 


lh,h, 


h,h. 


. - I 

- 2. 'y/‘ () 


Ihcrclnrc. the closer is to 1 Ihc btsler the rale i*f 

convergence From the forms of H and 1 il can he seen lhal 
if while /t*-0VA.-2. Ihcn I - f. - I and 

convergence will lake place in must onf single learning cveb; 
f or any other impulse response sequence the convergence 
rale will Ik slower 

Ihr value A„,^,, represents the w<irs( ease rale ol 
convergence ol Algorithm 1 when applied lo a given system 
Il IS rclalivcly difficult to compute m general. esfKcially when 
V IS large Also in practice the actual convergence rati' may 
he little or much faster than A„„„ depending on how close to 
! the remaining eigenvalues ol I arc, as well as on the 
tracking error sequence to be eliminated. For these reasons, 
we suggest using the product of the eigenvalues of I for 
comparisons of convergence rales when applying Algorithm 
I to different systems with roughly Ihc same A,„,^s Since the 
product of eigenvalues of a constant mainx equals the 
determinant of the matrix, the product A ol eigenvalues of ( 
IS simph 


A-tfri 




(M) 


fhr above equation indicates that the larger the value of 
relative to the rest of the impulse rcspimsc sequence the 
closer to I A will be This implies that Algonthm I will 
converge fast for a system with fast dynamics between input 
^ output y. m other words, a system whose impulse 
rcspt>nse both rises to its peak value then decreases to zero 
very quickly fhis is consistent with the observation that 
cxvnvcrgcnce will take place in just one learning cycle if 
-b for all k except I Therefore, in order to promote fast 


V u OC h 


il the svMcin IS inili.db irbixid Anv ('HtpuJai unr- shot or 
miifMvc ideniifiii^iiion algorilhiu ewn fH‘ usi tl In uise the 
svsicm were noi mitiallv lelascd when (Wj }' and I v*) 
weiv colledeil, il rnav Ik IkUci to idcnldv the (fVosMblyl 
fewer /laramilers ol ihr liansbo turn hon Itom h I<» v brsl, 
then derive Ihc im(>ulsc response Mr* i ^ from Ihc irsulHng 
iranslei function Uiis r^' bcv ause ideiildvmg the parjimrfers 
of the iianslci lurution requires much lewer .iceunite vets ol 
daiii. rind (he biM Irw ihiui in 1 v, fleflrd the impulse 
response of the svsiern more accuiairly smee Ihev are noi 
aflccied as much hv (he iniiial nMuliiions o( the syslrm as the 
lirsi few ilala are 

Although c«»nvergtnn' ol the q IrHirnmg pOKess will Ik 
theorcliialls slow when h , is small rclativT lo (he resl of the 
irnpulvf rcspniM* scvpicnkc if may siill be s^KCilcd u(' in 
priielice This nun be dime for exiirnple, b\ assuming thal 
(he hrsi Icis small valurs n( ilu impulse rcs|>onse lo Ik zero 
(i c Ignoring iherTi) ami reindnong (he irnpuKr resiKunt so 
lhal h. has a rrlarivelv large rnagniiude Next one should 
iieraie to ohiain q until the Hacking eiroi energy n rtlalnclv 
small (this is a ralher crude idea), then switch track |fi Ihi 
origmiil impulse resfwmsc sequerue and cirnimui ilerating 
until salislaclors erioi energv is obiainrd 


7 Simulutiim rr\ii/n 

Mans single input single outpui second order svsiems w'cre 
simulated m lhi‘ configuration of } ig 2 ( >nc of them has the 
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ilynamiis 

1, l5Sv(M - > Ovf^ IJ \ Sy(k 2) 

1 LSu(A IJ + 2.Sii(k - 2). 
Iff A) >4 IKi/fA 1) - .l.M):VfAj t 2 M4yrfA I). 

v(A)-MJ0 lor k^O 

The profHi^cd i^ kttrntng algcinrhrn was applied in compute 
the tracking control assuming e'‘ is uvailahic (not necessary) 
Figures 4 nml 5 show the results of the system after appilying 
Algorithm 1 to Iciirn // lor 25 learning cycles 

Note that the plant in this system is neither stable nor 
ininirnum phasc If the f/ learning pnxxss were allowed to 
continue for another five cycles, the (racking error would 
iKcomc pritclically undetectable fly setting the magnitude 
lH>un<l on to f>e 22 0. fairly precise tracking is still i>btained 
afler only 25 </ learning cycles lOc results arc shown in I ig 
fi Of course, since has been Ivuindcd below that which is 
rei|uire(1 lor perfect (racking, perfect tracking cannot be 
achieved even if the learning process were allowed to go on 
forever 

In all of the simulation results, the trucking control signal 
nlwiiys seems to he trailed by small (if not zero) values TOis 
IS characlcnstK of the control methodology proposed It is 
due to rniKlifying the (racking control values in the sequence 
f/(d|, r/( I). , Hy the time the last i/fA js are 

modified, (he Hacking error c'liergy is already reduced 
significantly Whai remains lor the la.sl i/(k)s to reduce is 
small, hence resulting in small trailing (racking control signal 
values Such a property is very ilesirable in practice 

H. (Vinc/ii.sio/i.v 

A leedhack conirol mcthoilology has licen pro(>osed loi 
(he practiciil precise (racking ol short iclcreiice tra|eciories 
of orders signilicantly higher than that of the plant I he 
controlled system consists ot a staiuiard feedback control 
loop with an additional input Irorii which an auxiliary 
‘ tracking control’ signal is m)ccled I'he feedback con 
trollcr s(abili/cs the plant m case it is open-loop unstable as 
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Fkj fi. Ploi t)f r and y with </ bounded 


well as minimi/ing the nmsc scnsilivily of the system, while 
the tracking control mimmi/cs the tracking err^ir in the least 
squares sense 

'nie generation ol the tracking conirol is iterative m 
nature, but a compact formulation has been developed such 
that the Iterations can fn.* carried oul exponentially fast 
Besides being able to make the plant track the lelerencc 
trajectory more accurately, it turns oul that such 
methodology will generally yield a fracking control signal 
which converges to a small value before the end of the short 
tracking task This will make it easier lor the planr to seitle 
into Its final still position at ihe end of the lask 

The Iteratively generated tracking control will converge 
asymplolictiJIy to the "mslanl iracking conirol ' loi ihe 
system However, the rale o( cniivergenee depends on the 
magnitude of the lirsi impulse rcs|;vmse sample rel.ilive iti 
those of the rest Hence one can expect in gencr.il lhal the 
faster the dynamics ol the feedback loop the lastei the 
eonvergence will lake place 
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Optimal Hold Functions for Sampled Data 

Regulation* 

Y -C JlJANt and I’ T KAHAMHAt} 


Key W«>rdi --r>i|i:iljl conlrol, lrcdb.uk loiiit.il, cpiim.*! l|■^!ulal.>l^. sampled daUi NVMc nH 


Atwlnicl* r'his paptT lnvcsuga^c^ the 11 ^. 1 - ol (icocr.fh/r<i 
Sampled Data Hold F unction ( ontrol KiSHI 1 to opiirm;c 
quadratic rncasuro i>f pt rlt>riTiiincc in campled vlaia vtnuod 
|)H)(ys Fhe idea ol (iSHT contn>l is to uvt sampled d^Ja 
Iccdhack, hut considci the hold tuiKiion etc a dtsi^m 
parameter F xplicit solutlon^ aic ^i\cii jof the ViSHI 
vL-rsnvns ol the optimal LO and I 0< i rt ^ulaiors I he 
qiiL-stions of existence. uniqueness and eompiiiafmn 
optimal hold lunctions are treated An example iv {^resented 

1 Intrtuiui tioti 

lilt TkAlininNAl approach to sanqiled data conto*! as 
surnes that the discrete lime plant model is ofMamed lioin a 
coriliruitms time svsk-m hs usin|^ prcspK.'cilieil hold devices 
tspicallv. /ertt order 01 (irsl-mder hold (I ranklin aiul Povkell 
PAStli A dq'ilal compuici Ihen implements a diseieie lime 
kOMlrol law In such a scheme, (he sul>sequini mieisamplmii! 
hehavun ol ihe cnnirolleil coniiruious imu svstem is laiils 
well understood (I)e Sou*'*! .iml (ioodwin. I'tKl, flciik’cr, 

I rikuia and Nanaia. I‘^h7, Smsena l‘^h^ 1 t.mklm .md 
1 lUaini Nacim. Kecenllv. howeser anew approathio 

s.irnpleil data control has been ininKluird (( hamm.ts ami 
I eondes. l'^J7Ka.h l‘^7h) |“his methiKl is called tieneral 
i/cd sSainpk t)Data Hold I uncliori ( onlrol ((iSHf and its 
oritjmal feature is lo consivler ihe hold Iuikiiofi as a design 
(Mrarneter I'ntil now. siudies on (. iSHf contrn) h.oe hetri 
pnmariK lociiseil on ihe resuhm^ discietc tinu svstem ami 
lillle has been said abtnil ihe mlersamplm^' l>ehavior n| iht. 
Lnntiolled conliiuious time svsiem I Juan and K.ihanib.i 
Kabamba. PJHo, l'JS7, Kac/orck. Idhs, pMn,/avmcn 
V /,en^, /asgren and 1 am, I'tSt, lain ef u/ I^KcS 

(oeshak .irul V'er^hese. 

In ihis hriel papci. we presenl solutions o( optimal th'si)L*n 
problems lor (iSHl control where the |*erlormam.< indt x 
fvnali/es the inicrsamphng behasmr o( the closed loop 
sysieni I his is act ornplished fn usin|j, [Kiiaitv indices whnh 
are time inicttrals ol a tunction o( the stale ami cuilrol o( \lx 
rejiulatcd continuous lime system Ihe opiiiTikalion problem 
(hen luiconies a siandaid optimal cv>nUol pfeihlcm but where 
the control variable' is the hold functum ilself F xisleiice 
and uniqueness of an oplimaf hold f inclion is (ooved Im a 
wide class ol optimal (iSHF regulalion problems Ihe 
specilu prnlslcms solved in ihis pafxr arc (iHSI control 
versions of the linear qiradralie and linear quadratic (i.tus 
Sian rejitulators The solution of these problems ioj»ciher 
w-ilh our results on existence and uniqueness of i»ptimal hold 
Uinctions eonslilule the lUl^lnal conlnbnlnin of this siuiU 

' Received ?l May IVKK. revised 7 March ('/‘Ml, received in 
linal form 2' Julv 1W). ITic onpinal version of this pa|xi 
was not presented at anv IF AC mceimp Ibis paper wc.s 
recommended for publication in revised lorm b\ Ass<.uiate 
f.ditor R V F’alel under ihe dirLClmn of F dilcn H 
Kwakernaak F^artiallv supported bv NSF under (*rani 
IC'ST<7::244 

' Acrerspace tnpmcennp Dcparimenl, fhe I niversity ed 
Michigan. Ann Arbor. Mf 14b. I S A 

1 Author to whfjfn all corrcspmdcrrce shouU! fxr 
addressed 


Sever ul authors have inves!i|!i,ilrtl the intersamphnft 
fx'hasioi of Sampled data lonlnd svxtcnn IFormto and I rvts 
i iu7|) vhowe.i how to ctunpviU' the (H'nalt> matriecs o| « 
disi.reli/ed It.Mf problem bused on iKosr ol » contiiuious 
lime I UC» problem assuming /no order hold I )e Stiu/ti 
iind liioyKtwin ( b/S4) prrv nied ;i mc thuKi lor komputiivg (he 
lime survitig ivutput uivariunu' fxdwcen sampling msianls 
Finger (suggesied Ihiii the oiiipui lx-iwren samples can 
be ptcdicied In a lincui luruiton and uvnl iho in adiiploe 
vsniirol Kippk liee Lkadbcui coiorol I<m sampled data 
sssleriis was mvi Ntigaled m I nkuia and Ntigalu |l‘4K7j and 
SiriM'iiu »iml a necrssaiv and sudicicnl iOtulilion was 

given I riinklm and I niaint Nanni sFiowcd ihal a 

continuous imu internal ituhIcI ts nruess.irv ami vuftlcicni to 
pi I vide nppk Ircc icsjxium' Ioi the lotnisi m tvonii;: banism 
Mowevei all these sludres assume that fhe hf4d tunciioris are 
run part of the design problem 

t.icncrali/ed sampled liaia hold luiKiton eontiol has iH'rn 
investigated lot fmiti dimensional, continuous lime vysiniis 
(Kjibjinbu. lUh' iuan and Kiibamf>a. I‘/H7. ( harnmas iind 
Lcirndes )n7Ka b, Kabamba. i'/Kfi) tmite dimenivionul 
diwieii lime svMems (K;u/oiek. and mlirnte 

dm cnsinn.il umlmuous turn systems l /avgren. l'J>H t /eng. 
j'M' /.avgren and larn, l‘/K4. I urn rf , P>Hh| Hit 
kindred idt a ol (seniHlic cotTqHMtsaiion i>l lime itnariaiil 
ssNieriis tias also received allenlnm ((oevluik and VerglieM:, 
l‘JK2 Khaigonekai rf ai I'tKS) Ihe pnrnaiN loncrin of 
iluvc studies has Ikcu tFu: projHnIrts of the discrete lime 
ik»sed liMifi system bctausc they determine im|vrriun( 
kharactensiKs ol tlie coniiinious time svsieni such as viabihiy 
ami deadbevil rcsfwtriM As a mnvequeme. the inlersatnpling 
Ixhavior «d ujidiiuious iirne systems under t »SHF rcgutalion 
has icieived lilik alicniion llowevei in Kabjiml>a (l'^H7) it 
was shown tha! in (»SHI control, fho inieisampling behav'ior 
m.iv lx imsatisiaciorv This phrnomeni'fi inotivatrs iFie 
present si ml', 

7 rrffhirm formuluitnn. nofi/fion^ arid drfinim>/n 

We ijM’ Iht (olkiwing siandiinl mtlaiions sufmscript I 
tienntes matrix trarisjK»v\ / ( I denotes r npeeled value, li i ( 
denotes the Hate of a matrix, d ( ) denotes the Kroneikci 
vvrnfsol m Utih the diM ren tim< and tonimiiouv time ium' 
denotes the idcniiiv matrix of intlrr p I A t A' • 1/V'" and 
denote Ifrc ttdiimns o( A as 1 , / 1 ri, 1 e A' 

ft, i^j TFre vet ci|X‘riiior f>n A' is defined as 

vet (A ) t<*l where vet ( A' ) * '' 

We comvidei finirr: dimensional linear time invariant, 
continuous time svstems under sampled data regulaiton as 
follows (see F ip 11 

fTant and sampler 

I (/) Atii\ -t Hum wfr) (2 H 

:rA) - ( i(kT) a vik ) (2 2) 

Digital com pen sal or 

f 1) t,/CfA ) (2 3) 

v(A) - ,VJ(A) 4 PCfAl f2 4) 
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Fi(< I Feedback conliguralion 


Dtgfliil to un^ldg conversion (Mold device) 

M(f) A(Oy(A). r f |A/. (A 4 I)/) (7 5) 

Mr) - tU ♦ / ). Vf (7.6) 

where 4[(0* *hr plant stale vector; i/(/)i \H'*' is the 

control input; is a disiurhancc vector. C(A)f |A^'‘ 

and i/(A)iUW^’ arc the discrete measurement vector and 
drserete mrasuremeni noise vector, resficciivcly, ^(A)f \fi'* is 
the compensator stale vector; y{k)^ \H' is the compensator 
output, / (I IS the sampling period, is a 

r pcruKlic intcgrahle .md briundrd mairin representing a 
hold function; and the real matrices A. /(, ( , f\ f/. V. V 
have appropriate dimensions Wiihoiit loss of generality, we 
asAumc that the matrices ( and ( S, V-') have linearly 
independent rows 

TTie formalism of etiuaiioris (2 1) (2 6) is ijuite general 
/xrro order hold (lirsi order hold, ilh order hold) control is 
ohtameki by letting the hold lunciion MM be a constuni 
(hrsl-dcgrec iTolyruirnial, rih-dcgrcc polynomuil, rcsfiec- 
tivcly) Mso. by letting i/ II. r p. and V we obtain 
the formalism of (iSMf control with direct output feedback 
used e g m Kabamha {\W) 

f or a given hold function / (/). i c [d. 7 ), the problem ol 
de.signing the matrices A'. / V. V for performance of the 
corTes(xinding discrete time system has fx-en extensively 
treated in the lileraUire [see e g. Franklin and Powell 
(19H0)| Our objeetivc m this paper is, for a given 
compensator (2 M (2 4). to determine time histones of the 
hold function h{i) in (2 (2 h) ihal will optimize various 

performance criteria a.ssticialeil with the sampicil liala system 

(2 1) (2 6). 

Upon liMip closure, the stale and control hetw/cen samples 
satisfy 

r(A7 > M ) ♦ /)(/).SiO) I 7)(MV i'(A) 

r mMA J 4 M. I i (0. 7 I (2 7) 


= I(2.15) 

then the cloised loop equations for the discrete lime system 
arc 

xjk + l)-«P,Jc,(A)4^0,idA) 4 wjk) (2 16) 

Tile dosed hwp monodromy matrix is defined as in 
(2.13), (2 16) and denotes the state transition matrix of the 
regulated discrclc-time system over one period 

Definition Ilic design problem of finding an optimal hold 
(unction 7(t), t e |(). 7 ] is called a fixed monodromy {free 
monodromy) problem if D{T) in (2.10) is specihed (not 
specified) 

A fixed momidromy problem must therefore satisfy a 
design constraint of the form 

/)(7)- (;, (2 17) 

where typically, the matrix (7 is chosen such that the closed 
loop monodromy matrix of (2 I.M defines a stable discrete 
time system (2 16). 

3 Ljnear quadratic (iaussian rrf^ulation 
Throughout this S4H*fion we a.ssume that w{i) and i»(A ) of 
(2 l)-(2 3) arc stutionary Ciaussian prcKcsscs satisfying 


F;|»(f)| = o, ( 

fiR. 

(3 1) 

/;|iM*)| -o, k 

e |;V. 

(3,2) 

F:|b'(/).-'(*)1 = 0. f6|«, * t |^; 

(3 3) 

F,[B(f)K '(T)| ^ R, d(t - r). r, 

Te|«, 

, (34) 

F.|i'(*)i''(i)| R„ A(* -il.k. 

l€l^\ R, ~i)\ 

(3,.S) 

t|K(/)4'(0)l -- 0. 

1 1 \R\ 

(3 6) 

F.|..(*)x'(0)l =0, 

A € 

(3.7) 


u(k r i t) h{t)V( X (A/ ) 4 MM,Sc;(A) 

fMMV iMA), tf|0. 7| (2 H) 

where 

<P(t) exp(AM f /)(M(‘, re |0, 7| (2,0) 


7)(M I exp (Alt r))WA''( r) dr. t f |(l, T\ (2 !()) 

AI 

-A/.. 

ai(A7 4^ t) =' 1 t'xp(A(A7 4 r T))x(r)dr, 

U r 


Defining 


te|(). 7) (2 11) 


ij*) .= ii'(An. ''(*)!' 11«"' 


liquation (2.^) implies that (ji(A) is a stationary zero-mean 
white Ciaussian sequence with covariance kernel 

/;|t..(*)tw'(.)|= R.JT)fHk - 1). (.VS) 

'?,„(7')“[ cxp(/«(r- T))W.cxp(/l'(r- r))dr (VJ) 

7(1 

Ilic f>crformance index has the form 

/= lim f(' [ (x'(Jx +ii'«u)d/), (.5.10) 

ff I t,r I 

wherr RelR"”"'. « = 

/?■>() The criicrion (.1 10) can also be compuicd as follows 
(see Juan. 19SS) 
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Propostoon 2. Suppose ■ hold function F{n, /e|o ri 
subiiizes (2.16) nsymptoticaUy Then the cnienon (? 10) c*ii 
be compiiied as folk>ws 


J » ^ QP^iT]] ( V I2l 

where L. e |ff'"N.(f)f /‘.(Mt lW’-' «.c 

obtained as follows 




D(f) “« AD[t) 4 flF(f). [){(\) a 0 (3 13) 

eKp(/4^) + C'V'D'd)] 

S^D'(t) 

K Q\exp (>4i) + D(I)VC. D(f )S1 

rc'v'^f'dii 


expiAT)-*- Dmve D{r)S 
VC P 


(.1 141 


rcxp(/4’r)-I r'i''z)'(r) c 'v' 

^*1 .s'n'er) r' 


0{T)V-\ 


/. - (1 
Cl l.'>) 


[ l/V‘n',;;C>0(T)\^' ■* V'f'(rm(r)V|di i.l l(.) 

■^(1 

I - [ tiT 

Jfi 


rjn^ 


P) 


Proof First rewrite (2.1(1) as ( Vl'^) Define 

lim f'|ji„(/: lJf^(A )| 'Die .stahiliiv of (2 1^) implies that /tan 

4 

he computed hy (3 IS) Mtircovcr. simple algehrun 
manipulations based on (2.7) (2 II) imply lhal the com 
( 3 11) can be .omputed as (.3 12) subject to ( 3 13) ( t 17) 


(a) Free monadromy 

f'roposuion ^ A hold lurution /(M.m |b, / | which 
stahili7.es (2 lb) asymptotically and minimi/ts (3 10) mu.M 
Viitisfy 

( ' V’ 

■ 2KA(/)|VT , .V|/,, 

~2ftHl)VK„V'‘ :.t) (3 IK) 


where T(/) f l/Sf'’ "' saiisiics 

*V(|)= -/4'ip(f) + 2e|exp(^i) + , f)(().V|/.„ 


(I V ' 

.S' 

'f'(r) - -2 |;„.())a:„ 
A' 


^ 2yD(/)V7<..V ’ 

exp (A 7 ) + D{ 7 )V ^ D(7),S 

UC 

73(7) V' 


U 




(3 Fo 


(3 20) 


f;4:|tialM>m ( 3 13|-l 3 21) tktmc a iw(» poinl bottuclan valiwr 
prt>Wcin lot the two n n r matneci 7>(i) and Tbc 

hntx»rd<rr gradiem al|eiin(hm c»l Brmwt and li« 

hern uml sutXTicklulls to aunpotr attlulMtfii to tlir«: 
equaiiom The ctanit«ln) wf have irraied Kumte«i that m 
Itenerat. i3 13)13 2!) alwnyi^ hMS't a wilumm when the trtpk 
tyl H ( ) (2 n (2 2* IS minimal but thai ihw ncduium w 

not m grnciat utm^uc Mowrvri in the caw td bird 
monodromv. we can firuai aniee K>fh einnenoe and 
unique ne«k.v 

lb) Fnfii monodrumn 

PrtFfMHiikm 4 It the triple (.4,/I < ) td (2 I F (2 2) n 
rfimmal. and ifie nuiru ij of (2 !7| tv such that the lyttftn 
(2 lb) IS asvmpiotiialh stable, then lor almost all T the h*4d 
luJHtion 7(f), M jo 71 whiih minimi/rs (3 10) kubjirei ro 
(2 l) (2b), (3 D (3 1^). (2 17) exisU and is unique It 
.sat I she s 

/>(/» - AVu\ t \HK 

• ||K ‘ - CH,\ 

II. (>(/) < (V22) 

If'lf) ■ 4 'H'im * 2t>|fxp(.40 ♦ , />U).S1( . 

I ('' F ' ' 

t 2C'/>(03 7f, 3 * ( 3 23) 

7(f) * \H V|f, ♦ V WJ * 


(3 34) 


where /is the fsosjiivc srmulrfiruir volution ol (3 15) 

/Vtro/ See Juan ( l^fKK) 

Notice thill (3 22) (3 23) can tx' rewritten as a stamlartl 
Hamiltonian two [H»ini Ixriinaiv siilur problem for the 
vectors vi l(/m and vcc(3|‘) I hr ihirci volution o( (3 22). 
(’23) thcirfoii icquires iinl\ volvinit linear cquatiom 
(H»> on and Ho. I^7M 

4 I jntaf quadmltt rr^klunon 

Fhrou^hmji tho section we assume there is no disturbance 
and no measurcmcnl noise we are legiilatinit the transient 
lichavior of the chased hxip system agarnsi non/cio miOMl 
conditions In (2 I) (2 3) wr avsurnc 


»*(/) 

II. 

(4 1) 

/ (1(0)) 

0 / (id)) '1. 

(4 2) 

' ■! i«i) 1 

li'ioi i'dir) - a;: 

(4 3) 

and the jxTforrnauic: index has the foim 


' "I,.' 

(j '(/i t u ' Hu ) ill ). 

(4 4) 

where (J * 7" ' '7 0 


H R '. 


R (t 


cxp(.4'7) + C 'V'D'(r) C‘V' 

S'D'iT) P' 

texpiAT)^ I)(T)VC fJiri-Vl 
* '^4 UC f I 

4 MJT) - A', = 0 


(a) Frer monodrorrty 

Rntpoutum S A hold function f(f ), / c |(t, 7 | which 

siabili/ev asvmploticallv f2 )b) and minirrn/x-s (4 4) vub|ccl to 
(2 1) (2 ro (4 1) (4 3) ,injv( satisfy (3 13) ( 3 2.1) where 

RJf) 0 

0 0 


and the matrices D(r). and Mj!\ arc given by 

(3 l3)-(3 15) 

f^oof. The optimization of (3.12) subject to (3 13) (3 17) is 
performed using itandard optimal amtrol theory, but where 
the stale vanahic is the matrix Off) and the control input is 
Ihc hoki function FU), yielding (3 lH)-(3 2D See Juan 
(KWI) lor details. 


IS replaced bv A^, and is ie|:>la<ed hy b Ihe optimal value 

j (4 5) 


(b) filed mrmodromv 

Prop<nitu>n b If the triple (A. B. f ) of (2 11 (2 2) rs 
minimal and the matrix O of (2 17) is iwjch that the mtem 
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(2.16) IK ftKymptriticafly Mabic then for almmt all T, the hold 
function f’(r)» r r (0, 7 ) which minimL4c;K (4 4) iiuhjcct to 
(2.1)"(2 6), (4 l)-(4 3), (2 17) ckisu and unique, ft 
MatiKfics (3 22) (3 24) where 

f^JT) 

0 


pling behavH>r Note that the divcrcle compenAitor has rtoi 
been cho»cn for optimality with respect to the performance 
index, because this optimization should depend on the hold 
function, and the effect of optimizing the hold furR'tion alone 
would then be difficult to assesss 
The plant is a simple harmonic oscillator with position 
measurement of the form 


is replaced by and H, by 0 fhc optimal value of (4 4) is 
then given by (4 S) 

Remark I Proj^»sitions 5 and 6 reveal that the linear 
quadratic regulaUir is a particular case of linear quadratic 
(iaussian regulator where ff,, (I and AT" replaces 

HJT) 

(I 

In other words, opiimr/ing the transient |scrf<irmancc (4 4) of 
a noiseless undisturbed system is equivalent to optimizing the 
steady stale performance (3.11) of the same noiseless system 
under some properly dclincd perturbations 

Remark 2 Proptisilions 3. 4, 5 and 6 illustrate the fact that 
fixed monodromy problems are easier to solve than free 
monfMiromy problems Not only can wc guarantee existence 
and uniqueness of an optimal fixed monodromy hold 
function, but it can fn* computed directly at the extiense of 
Milving linear equations On the other hand, for free 
monodromy problems wc caniioi guarantee existence of a 
solution, neither can wc guarantee its uniqueness, nor can wc 
guarantee that the iterative algonllim wc used will always 
converge. The hierarchy of difTiculty between free and fixed 
monodromy problems is rcininisceni (»f the problem of 
optimal 1/ model reduction (Wilson, where, if the 

poles of the opdmiil reduced order model are Ircc, it is not 
guaranteed to exist, nor to be unique, nor to be computable 
by rt convergent algorithm, whereas il these |Kiles are fixed, 
the reduced order model is computed directly by solving 
linear equations 

S. t xamplr 

In this section we illustrale the use ol the results ol 
Sections } 4 Wc compare two sampled data regulators for a 
given plant with resfKci lo an integral t|uadiiitic performance 
index Ihe first regulator is obtained by using a standard 
zero-order hold, preceded by a discrete com)X‘nsalor based 
on pole assignment Ihe second regulator is obtained by 
using the same discrete com^Kiisaior, hut optimi/ing the hold 
function with respect to the pcrlormance index, under the 
'fixed monodromv consirainl that ihc tii.Mrrtized plant in 
the seamd i nnfi^urmidn he (he uime the diM reii:e(l ptanr in 
the first I on/ignnmon In olhei words, wc show that it is 
pos.siblc lo improve the (xrlormance ol a (cedhack loop bv 
adjusting the hold function, without changing the discrete 
LomjH’nsator nor Itic discrete model ol the plant .Such an 
improvement is then due exclusively to a better intersam 


0 -5 

5 0 

11 ()|x 


I* ^ 


(5 1) 


The sampling period is 7 - 1 

(A) The first controller is implemented using a dynamic 
compeniuitor and a zero-order hold 

u(r)-^ yik), (€\kr. {k + 1)7 ) (S Z) 

The discretized model of the plant is then 


x{k + I) 


0 2H37 0 9.S8M 
"II.95H9 0,2837 


(1 1433 
-0 1918 


y(A) 


t(/c) - [1 01.x(A ) 

ITic dynamic compensator is 


(S3) 


D- 


-0,116732 
0 20.S7 


0 373,S 
-OS 




0 5673 


0 K7.S 


y(A)-( 15094 4.0H/>|t(/l; (S 4) 

and has been chosen so that the closeil loop eigenvalues 
are located at il Ox 10 \ and 3/ ^ 10 ' Ihc cost luiuiion 
has Ihc form (4 4). (4 3) where 

c- ‘ " 

0 1 

R V 1 

(I 0 {)-^ C' 

I I) 0 
0 0 II 
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For this regulator, the performance index i^. computed using 
Proposition 2 which yields 

47 82. (^) 


(B) Ihc second contioller C[>nsists ol a sampler with 
gcncraii/cd hold function, logcthei with the same iliscrele 
compensator 4) Ihe hold function is consiiamed such 
that the discretized plant is the same as (.‘> 3) In other words, 
the closed lcK»p syslems A and H have Ihe same dynamics al 
sampling instants However, m case H. Ihe hold function is 
chosen so as to optimize the cost lunciion (4 4). (4 1). (S S) 
Aplymg Pr(qx>sition 6 yields the hold function ol Fig 2, with 
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which rcpreiicnts a 47'^f improvemcni over ( 
h C 

The mam coninbution ot this paper has been k> prcscni 
methods for i>piimizing the inicrsanipiing behavK>i of 
sampled data control systems Tbe basic premise is that the 
hold function ilsell is the design variable We have presented 
explicit solutions to the optimal LQ and LQO regulation 
problems It is found that fur fixed monodiomy problems, we 
can not only guarantee existence and uniqueness of an 
optimal hold function, hut wc can compute it dirccilv bv 
solving a linear two point boundary value problem ol 
Hamiltonian structure Hus brief paper has only presented 
(he basic theoretical results on optimal sampled data 
regulation by GSHF Engineering design issues and detailed 
examples are considered in Yang and Kabamha (IVHX) where 
il IS also shown that CiSHF control can be used ic achieve 
simultaneous quadratic perhirmance in several control lo<ips 
using the same conirollci 
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An Indirect Prediction Error Method for 
System Identification* * * § 

T. SODERSTROM.t p STOJ( AJ and » FRllDI ANDERS 


Sysicni idciUitKaiUMi; paranirtcf c^umalh^n. ntcthiMl, nutdrl \iHKiurc, 

maximum likclihAXHl mcthcKls, (jcnciiiU/cij »eaM MrquArrs 


Abrti»ct—A new form of prcdiclion error mclfuMj (Pt M) in 
developed ll is appitcahic to iht case where ihe model 
siruciurc of micresl can be imbedded m a larger mink-l 
structure whose estimation is relalivcK easy An optimal v^av 
of reducing the larger model lo Ihe smaller model structure iv 
presented and various intcrpreiuiinns o( this reduction are 
given I'hc proposed method will have the same asymptotic 
Statistical properties as the standard PlIM but it can be 
implemented by a more efficient algorithm Ihe propciiies o| 
the method arc illustrated by the means of some simulated 
examples 

1 Jnfnniu( tton 

PklDIcnoN IRRIIM methods (PF.Ms) (I )ung. I07 m, aie mm 
well-known itxils to get slaiiMicullv efficient pai.imeiiK 
models in system identification C onsiderable iriiercsi has 
fn-en devoted to developing alternative meihtKls and 
algorithms which require u lesser amriuni ol compuiatmn 
without sacntu'ing too much of the staiisiical cflicieruy 1 his 
paper follows this line of resc'urch 
C onsider the case of two nested model structures A/, and 
A/,. I e let Af, be a subset of M. (tllusiralinns ioc given in 
Lxamples 1.1 iind I 2 below ) It is assumed that a F*I.M is 
relatively easy to apply in A/. We will present and analyze 
an identification method, winch piiKluccs a model iii Af, 
using the Pl'M moilci parameters in Af. as the data tor this 
estimation Due to the two step poKedure 

measured data m<xJel in M- ♦ mi^dcl in Af, 

we will call the proposed mcthml an indirvi i predu iufn error 
method (IPI:M) TTie IPliM cslimales will tie shown to have 
similar statistical projK-rties to the Pf-M cslimales in Af, In 
Mime circumstances they can be computed much more 
efficiently 

Note that the second step in the above Sihimc makes 
sense*, even though M, iiscK may pi ovule a reasonable mode' 
lor the system under study According lo the parsimonv 
principle (sec for example SiKlersirom and Simta ( I'^km) lor a 
general treatment and .Storca and SiKJersirom fl^H2). Sloua 
et al f IMH.Sa) for some specialized anahsis), vimc ai curacy is 
lost if an unnecessarily complex model structure is used (such 
as Af. instead of Af,) 

* Received 14 October IWl. revised 24 April IMHM; 
received in final form 25 Apnl 19*^) Ihc original version ol 
Iffjs paper was not presented al any IFAf meeting fhis 
paper was recommended for publication in revised form by 
AsMKiaic hditor D W C larke under the direction of Editor 
P C Parks 

^ Automatic Control and Systems Analysis (iroup. 
r>epanmcni of Technology, Uppsala University. PO Box 
S751 21 Uppsala, Sweden Author to whom all 

correspondence should be addressed 
t Faculty of Automation, Bucharest Polilechnit Institute. 
Splaiul Indepcndcntci 313. R-772(>h Bucharest Romania 

§ Signal Processing Tcchrwlogy, 7(13 ( oasiland Drive. Palo 
Alto. CA 94303. U S A 


VAr nvsunu that I'KHh model slfmluirs. Mj aryd Af,. are 
given u pnrtn Ihis mighi n<»i Iv the cast in For 

determining an a|>{>fopiiaic iinnkl slrmrtufc Af, i»n< c-an 
apply the a|>juinich piofHrsed m this fuifwt lo riHHleb of 
varKius outers and validate them with siamiard means, see, 
fi>f example. SixIcrMrOm arul Siinta II9N9) |>m: 
model si) obiaim*d can ihen Iht taken ns the liiiAl one 
Similarly, art apprt^pfialt nuHlel order (oi M, can be 
determined by ciaivdard mcibiHls 

Next Iri us cyhihii two typical cAses ol nested or 
hitrarchtcul miKlcl Mrucuiies .if, and A#f In Inuh iaacii wc 
will let ff denote the parametei vector in Al, while Al, is 
paiameln/ed hv a vecti>i ci 

Lxumple 1 1 ( Ihc generalized least squares sliuvuirc') 
lei Af, fK- given by 

M, /-(.(v 'k(/I «,!</ ')iiin * ^ dial 

In (! I) u(n drnoirs ihc input signal i(ri the output signal 
ami fi/| while nois*,' The |>olvnorTHMK and the pnrumeter 
vetiiN H are 


.A,(y ‘ 

) , 1 ♦ ' 

* * “llj'iV """ 


«;(./ ' 

) ■ ’ > 


(1 1h) 

( ,1.; ' 

1 ■ 1 »1 V'l/ ' 

1 ( 1 1 . »»• 1 

■4 • ' 


0 


i,( 1 1 lit .1 O 1 

'U/-, <1 ,1 

' (1 U) 


and ly ' dcnnics (he tNukward Nhift utH'iator A nuKlel ol 
this lorm u used loi example in the genernli/cd lexst squares 
((il S| methinl cl < larKc (U^»7|. StHittsirom (|974l 

B\ nnillipivmg ( i la I with f ,(r/ ') we tan rewnic Af, as 

Af, A,uy 'it KIO ffd'/ ’»< |(9 '(«(/) W(/l 

(1 Id) 

Phis ni'KlcI IS a lineaf regresyion with umMraintx, since the 
jxilynomial npi ralors have f ,(</ ') as a common l»ctor By 
ncgleciing this irmstrairn we at live al ihe miHlel viructurc Af; 

.Af, Mu 'iv(n h_iq ’)u(r) + e(r) (I le) 

where deg A nw nu, ^ nr , deg H , nh ^ nb, > ru , 
lire paramelct vecior n is 

hV <1.10 

Example 1 2 ( AR process otrvervrd m iioim:' ) Let Af, 
miKkl an aunvre gressive pT<vcevs observed in additive while 
noise Such a model is frequrnily used in various xigiial 
processing applications ll can Ik written us 

v(r) - * , o(/) ♦ wir) (1.2 a) 

^\\q 

Ixi the while nom sequence* idf) and H'(f ) have vananeex 
o, and rcspeciivcly Fhc parameter vector ff u given by 

rz; cz^^l n 2b) 


l«3 
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Ihc spectral demny of y(/) is 


(py () 


rr;; f ) 


(I 2t) 


Hy using spectral facNui/arion. (hr measurements yit} can 
alS4) be represented by an ARMA nwKicl 

M, A{q ')>(/) M ((/ ')<(!) (I 2dt 

where ( (if *1 - I ( 1 ^/ ' + f c„q '' and rr;’ - arc 

given by 

fr;( (e''*^)r(c '‘*) «wr;’ I #r^y1(e''*)A(e "') (I 2c) 
fhe parameter veciur <t for iVf, is 

a \a^ a„ f, ^K\' ^ 

Hoth minJcK, (I 2a) and (I 2d) arc valid represcntainms of 
V(f) However. (1 2d) has the diawback of being a 
nonpursirnonious reprcsentalion |it has n I parameters in 
addition to fl 2a)| f urthermore, for most applications the 
parameters of interest are (I 2b) (m particular the signal 
parameters a, and r/;,). not the parameters of the A KM A 
representation of the signal tonoise process ' 1 

Other examples of nested model structures are described 
by Diisgupla ei al (l‘MK) fhev treat the siiuaiion when ff 
corresfMinds to a set of physical parameters and show that in 
many eases a is related to 0 in a so called multilinear 
fashion Similarly, Hastin rt al fl‘JHd) give eases where M 
describes physical parameters These authors show that lor a 
large class of models, the model can be written as a 
nonlinear regression and imhcdded in a linear regrcssnin 
nioilel in /Vf, 

I>ie ll'I M can he viewed as a way for modrl nuiudion. 
since the larger moilel in Af, is reduced in Step 2. A similar 
principle, iilthough ruif hascil on a IM'M, is suggested by 
I'oral and Tnedlamlei and Kosen and I’orat (IMHb) lor 

time senes analysis In these relerenees, lilting a model m 
M. consists ol estimating the covariance lunciion o( the 
signal, which can he done hy a simple firocedure In the 
second stage a parameleric model is litled to (he covariance 
function data, A similar approach (or AKMA modelling is 
projHiscd by Sloiea rr ul fl'^fHT) Moses (1‘^Mb) gives a 
method where the eovarianee function ol a time senes is 
estimated in a first step while technujiies for approximate 
reali/alion and model reduction are used m Ihc secoiul siep 
Wahlfvcrg (l‘Wi, l‘>K7, l*fH‘)) has proposed an alternative 
approach in which M. eories|>onds to an auloiegrcssive 
mmlel of large order Such a rmulel can fu’ compuieil easily 
since it IS the solution ol a linear leasi‘Si|uares problem 
I urlhcniiore. ihe problem of reducing identilied models has 
also been discussed by Jakeman and Young (l^^thl, NHA) A 
situation similar to the pieviously introduced problem iKcurs 
when using the U[iproach of inilirn t idt'ntifuation to estimate 
the parumciers of a system under lecdhack conirni see 
l.jung el al (1d74) or Sodersirdm and Sioica (IWI) for 
details. In such a case Ihe closed loop system is lusi identified 
(which in fhc framework of this paper corresponds to fitting a 
model in M. to the data) In a second step (he open Imip 
dynamics is solved for, assuming the feedback is known 
Since the ofnin loop system typically is of lower order than 
the closeil loop system, we have a model reduction from .Vf. 
to . 

The paper is organized as follows In the next section the 
IPrM IS introduced formally and some interpretations of its 
secoiul step. i,c reduction of iVf, to M,. are given In Section 
} Ihc asymptotic distribution of the IPliM estimates is 
established, W'hilc Section 4 is devoted to implementation 
issues of Ihc IPLM 


2 The truitreet pmiu fon error rntthini 

Tor a detailed discussion of prediction error methods and 
then role in system idcmificalion. see l.jung (l^7n, IMK7), 
Sbdcrsirdm and Sioica The PF. csiimaics of ff and n 

arc given hy 


n ^ arg mm V , ^) 12 lb) 

where \ is the number of data points, and r ,(f 0 ) is the 
prediction error 

r ,(r M) - y(r) y(r f / - 1; f/) 

in the model structure A/, and similarly for * a) 

We will impose the following two assumptions on the 
model siructures .Af, and M. and the data 

A I I he Structures are nested 

A/,c:A/, (2 2) 

so that there exists a smiKith map 

£1( M) A, c y. c ^ 

such ihal 

r .(/, n(fy)) - r,(f l2 1) 

Turthermore, dim ff dim (y and is an o|h:! 1 (nonzero 

measure) set m such that / is a staiionarv 

process lor any ff f A, Wc assume that Joiff)/ has 
lull rank over A, [ j 

A2 Both siiijcliires give paiarneter idcniifiabiliiv Thi^. 
means lhaf (here exist urntfttt'. ‘ tnie’ . parameter 
veclofs u' and fV' such lhai 

1 ,(r. fy*) / ;(!. o*) IS white noise ol zero 

mean arul variance A , ; (2 4) 

NcyIc ihal (2 4) and .issurnpoon A I impU 

0* - rY(fr) C! 5) 

Assumpiion A I is solely a condiiiori on A/, and Af , while A2 
involves also the properties ol ihe dai.i (“ ihe svsiem’ ) 
Assumption A2 may seem sirong The recjuirenicnt ihai (he 
quanlitv in (2 4) is white noise is ru'iiher needed lor 
derivation ol the estimator (2 d) not the interprelalions 2 I 
ami 2 A to follow li is neeilei! (hough lot the Ml 
interpretation 2 2 and m the analysis ol asvnipionc projveriies 
(Section ^) 

f.xamplr 2 I | The map rY(fy)|, In I xariqde 11 the ma|i o(fy) 
IS m irnplicil lorm given hv 

.•l.(c) - A,('H > /fdc) ■ ’ H (2 (Kii 

In (his ease 

dim u m/. + nh . na, 4 nh, ^ 2m , 

• nu, i /lb, ^ rn ^ dim ll (2 hb) 

In I xamplc I 2 ihe map old) is implicillv given by fhe 
ideniit \. I I 2e) 

r7;( (z)( (c ') - (tN (}'^A{:)A[: ') (2.(k) 

Here 

dim ri - In f I ' /i ^ 2 dim (( i j (2 t>d) 

Since is a subsei of .Af, (and hence a more parsimonious 
model slruclure) it will give a more aecuraie model than M 
according to Ihe parsimony principle, see for example 
Sodersirdm and Sioica (l9Sd). I'hereiorc Irom the u( rnrtjt v 
standpoint wc should be mleresied in the esumabon o( 
,Af,(d) Now . ii mav happen that 0, (2. la), is more dilticult 
to compute than d. (2 lb) This is clearly ihe case m 
txiimple I I since A/> is a linear regression 
Due to the above consideraiions it may lx* preferable to 
hrsl obtain the “slimale d of a and then use this esiimatc to 
determine an estimate, say d, of ff 

If A\ IS an open (nonzero measure) scl m vve can 

expect that d c .V, (at least for large V), since tx’c A,. In 
such d situation wc can compute d as 

d-Nfd) (2^) 


d ^ arg min V f ' 


where d(A) IS the inverse function 

d(rt) A\-AV 


(2 la) 
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I( IS easy to see thai H ^ H Indeed 

V s 

2] *'» = 2L 'i*'- a ) 

,,. I 1-1 I { ^ 

N 

V* 

2d * li’J W <: .S\ (2 HI 

t - I 

which implies ^ fi We used Ihe asvumpiion ihiii (i e S. m 
the last equality in (2 K) 

However, in most eases ul interest iliin W • Jim a and \ i> 
a “ihin" SCI of /?*"”•. Then (i «.V, |wp 1) jnU (2 7) 
txr used In such a case we cihiIJ detenmne H as the HYlutum 
to the lollowing optimiAation problem 

ti ATg mm V^(^i) V'( fi) - l(a - ‘I A fiuni 


where is a ainsisicnl estimate ol 


= k-( 


L?f J/. rt) 

Jyn 


\ ‘ {(. n I 


,'2 Ml 


[2 U)) 


wiKie the last term is wniten m an mlvwruiuil way Ihe msMinl 
term m C ISbi t% related iv> with V IMvcn 

bs 1 2 Mj l*rvH-id<‘d i hitu a miuunium at t:K*Mr to twhKh 
IS true toi V Uijfvl then it iomt | 2 I'sbi that 


0 i2 IVi 

Mcniv the esunutc pven bv ([2 a hihkI bjtJe sainfdr 

appiiuimaiKH. >H t* in ih<‘ h um 

d ■ fv \H\. \\ (2 1VII 

A icl.iied flppn>acti hav iHreii (n4)(>osc'J bv I ordliiiinkf Ami 
IVmaI (IMKSt It c4>nirnis rstimatiiu, pammeUrs m a mmlet 
baM'J on a pMinn siaiiMic In tiino of the piotsirm tn itio 
pafH*! (he joinudatiors is av followv let J K w CiMiMStcni 
estimate oi a with 4 voxaiuimx matiis 1 onsHlri 

csiiriKites kJ ttii loini 


H -Uji) 


12 HmI 


A natural estimate is 

A I I Y I 

'■ l,v.,^‘. Jrt 

Hence the indirect prediction errm method (IIM Mi conviso 
id the following two steps 
Step I Determine o Irom (2 11^ and /’,. 

Step 2. Determine W Irom (2 M) 

Iklorc givinp some moiivaiions ol the IPi M iccall 
that under A1 A2. the normali/ed estimation crroiN 
\ V(f^ and \ ,V (n (i*)V arc asvmploiKallv 

normalK dislnhuted with zero means ami cnvaiiamr 
ni.itrices ^iven by 


when- the fiiiutiiin f i ) is li lt mveive to fi((^) , m . ( 2 u» 
the M use 

b /((lirri) 12 U»l^ 

Note that siiKi tlim n dim b tiu le aie maru ou h funi tnnii. 
f then ilu' lOs.uiaiHi malro ol b ha\ (t>i \ larp a U»wv*r 
bound I ho l*oun»l o achieved d I hi rv.iniiatc b (2 l(»a| is 
chosen as 

H aiKinin’j.i '(fO|n .tib|| (2 lb* I 

If (b b in (lU I o fr|vl;Hcd In the eslirmilt /', (suih a 
lepliio. im nt sbonld liaM onb a biirhri oiilcf rite* i » b| we 
aiioe ai the estimate b <2 'M 


Odf L» I 

Jii 


1: 11) 




I, ( Jf di. fM: 


1.' b 


.'b 


(2 12) 


.mil (2 III), resficclivcls. (l.jiin^*. IMH'. Siulersiiom and 
Sloica, IMSM) ^■u^lhcrrnon•. i1 is not diMiudi (o see that 



(2.1 b( 

Mil bl 

.>b 

(2 1V| 


and where we have assumetl (i lo have lull rank 

2 I A i^uu>rnriri( ul intrrffrctuhon I his idea n- |.nvt'n m 
Sodersirom ( IM75) and Sloica (iM7(i) (and sec also |)as)!ijpia 
IMHS), and can be deseribed as lollfiws Ihe i(plimi/ation 
problem (2 M) can be alternativeK stated .o 

n are rnm (li a }'!*,'{ n n ) 

‘ ^ ( 2 14) 

b bill) 

Ihe ficonu’trical interpretation then bciornes quite clear 
The idea is to determine the point n in S; wtneh is close si (in 
the metric induced by ) lo u. and lo use li and the irncrsi 
lunction fbn I as in (2 7) to obtain 

2 2 A rruLumum likelihood infrrpreiatUfn I ho idea o 
bdscti on the development in Siotea e( ul (IMHyb) ( onsidci 
n computed in Step 1 as a statistic" Ihe asvmpiotii 
likelihood lunction of n is given b> 

^7 b) - ^ |(jg (2.’T) - lop del (7 ! S ) 

- ,'X[rt - a(0|V;C(rt a‘^>l] 

2a‘ 

Ihc dcrivaiivc ol l.iO) with respeel lo >> 'iili''(ics 

rd/.(H) /.■ 3 S . 

S' if) " ^ 2f/ '' ' 

- '|fl - alHll' 2^21“ 
jb 


2 ' A io<,\ fumiion inirffoeiution 1 et b be close to 
jrocn In (2 l.oj Sim c itic (unt iiou ,»( 0) is sjuootli ol (<) wdl 
ihcn Ih J»si to a A lashu seru - cHpansion ol i I/, n I tf)) 
po es 

■ o () o ) , 

/ (r ii I b I) f ,(r ii M ('I ( b I ,11 t , I Si) 


Soil e due U 


1 v\ .o (/. n I 

(I ^ I 1/ n I 

N on 


(2 171,1 


we gii 


1 I 

V' , (/ n ( b ) I ,(/ III* ‘ 1 fi ul f 

2 .V 2 S' 


is^' 

.'I .(r (j I 


, -If, !• I 


,'l ulb)| 


Ionsiani t 1(0) 


12 17,.) 


Nciur l'*f b close to b the loss luncliori m (2 bi) behaves 
approximate Iv a t In fail. [2 1 \) wdl h»,ld exactly 

(fcpardlevs ihe distant e ol b Ifrim b) d 
(II f (/, ul IS afline m u Ihe. implies that (2 17a) is exact 
(iij The estimate /', (/iscti in (2 II). o used 
In suih a ci»s( 


ff N (2 17dl 

for anv ftniff V 

Note that li'r flu Dl S lavc (Lxamp)e 11). the two 
conditions ( 1 ! am) (ii) above art siitislied Ihe rrriation 
(2 17d) was established for this case in StHkrsIfoni (1M77| 
See also SliUia and Sodersitom (IMH'b for a furtfiei 
discussion of (his mterprciaiion 

^ Aivffiptofit pntprrifr} of 'hr If'h.M 

In (2 !7di wc i siaidished that umkr certain cotnjitums the 
lIM M estimate b eormidrv run by for fmiie V with the (*l M 
estimate b Ikis is ,i ser\ strong proyKTU that hotels only ni 
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ipccial ftifuaiionft , under much weaker asMumption& 

the eAiimato and f) have the same aitymplotic disinhuiion 
us will now he shown Note that this is an attractive property 
since the estimates then will have the same statistical 
properties 

Let N he large Then we have 

A - «• - A - «(»•) -= fKI/VV) 

y(0‘l ■■ (Hl/N) 

A - o(«) “ (KI/Va/) 
rt(») ■ a(H') --on/V'V) 
f) - tr 


Hence ihc ciiimaie H is root-A/ conMiiicni. By series 
expansion we get 

0- vidn v'jH'] 4 K,„(«•)(« - «•) 4 (ki/n) 

W W - + (l(l/N) (.VI) 

Dincrcntiating VfH) gives 


i tl) 


VJfl) -' l<i »(«)! /'. 


(V2| 


- (CP. ‘G") 'CP. '(A - «•) + ) 

= (4.3) 

In the last line we have used (3.4) The result (4.3) means 
that and 0 are asymptotically equal and that the GN 
algoiilhm (4,1) for large S converges in or>c iteration only 
Let us now discuss the choice of the initial value for 
the optimization A consistent estimate can he 

constructed in many ways Note that we would like lo obtain 
0^^** without reprocessing the observed samples 
y(l) v(AT Indeed the computational efficiency of the 
IPEM lies exactly in the fact that the information in the data 
arc condensed into a and . These variables have generally 
much smaller dimcn.sion than N. To maintain the simpliaiy 
of the IPEM the initial value should he computed from 
dr and possibly In general terms we can proceed as 
follows The estimate a is by construction consistent Hence 
it will lie close to the set Take an arbitrary point d in 
that is doxe to dr. We can then regard a as a consistent 
estimate a.s well Finally compute as 

(4.4) 

cf (2.7). A more specific way to organize such calculations is 
application dependent. 


Lhe term (rj^'er/Jff') is written in an informal way Strictly 
.speaking it is tensor I he second term o( Vf,^{0). when 
evaluated at 0 • 0*. can he neglected 1 tom (,V2) we obtain 

* (A - - (A ri*)'r,'(;' mki/N) 

♦ ^)(l/^/^) • (I’P./f/' +h(i/\/N) 

(.T.l) 


N<jw (3 1) and (.1.3) imply 


Example 4 ] (Initial values for GLS) Con.sidcr the 
.situation described in Example LI Let the coefficicnis of /t, 
and be determined by 


B,(tl ') B,(q ') 
A\iq ')~A,lq ') 


+ 0(1/ 


(4 .Sa) 


This means that Ihc first na^ 4 n/), values ol the impulse 
responses of the models (I la) and (Lid) will coincide The 
relation (4 .Sa) can be equivalenlly written as 


« »• ' (G7’,.'(,'| 'GP,.'(A i»') + 0(|/N') (3,4) 


and hence 


with 


0-) -'‘'‘Un(0,P) 

P ’ ((;p,'(,') Inn Kiv ( \^(A I*) 

KJ . ' il 


(.VAa) 


X p„'f;'((,p„'(, ') ' 

- r„ cv.Ab) 


cf (2.13a), This meiui.s ifuit 0 and 0 have ilie .same asymptotic 
diHtribiiiion. 


4. lmplentrn(uiiori of the IPEM 

In this scchon we will lirst discuss how to perform Step 2 
of the IPEM, i.c the minimi/alion of the loss lunciion V'tW). 
(2 M). We develop a (iuuss Newton ((iN) algorithm lor this 
purfHise For a .sufficiently large amount of data, (his 
algorithm will converge in one step provided it is initialized 
by a consisteni csbmale of ffV Lei denote the 
estimate at iteration k By dropping the second term of 
V„ft(0) in (3 2) we gel the following algorithm from u 
-standaril Newton method 

X ((;(ff'**)/\,‘lA (4 1) 

If f)'"^ i.s a consistent cstimaie ol 0* we can a.ssunic that 

f)*| - t)<l/VV) (4 2) 

We then get 

0* f ' 

I (;((»"")/’„ '|n - c»((C) 

GVtf'"' «•)+ + <>(^)]| 


AAq ')B,[q ') -A,{q ')fl,(i/ ')-0(i/ '-'‘"''■•"j 

(4 5b) 

By equaling the coefficients of (he first nu, 4- nb, powers of 
q ' in the left-hand side lo zero we get the following linear 
system of equations 

/ f) 1 \ 



(4.Sc) 



By convention, the coefficients and b[^’ are zero if 

I > noj, j > nbj. n 

Initial values for the G-aiefficicnis may next be 
determined from one or both of the relations 

')C,{q ') 

(4.5d) 

B,{q ')C^{q ^)^Bjiq '). 

Equating the powers of q ' will yield an ovcrdctermincd 
linear system of equations. The least squares solution of this 
system is a convenient way of computing C i(^ '). 

Note that the initial values A,(<? '), B^{q ‘), C,(i/ ') 
computed in this way arc consistent by construction. □ 
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To illustrate the properties ol the IPEM ami the algorithm 
(4 1) we present sowie numerical Mmulamms in the (otkrwms 
cxain|>le ^ 

t-iumpir 4.2 (NumcrKal iMuuratiom for (iUS) iv 
y{t) -f ayU -- 1) hu(i - 1) ^ ^ 

1 4 14 ^ 

fl « “”0.9 ^ - ! U t -0 9 

WHS siinuUicd and us paramcirrs csUmaicd PC MaiUb 
(Molcr r/ fl/ . I9H7), wuh ihc Sysicm IdcnidKaiion 
(L|ung. 19H6). was used for \hc avmputiHuvns :i\rcc 
(liffcrenl mclfuKis were uiicd 


PEM. winch in ihc iwilixvx 
Ciauss-Newton algorithm for 


IS tmplerTvcnied as « 
mininii/mg , (/. U) 

\ I ■ \ 


The iterations arc stopped when the giadirnt of this 
criterion has [euclidean norm less than d lire initial 
estimate is based on a sophisticated use of the least vquares 
and instrumental variable methods Sec Young tlWl or 
Scklcrstrom and Sioica (19H9) (or descriptions of thCK 
methods 

(il.S, which IS the traditional method for implementing 
Pl:M m the case of generalized least squares model |src 
Clarke (I9h7) and Siklersirdm (1974 )] I he ileraiions were 
slopped when M \ + The initial 

estimate fi'*" was lormed by making a least squares 
estimation of a and h In Cil S n and h are estimated 
alternatively with c One iteration is here delmed as one 
update of all three parameters 

IPEM. which was implemented as in (4 1) and initialized 
as m Example 4 1 10 he spccilk. the initial values ol a 

and h where found from (4 .Sc) which m this easv lieeomcs 




h\'' 


The initial value of i was obtained h\ equating the 
coerticienis (or i/ ' of the (list equation of (4 Sd) fhis 
gives a f ( ^ iii’' The iterations were sfopjH-it when 

Ijrt" • " «“'i| V. ,^(1 1 II 

The methotls were applied to three diflercni cases 


( ao’ 1 \ UN). n(0 while noise ol vari.iiue 2. t {i) white 

noise of variance 1 

( ioe 2 \' ~ IflOf), u(n while noise ol variance 2, efr) white 

noise of variance 1 


TA.m.1. 2 1^. i 7 fw w^m Mitsa . 
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( mf V * Itum. u(/i a tn>t ordci auloicgtrssioti with fMvir 
lit / 0 H and variance S Sf> rfrf while m>iu‘ of vanumT 1 

The iiumcrual icsulls obtained air given m TubU s I S Note 
that the paiamcicf used foi the stop crilcna has diflerent 
meaining. (oi the diflerent methoiis I cn loirqdt irnrss nImi 
the mitiid values me shown, which will give a inorr 0 *1 fslcle 
dcHiiption (d the (piaclicidi convrigmn pio|>cMirs In Ifir 
tables, iteiiilion 1 refers to the iniiui) value 

Since IH Matlaf> is used, the compulation limes shown 
must Ik consideied with Mirric care (mains manipulattoru mu 
fast while usernuidc liH»f>s arc vonipaialivriv dovs) 
fH hKo proviiks a tounimg of the floating fxnnt 

o^K'iations T his hgurc will alw* give a giXH.l indicaiioh of ihe 
cc.mpulaiiomil load 

lb following comments tan in: made to the lesults in 
Table I ITie estimates M diller a little between the diHetent 
mrlhixls due to different implemcnlations I hansient cHtvis 
of hlicnng etc differ, (nr example f lo get tonvergeiur to 
(our digits in the result wc need to ch<x>se A lb * loi Pf M, 
A ■ 10 ' (or (il S and A 10 (or IPTM IT’I.M gives 
almoM the final result after one lUiaiion of (4 1) It is aliwr 
obvious that IPI M is much more cost rfleciive in terms of 
coinpuiatioro than PI M anti (rE.S 
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( ompared in ihc previous rci*ulis iKc fndnwing commcni.^ 
can he made fo labk- 2 For four (marked *) Pl'M was 
siopp«:d aflcf ^ itcratiom. sovee the Um fuiiciion noi 
reduced further, although the step length in the Newton 
algorithm was M) iirncs reduced by S{V4 I PCM tunveigcs 
very quickly ( Fhe initial values ‘ iteration 1’“ iiri' very gixKl 
and cssA^ntially one ilcralion of (4 1) is suHicicnt ) Note the 
small tomputalional cost for additional iterations of IPCM 
(less than 1 kflop per ileratiun compared to HI kflops per 
Iteration lor ril.S) In this case (il-S converges quite slowly 

The results shown in [able are i|ualiiaiivei> similar to 
those prevented in Table 2 


^ ( (ffii luMom 

An indirect prediction error method has been profxised 
and analyzed It is applicable to cases of two nested model 
siruciures where a Pf.M is relatively easy to apply in the 
larger siruclure A simple algorithm was derived lor the 
estimates in the smaller model structure assuming the f‘f M is 
applied m the larger siruclure as a lirsi step 

Ihe projMised method is computationally last and iri that 
respect suj>erior to a P[,M used directly in the smaller 
structure Ihe statistical pro|K'iiies are the same il the 
number ol data is large hut much less eompulalioiis are 
necdeil with the new method I fie indireet IT-M approach 
can be seen as a systematic way of icdueing or simplilvmg 
models uhtaineil by system idemilicaiion 
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Comments on 2-D Descriptor Systems’** 

STKPHFN I t AMPHI I 1 1 

Key W«^--^Bv.und..ry value pioMem. dilU-tcnc. cMuati.u.s .vm. m^ tm.llulimrr,M,mal 

systems, linear systems 


Abifi»cl—This paper discuvves general 2 1) dcwripiiM 
systems of the form tji, ^ ^ . 4 , ^ Hx,. ^ * t i ♦ 

^ *♦■/), li, D,u, ^ *, S<iluth)n formula and struciuial 
Ifirms arc tkvcioped for stucral large classes fi| M) 
descriptor systems The idea of a rccuisivi chain is 
introduced. It is shown that these sysicms inclmic sevcia! 
types of behavior not discussed clscwhcic in the hteriiiufc 

1 Introduction 

Ri ci r»ni V IHI KI has been increasing inicrcM in J D (and (he 
more general m-D) systems Intause t)l ihcn nain 
applications in the numerical analysr, ot PDl s image 
priKCssing, signal prixcssing. and as models lut uihcr 
discrete proi'csscs Singular (or descriptor| systems rnou 
frequently called dilTercniial algebraic (DAI ) in ihi 
mechanics and numerical literature (Brenan n ul PW#). 
have become increasingly imt>orian( (or 11) systems 
Singular 2L) systems should also becoine imre.ismgls 
important This pa|x-r will make sescial obsersaiion'- alxuii 
singular 2-1.) systems We arc pariKularls inicieskd in 
determining properties of 2 1) systems which virr run seen 
with singular l-l) systems and have not been presnnisb 
discussetl in the liietaluie 
The system o‘ interest is 


O,.,, 

, , - .4.1, , ^ /fi,, , ^ ^ ft, 

. ) ^ 


1 1 ) 


V, , - f/A, , 1 //m, , 1 

• b. 1 

' 11 

( 2 ) 


where i has values m (of /"). / is a smgulai square 
malrix. the rest of the matrices are ennformafde in si/c arul 
/ IS a limic index set which dcjx“nds on (/ /) I or this [cqxi 
II suffices lo consider 

f j j /U, , -f Ri, . , , - f c , , , W, < ' I). / . - <1 ( M 

Ixi /■ be integer 2'iuples (/, /) such ihai i - b, / 'i I hr 
IxHindarv of J' denoted 3 /‘. is those (i,/M / with ai 
least one of t. ) equal lo (I l or am set 1, ’he vei inr 

space of all f?" (or f"’) valued limciions itclmed on 1 Ihus 
we can talk of / c .^^(-/* j. or ol a sequence : / 'b : 
b' Coven 1 f: ' ). Its houndury ludurs are il^- values ho 

'Ihe system (.^) is called \olvuhlr il ho am 
f >„(./’ ), there is a solution lo ('ll m >„( T ) which tv 
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uni.pich dcit rnum .j to n > t>vmndHrv valurN I oven 
f ' t a Iwundais value U i b oi / (b »v 

t<uimrefi/ hn lU d theie is a voUiluvi lo ()) with ihiv 
Utuiuliiiv Vitlur 

Ihe svsicm t U wnh I nofisuigulin has been studieil m 
mans papers As in I turuisim find MaiMiesmi (1*^78) wc 
prefer (1) to vtiher modt h.. sui h as ihe Roesser I nsih ( M 
[H'lmiis smalk 1 si/ed ati.iVN SrtoniUv i M allows the u\r ol 
geneta! vimilariiv ii anslonnalKHis in I'oitt analvvts ;ind 
ci'niputation 1 m.dlv :o *lis<usvrd in itu Milion otl 
jhernatoc (oirns inhci umkIi) loiim, disguist some ol Ihe 
tidhv iiloes prtsciii I ht smgulai v.tsi undi i ddlr teni 
asMiinpiionv liom mus, is also siuditd m Kat/orck (P)HH) 
and I ewis and Mi fli;tos ( |US,S) 


2 .'kinufi'tm 

System ( Ui is rct^niof il am) A rJt id nonsinguliti 

for sdiTU p.iif / M and omp/v rn^uin^ d eitfiei ri H or 

a/ < IS a ii gvd.n (H lud Simpfv n i/ul,u impln s regulai If 
A n hnnsinguKu ’nil tin «vtlu r un (fnirnlv .or /cO' itu ti (h<. 
svsti. in IS legulai bui in'i siin|»l\ ogolai A mnu inii H siirig 

rx.impU (s svhen / b .md li ( an l>oi|i smgulai fvui fi i ( 

IS nonsingiilai Sm h sysu rm whnfi int lud» Ihi usual 

Koes‘ I's iin»di 1 iK.ii/'iitk loK'ni ati rnu simpiv legulai 
Noll dial soiv afniiiy unpin s legiil.oiU 

In ordi r lo cxauiun u gtil.ir vvMcms wr nrrd lo icvu w a 
fi w v'UisiqUs horn ( amjdHlI (I')ho) lU.n.dl Iftal rSeiy squari 
iTiahix \ has i lh,i/in inverse dettnu d \‘' I ht ti arc ni.mv 
ways (i- expo ss bn 'volulnm id a 1 I> ili stnpioi dilU ti nti 
equation unluduq' rfic usi ul shullh liki algoiuhins Inn wt 
shall use ifie Dra/m mu jm noi.nnm Inn.ms* it »s 

convenient I he mmu rual implemrnlalnMi of this iMUalnto is 
denusseel in \^ llkmson tlbK?) I fn mJei of a inatiix is (he 
si/e i>l the laigrsi nil[*'Ui iit blot, k m its Iordan laiioitual 
ftum Ihi'ii lr"in ( unplnK (fUKU} vai have 

I hrnrrm I Suppose thai / 1 is a regidai (nin il Iheii 

/.i, . , Ak ‘ U (k ' 'I (4) 

|s solvable and tfu I'cnetal 'adiilion (v given f’v 

I. ^ 4’ I, (/ I') V I ,e'/.,, c i 

where f, < / / 't > t, I i/f 4) / A (>/ 

,4) 4, 4 / ,4 f I A*\ /' f I '' q iv an arbilrarv 
.cetor V IV the iridex ol I arul y is a st id.u * uvl» th.il // 4 

IS noiismgulaf I he pi on it um /' and / 4 % ao 

invlrfx-ndent ol ; 

Assunn then that / ( is a regular jh ru d A similar 

discussion apfdiev il / H is regular I n at / as fixed II Ihe 
vcquenu I is considered known then (4) is a dilltrenti: 
equation 

/'•U. , ,.) ^ k ,,. * i 4 , * /G.. i , w, '» ' * b I'b) 

t^r I, with the icrnn Ui square braikclv known Since 
/ . f IS a rcgvii.il fn inpl wc rnav afxply I heoicm 1 .ind 
determine i . , Several im|>oFlant tonvcqiiemes o| (hm. 
dpproavh arc summ-iri/cd in the next propisihon 
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Propouttim 1 Suppose* thai P. (' is a regular |>cncil Ihcn 
i^) IS solvahle Ixl v ^ Index (fj. P - f/7:. where 
A (AA ( } 'A Set V » V I Then 

1 Ihc houndary values i, ,i may be lakcn arbitrary. 

2 I hr bifundary values /'itiI. arc arbitrary 

} Ihc tKiufidary values (/ ~ A)jr„,. f^ \. arc determined 
by {.t, „ I () ^ f -< ;v} anti (/ , | (I \ / ■ 1. 0 s i -- I)v| 

4 A(ir t “ I the value ol i, ^ is determined from the values 
of X,! for t) * v I I and x, ^ ,, , , for (Ji (y - I 

Ihis compulation tan be curried out m an increasingly 
Loniurrenl fashion I hc most interesting ease is when t'I 
Ciivcn the houndary Londilions, Ihc computation proceeds as 
lollows 

1 We begin computing r,,, 

2 As soon as r, , has been computed we can begin to 
concurrently compute i, r . 

T Once i ) , arc ctimpuied, we begin computing 

x, I ^ ^ for i 1, 2, . . 

f his pattern is illustrated in log I for the v ^ 2 ease 
I'hcsc results appear to contradict the characterization of 
snlviibilily in Kac/orck (UfHH) However, there is an implicit 
ussumption in Kaezorek (19HH) that the value of r,, can be 
dcterminctl without knowing any values of either , or , 
with r I or A y In the case of a simply regular system this 
forces V to he zero or one While useful, there is less of a 
logical reason to make this assumption than m the 1-D case 
siniT i, I may he spatial rather than lempirrul variables 

Axtimp/e I l et 


f his piohlem is simply regular with v - 2 hut it d^res not 
satisfy the rank conditums in Kac/orck since, in the 

nolution ol that wink, we have A,, d but 

A convenient way to visualize the computation of a 
solution ol (3) IS by picturing the region where at least part 
of /,, (or 1 ^ ^) must be known in order to compute a, , For 
example, Fig I could Ik pictured as in Fig 2. 

We now construct examples of solvable 2-D systems with 
riu>ic interesting computational configurations. Consider the 
2-f ) syMcm 

+-^VvVm. 

A, V’ . , A^,,- (H) 

Ixt 


Example 2 Suppose in (7|, (K), that ( , - (J and 






1 0 

fl 1 



'l”hcn the data required to compute z,, is pictured rn Fig, 3 

Example 3, Suppose we change F, in Example 2 to 
^ I ^ 2 ^ Tficn the region is given in Fig. 4. That is. we 

need values of ^ in the shaded region of Fig 4 to determine 
x,^ and these values in turn require information from the 
croKS'hatched area 


ff we view (6) as having input /,, and output x, , then the 
output mask (region where data is needed) for Fig 4 dfKs 
not appear to he what Bose (1982) calls recursively 
computable. Ycl Ihc difference equations are solvable The 
reason for this is that different masks arc used to compute 
difTcreni parts of i,, and one mask may have to wail until 
another mask has finished computing needed values lliis is 
discussed more carefully in the next section 


3. /^er wry/i'f chums 

The previous examples are s^Kcial cases of a wide class of 
solvable 2'[) sy.stcms which arc not recursive in ihc usual 
sense To discuss these systems we need to extend some 
previous terminology 

For n X n miilrices A. H, C . A we define the operator ./ ol 
' ) into itself by 

(7|r)),, A,x,,, ^ H \,,, ^' Cx ,- Ax, (9) 

Note that ,y|i)*“/is Mdvafile if the range of J is 
and yir| - h, r| ^ 0. implies z - 0 
J IS a rfcurvioe <fperu(ur if J is solvable and the Milulion 
of y(jil “ / can be eompuied recursively (Bose, 19K2) given / 
and consistent boundary conditions. Thai is, there is a 
suitable m(i\k so that; 

^ (lb) 

O.i )«/„ 

Example 3 is not recursive in the sense of Bose (19H2) 

Proptmuon 2. Fhe following eases are all recursive, and 
hence solvable, operators 

I. E, P or E. C a regular pencil This includes A 
nonsingular. 

IF ^ - 0 and E. A a regular pencil 

Iff A “ ( - 0 and ( . A a regular pencil 

IV E - H - 0 and ft. A a regular pencil 



Fki 2 Simply regular with v 2 


FfO 4. Example 3 
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Wc denote a sequcDcc Irooi ♦..(J ) by i"! a funetnw 

.^ •»“ 

iitmatn if ibcrc emis an tnicgcr p m‘h ihai ihc vuliic of f 
dcpcml!> only on fhc numbers 1 ^ it s r, 0<. i-sp 

Os/ Sff). Wc dcftiw the system (3) io be an if 

i[ IS in the form 

(in 

y, i|x‘' 

and each F] is a sequence of vector valued (unctions with 
finite domains. If all the operators y, m (11) arc solvable, 
then the system (!1) is solvable. If each J\ is recursive, then 
(11) will be called r-.rw^r recursive, or a rrruniir chum 
Example 3 was two-stage recursive bui nni recursive 
An r-stage recursive chain can be thought of as having r 
ma.sks each operating on a different portion ot the slate 
vector with these masks arranged in a recursive manrKr 
For Ihc nonsingular case, a .sufficient condition (Fornasini 
and Marchcsini, 1979, 19H(l, Pandolfi, 1<*K4| (or Isounded 
input bounded output (BIBO) of (3) is that 

p{z^,ZJ}--6c^(t:~z^H zA z,Z:A) (C) 

have no zeros for which |:,1 1 and \z.\ 1 

hxampic 4 This is an example td ease II of Pro^sosilion 2 
Eel 

;j, «-(-o, 

I'hcn p(z,, z,) “ : .so there are zeros o( p lor which 

i;,i ' 1. |:d ■ I However the system will be BIBO as long as 
the domain aivi range have the same norm since the s«»lutK»n 
I' .1 

4 . l/iernu/iir formx 

Many alternative (orms for 2-1) systems have Inen 
disciis.scd in the literature I’here are certain difficulncs in 
altering forms with singular 2-D systems In illuslraic, wc 
lake an example from F-nrnasmi and Marchcsini (I97H) ilnii 
IS typical in that it utilizes a new stale made up of shifted 
values ol Ihc previous state ( onsidcr 

E\ ;, 1 ,. ) , E . I ( ^ ♦ I ^ mE , . 11 ^I 

V, , “ f , 11 "I I 


&ame as taking 



Aiwsume hasT tbe KsuiHlary sallies i ,, , *Mid (tMvmg 

function u Hut *• m (Pt u not drhrtcd for t * (i Thus wr 
muxt rxmxidrT OM as ^k ttned tor i *" t). j E aiwi die nrec<kd 
Isoundan value*, me a,, and {w,, ;;^i) We Have (hr 
nerded values of r, , i,, However, the values of i , will 
have to Ire mmputcil If f is xinguUi. ilw* K»und»ry 
cfmditt^ms are reminded to an aHiite vubsfuicc But m»w the 
Compulation of the new fwiurklats e'iHiditk>fis is alrrkwtl 
e^^uivaknt lo wdving ihc cuigmai dineieiKT cquatHUi Hus 
pioblem ol deicnnming the oMmstent IsiHindait values for 
alternative hums basest on shifted state valuer* is one of itw 
returns we pu lci to wwtk wiih the ortginal 2 1) syslem tH 

^ inSmur iUmrn.iumuiiu\ 

lire 2 1) .system (3l is Ihc diwnMr antlogur ot a partial 
liifleicnttu) equation (PHI ) Many td the di file re new 
IxMw'een 2 1) and 1 E> systems are due to ilie (ail that, like 
P[>(..s. the system »s inirmsu allv inltniie duneiunukal 

^ 1 Bair\ As wih IM>I s il is naluial lo hwik f*:u iraveling 
wave uvluiions ol ( E Hicy are easiei lo compute and may 
have physical iritciprc lations 

l et m ff \k r>onrv4 ga'.ive bul lued inu gers Wc could 

allow them lo In genciwl Malars but il will sinipllfv the 

cnporMlinn i( wc assume they are integers W e seek solutions 
ol Ihc assoiialed honiogeneoiis rquation bn ( E m the l*nm 

^>jmi -» n/) t IK) 

Ihe veion (unchon <y» net'll only be driineil on ihc nuiiilsers 
given by jon * pi/.; ‘0.^ - il) where m, n art any Iwo real 
numbers However we sliall assuine i/» is defined foi all 
mirgers If I IK) ia ,i Milulion ol ( E wufi f ' (i, ihrii 

/ : * Ol « n I ,40(.') < 07 ) M <;(>(: r n| (19) 

where ; mi + m; Hut (I'M is ,1 diflrreiiir equainni for gi 
IntOHincirig viiriablev V'd-I '/’f- * 1) V'd" ^ 1) '' 

V, 1 ( 7 ) with r m * h bin rn ¥' n. gives the I I) devnpbn 
CVS I cm 



Eepialion t.’Oi will have rionliivial soKiiions foi <;» proviilrd 
lhai del t''7 ^ ’71 /'7 1) is rwnu onsiiini 


I his same input-oulput relationship can lx: wriUen as 
E k; , I ^ - A , A . H, ^ Af 1 u, . I , * Af.u, ^ , ( 1 I 

V' ^ - (k- ^ (Ih) 

by taking 

f: 0 u" 

E ^ n AO. K,, - 

() n / 




(1 

if 


-4,1 


/ 

(1 

i) 

. A,- n 

0 

(1 

_ 0 

0 

()_ 

L 

0 

(1 ^ 


^iherc r, , , ^ X t = u , 

< • I ^ • I •*( t l .f * J M I ^ I / 

The new system (E*)), (lb) is simpler, since in 0 3) 
eliminated However, what has happened to 
houndary values'’ Going from (O), (U) lo (15l. (Ih) is 


f-.iumpir goI (I With w n 1 gives ihe ' iMveling 

wave solution « ' of rn. /E, . i , )'i , [ b 

if a (2»>! 1/5 » v t ((/( ^ yr i 4(ib)’ ' j 

S 2 i^pfruinr iitrmuUttum As with PI)I s il can lx helpful 
to view the diffeienee equalion ( E hs an f»[H‘i.iloi difference 
equation When we do this we vet that MJinr of out previous 
examples exhibit behavior which is intrinyuallv inhnitc 
dimensional in c harai-ler 

Wc shall take one ol i, / as die iiulejH'ndcni variable Ert 
b<.^ the usual space ol /> surnmable vequerues <»( real or 
i 4 >mp)rx numbers with norm i !/. If p ', then this is ihe 
sup norm I.ci lx the vn.tor s|7acc 'd all sequences of 
n dimensional vectors Then A^. rs ihtrse i ♦ A^ such that 
(iiiJE t some fixed norm lilt Wc then define 


iEll^. ■■ 

created 


ij.; 1,1 Now let :,rA„ lx the crHumri vctioi 

by listing i, I, , in pirder Ihrn (3) may lx 


wnricn as 


EE’i '■ 


( 21 ) 


where 



f (I 

A A 

0 - A 


r 

H 

(1 

fl 

A 

H 

A 



u 

U 

A 




1^2 
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and / " (/fj/ A/. I SiiKc we arc rmw dealing with 
inlinitc mairiccH ii i^ ^xmihle for E lo lx- onio but nor 
invertible In faei. 

Propoxtuon } I'hc inainx E in (21) is oniu as a linear 
iransfortnation of into liwll if and only if the pencil E, ( 
is regulai 

If E IS onto, then z^, can fw: taken arbitrary in (21) ami the 
part rif 2 ^,, in the nullspacc of E is uniquely determined by 
Its (0, / f 1) component, which are the additional consistent 
boundary conditions in addition to 2 ,| I has these systems are 
M)lvablc Notice that the pencil E, A need not be regular in 
that JiE f A need not have an inverse: for any A f;xamplc I 
has E onto but E has a nulhpace and A - 0 

Some care must be taken when working with irihniie 
matrices which are not operators since mufiiplicaiion is not 
associative and matrices with nullspaces can also have 
inverses 

flxurnplc on the other hand is not simply regular, so ihai 
E is not onto f or l.xamplc 4, E is nil|>otcnl and A - / so 
that we can use the algebra used to prove Iheorem 1 to show 
that 7^ A , , ffere the row hnileiiess (finite number of 
nonzero entries in each row) allows us to associate the 
needed matrix products 


f) ( t>fu lu\iori\ 

The usual definition o( recursiveness has been shown to be 
inadequate to describe solvable 2 D descriptor systems I he 
concept of a recursive chum has been introduced and 
examples given. Moiivated by the theory (or F*l)l.s. several 
new tyjies ol behavior have been p^milcil oul lor 2 1) 
systems 
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Solutions to the General Distance Problem 
which Minimize an Entropy Integral* 

D. MUSTAf-A.T K. G1.0 VI;r+ ;uid !) J N I IMI Bl f:Rfi 

Key Wot*- Mullivariahic tontr..l syMi-ms. ..)nlrol msUiti- i..huv! Mikmlinml 

conirol; optimBl control, siiiic cpucc 


Abstmcl- Wc pose, and solve, the problem o( mnumi/in^ 
the cntrffpv of an //*-norm Kmnded and siabdi/cil 
L'loM:d-liMip Solution piiKccds via the equivalent ciroi 
system distana- problem I^c central member ol the 
admissible class is shown to minimi/e tht eniiopv .ji intinnv. 
and in that case an explicit state space lorrmila iv derived |oi 
(he minimum value o( the entropy Links Iviween cniiopv 
//. norms and //,'Optimal conirol are niiven 


Vri/ufnm 

The notation 


A Ric 


A 

f ' ( 


HH' 

A' 


means that A' ■ A’’ is the Mahili/m^ solution o( the alf^ehiaK 
Kicciili ei|ualinn 

A A ^ .A’A AT///'A M '< (i 


State space reali/aiions will he wrinen 



/) ^ Ml/ A) H 


A square transfer lunclion matrix f/lsi is .aid to be a// /»ri.o 


(lut)( i{ ftii) J Vfo 

The 1 afilace tr*inslorm variable ' will be suppressnJ lor 
nnlaiuvnal sirnplieitv All transfer tunciioii malrucs an lakcn 
lo have reaLralional elements, all (.imstanl malrues are 
taken to have real elements Other nniaiioii,il conveniioio 
are lisied below 


4 

I he open right hall plane 



(Prefix) real rational 


/?//. 

Hardy space ol real rational 
matrices 

iraiisler lunclion 

HH, 

Hardy space ol real rational 
matrices 

iranslet (urutiofi 


Ihe fth eigenvalue ol (t 
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if’ (it 'iV the parahermiiUMi ixirijiugttU’ o! (. 

o T' ' Tr‘d the oh singular value oi iH 

, (I ,-,t I j M liiKC |c .'*( O'OCdou >1 diu) ' \ 
the // rKum 

supo (M/iii)) ihe //. ivorm 

ft*// ‘f** ' ball in ¥tH, le all 'E ♦ TIf//,. suvh 

that I ‘l‘(> • I 

(I A/ M* •>. |>*ifsnivr dehmir 

A/ tl W ,Cr‘ IS |iM»siiiv i' sc nil dcluiilc 

i l>t noire mirnmum i niropv 

( I )en< drs H, opiim.il 

( I;/ Dt r.oii V // optim:il 

'*'(/' K) I owti lincai liaclional map ol /* and K 

I fnlfmlui iittri 

Inis I \n M o lonicined with opfimu/ H. cimliol wiib a 
minimum rnimps iritciion Ihe ibt'iuv ol nptirriul ft, (ontnil 
has reen\( d imu h aiuniion ovei ircmt vcai^ loi lull delaiis 
tiu mil reste d rr.idi i o. rclmed lo I ram,is imd the 

lelcreiues therein I rguic 1 illuslrales iht usual eonflguia 
non when tin siaml.od (>lani /' consisting oj the actual 
[d.mi suitable wi ightiiig functions and inleo ormceiioiis, 
in.ips exogem'Ujs inpuis « and tonii<fl inputs n to Muitiollrd 
outputs and me.isuird nulpuls v As |s usual m ff, vonnol 
(uobic.ns wi assume thiil 


r 


I hi »losed liMjp o.insfr i fuTu tnui matrix Irorn k lo c is 
given bv the lunar fiintional map 

i, 

}' * l\ hi I r K\ /' 

ut the appoi]>riiitel> p.iTOlionerl standard filnnt /' and Ihi 
^nlUrtdleI h Uk ojHinial If, umlrol prutderrv is tii find a 
stabih/mg lontroller h,^„ wbnh rmnimi/cs tht //, norm ol 
this transfer lurntnui i < A saoslics 

ml /' A Ml, A stabili/rs /' ( 

!’ tTV A..,J| . (1) 

Moiiv.ued hs the belief *hai optimal //* lonlrol is not always 
approprtati we lonsidir hcfc tin sub optimal problem 
obtained hv relaxing the mfniium in fit to the upper bound 

c >(/' Aim ■ y. 

viherc y VIn general, there iv a class rd com rollers 
which satisfy this bound, such nonumquenexs deal! with in 
this pafH f bv s|H cdy(ng thar the emro/n <d (he cloised linrp 
iraiisfcr (unction must f>e minimiml 

The t niropv is defined as follows Lor am iran.slcr 
funi tnui matrix (t wfmh sjiiishcs • y the enlropv of 


1^/A 
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Fio. I llic ^landard //., control configumtion 


a. ut a point v„f 'C,. IS defined by 


/(0\ y,A„) 



In |dct (/ 




X 


Kc f„ 
I'd - ft»»\ 


dfji. 


( 2 ) 


I'hift dcliriition is equivalent lo that of Arov and Krein 
(19HI. I9H3), except for an extra Rc j„ term which ensures a 
non/ero entropy in the case It is easily seen that the 

entropy is well-defined (since IKV||,' y implies (i< / 
y ja))(H fu») "> f) and non-negative, that /(G, y.i,) ^ f> 
if and only if (t ^O; and that the entropy of G is invariant 
under unitary scaling of (j 
Our minimum entropy H, unitroi problem is then; 

Find, out of all controllers K which siabili/e and satisfy 

K)\\.^^y, (3) 


a K which rriinimi/cs K), y; v„), the closed-IfKip 

entropy at a point v,, f. 'i, 

Minimum entropy has been studied in a wide variety of 
contexts; its applications to extension problems (Arov and 
Krein, lyhi. l'fK3) and to contractive intcrfMilanrs (Ciohberg 
ft al , Dym and (iohlKrrg. I^Hb. I9K8 and see Remark 

4) lire pertinent here.wc use an adaptation of the method of 

Arov and Krein (I9H3) in iiidcr lo obtain a self-contained 
derivation The use of minimum entropy in /G. control has 
been considered in lamclKcr and flung (I9K7) for the 
*‘onc-hlock case”, where both f’,, and are assumed 
square 

As with optimal H. problems (sec Francis, I9H7) wc 
approach the problem by reducing our original problem to a 
"distance problem" Id do this, use the paramelri/ation of 
all stahdi/.iiig controllers of Youla ft al (1976) and Kuccra 
(1979) to reduce (3) lo the equivalenl model-matching 
problem ol tindnig c tffG such that 

l|7, » “■ y. (4) 

and then exploit the unitary invariance of the //.-norm to 
reduce (4) to the distance problem 


where 


|/<n 

«,.> 1 

1 N •, 



‘ y. CM ;«//. , 



Kn 




Find the error syisiem E as defined m ci)uaiion (5). which 
minimtzcx KE, y;j[,d over those E which ^tiify i|£iU < y 

Two approaches to the S4>lutian of the minimum entropy 
control problem arc evident; direct solution for the 
controller or solution via the equivalent error system distance 
problem. Direct solutions to control problems have only 
recently appeared (sec Glover and Doyk, 19H8; Doyle ft al., 
19H9) and it is indeed possible to directly denve the 
minimum entropy controller Such a direct solutKin is 
carried out in Glover and Mustafa (1989) Flowcvcr, wc 
present here an alternative derivation via the distance 
problem, which, given the longstanding role of the distance 
problem in H„ control, is of independent interest 

The arrangement of the paper is as follows In the next 
section we briefly motivate minimum entropy //. control 
Section 3 contains the mam results By parametrizing all 
solutions of the error system distance problem we are able to 
derive the unique minimum entropy solution together with a 
value for us entropy This is firstly done for the general case 
of entropy al any c , and then for the important special 
case of * * Tills latter case yields particularly explicit and 
appealing results, and stale-space formulae arc given 
Section 4 contains the concluding remarks 

2 Motivation 

Mere we briefly state some relevant background deiaih 
Recall that wc want our controller to stabilize P and keep the 
//,-norm of the closcd-l(M>p A) below a level / (where 
Y ^ Such control problems lead to a class of admissible 
controllers Our approach is to select the admissible 
controller which minimizes the closcd-liHip entropy I he 
closcd-l(X)p entropy (2) is a useful measure of how close 
a - :P{P, K) is lo the upper bound y on o,(G'(/rrj)} In 
particular, if wc rewrite the entropy as 

/((;,/,,»„)- V|n|l y ‘o;{G(/fiO}| 

1 r, 

X (6) 

I ho fvf] \ 

and r7*J(G’(/ri>)} ' y* - f ‘ for some frequency range (i>, • 
u)<. ui,. then /(G'; y.A,,) as ( ♦() Also, it is clear from 
(6) that all the singular values o,|(^| ol ii arc included, 
unlike the //. norm which depends only on the largest 
singular value (r,{G'). 

The term ((Re a,,)/|a„ ~ 7 o>||' in the entropy integral is a 
frequency weighting, with a shape dependcnl on the pKvsition 
of the point .r„ in the right hall plane. In order to obtain 
rcal-raiional controllers, v,, should be a real number; allowing 
makes the frequency weighting equal lo unity for all 
frequencies, a notable special case we will return to later 

An interesting link with the //,-norm is provided by the 
following lemma 

l.fmma I, Lci (V he a transfer function matrix which satishcs 
||G|| , < y. Then 

(a) (i) /(/;, y,.v„) IKV(A)(Rci„)/(.5„ a)|1;. 

(n) /(G; y;,r„) -llG(A)(Re,i„)/(A„4 v)||;:4 0(y ■) 

(b) If // i.s strictly proper then 
(i) /(G; y;oc),^||(V||:; 

(li) /(G;y;*)-||G||::4f/(y -). 

Equality in both (a)(i) and (b)(i) i.s achieved when y~-^x 


IS anticausul and is known in terms of the slanaaru plant P. 
If wc dcline the error system E by 


E ; - 


/?,! 




wc know that /(,4^(/*. A ), y; v„) /(£; y. A„) because entropy 

is unitarily invariant (see abiwc) Hcru'c, the closed-loop 
transfer function ,F(P. A) and the emu .system E have the 
same entropy Tins allows us to solve our original 
dosed-kH>p problem (3) by solving the following error system 
distance problem: 


Proiff See Appendix □ 

Rfmark I. Part (a) of this lemma shows us how the entropy 
at So provides an upper bound on a frequency weighted 
//^-norm of G. Perhaps more importantly, part (b) shows us 
how the entropy at infinity provides an upper bound on the 
u.sual /G-norm of G, if it exists. It is well-known that 1|G||;. 
with (j ^ ^{P, K). IS just the LOG cost as.siKiaicd with the 
plant Pand controller A'. Si) part (b)(i) of the lemma gives us 
a guaranteed upper bound on the LOG Ci>st. which indicates 
that the minimum entropy///* problem has a combined 
//*,/EO<i inlcrprcialion In fact, this connection is quite deep 
and in Mustafa (1989a) an equivalence with the combined 
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HJI.OG apprcMch ol Bcrmtrin and Haddail n 

pfoved 


I>etinc jhc trntf f' tn 


Rrmark 2 l4Mnma i aLui sKow^ ihal rcUung ihc ivuitn 
tonviraiin cniircly by allowing y g,vci, c^^ualiiy in l^ioth 
parts (a)(i) ami (*>)(•) In particulaT, part (hHi^ bcvtMiics 
fiO, Minimizing iht: enuf^py at inhnnv in this 

case IS therefore equivalent to minimizing i e the 

A/.'Oplimai (or L(Xi) prohlcm is recovered For K!cvn\. we 
shall not discu&s the full implicatHms here A luller discmsion 
of st>mc of the general properties of minimum rntrof>> H, 
amirollcrs and the amneclioiis with LOCi conirnt logcther 
with w>me numerical results, may tx' lound in MusUfa 
(IMKyb) 

Remark 3 The nsk scnsitive L-OCi problem (mx c g 
Whittle. involves minimizing an cvfK>iu“ntiaFol 

quadratic ctisi It may be viewed as a generaii/aiion ol the 
usual LOO problem It was shiiwn m (Jlovei and Doyle 
(lUHH) that the minimum entropy///, problem (ai infinity) 
considered here is equivalent to the mhmte hme nsk 
sensitive LOLi problem This result prosides another 
interesting interpretation of the entropy poddem, and also 
prompted Whittle (198^*1 to give a direct derivation o! the 
cniiopy minimizing property of the optimal 11 U<» 
controller 

Remark 4 I he minimum enlr*ip> control problem siiidicd in 
this paper is related to signal prixessing via the puddcoi ol 
finding the jxisUivc dclinilc hand extension of a goen 
otx'raior lo see the cimncclion, use a well Lnown fact 
( rheorem 7 7 b »>! Morn and Johnson, LiK*') and Ihr 
delinition of the //. norm lo show that 


4ml hr I 


t . 




Ot MfL 


**^1 !i.iL 1?. (> n 


Ihen kn y fmd tfe.t/f, such thrti thsr eiwrxip) 

/(L , h,.l IS mmimii:rd ovet thosr t whKh sultsfy HLtf* r 
^^c have vren that this prc.Mem is equivalent u* timlmg i 
stabilizing contrtdkr k which krejw y iMxd 

minimiies the closed loop tmrofiy 
Solution pfCKreds bv tiistU tuivametnzmg nil f which 
salisfv the Isound * 1 / ' y Siish a patameiiuaiion ts given 

in Half and I ohen (in lertm t*! a liivrjii Iriktional m»p 
of a J unitan matru arvd an arbiitary stable ccMrttfiHliOfi 
(that IS, <1* ♦ i #f//. 1 , but It Is more sonvcnicnt to use the 
paiainciiizadon of liUwci n ai {tn terms ol the lincJir 
fiadional map o) .m aii '/mo mufrii and an aibiiiaiv. st«|qe 
coritiaciivm ^ Hv adiipiing the mcthixl of Aou avd Krrm 
we are able to derive the unique choiit of ^ which 
minimi/es the rmiops aiul a value (or ihe minimum entropy 
loi Ixiith ihe general case of i f . and when i,, • * 

} 1 The yrnroii nor Mere we solve (he minirmirii 
cniropv dislaiue piof'kin foi arbiirarv f.,« f , and / prsiprr, 
blit not ntucNsaidx stiKils piojxr Ihc clas* ol eitor systems 
t ovei which Ihe i nb*tpv rnusi fx mimriii;ed is patnmetrizi'd 
in the (olhming ler ’ma 

I emma 7 jtdovrr ci al All solutions 
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I his can be inlcrprcickl as band ifata iHcause onl\ Ihc 
iiniiciiusal compfUicnl on Hr spcMiled In |)vm and 
(lohfx-rg (19Kb, 19HH) Ihc hand exten\i(*n of V is ilchncd as 
V/ -0 m (7) such thill M ' has ihc san c banded siructure as 
A It IS shown in Dym and (johbeig (IdKtv IdKhi ihat this 
unique hand extension also mminii/es the cniropv Although 
the very general results of Dyrn anti (lohfxfg l9Kh| 

could be applied lo our prtdilem. we cht>ose to adapt llu 
ineihod of Arov and Krcin (19hM I ho makes (or a 
relatively short and velf~conldincd derivation 

V /JerfiMbori of the minimum enin)f}\ solution 

In this section w-e Mdvc the follt»wing minimum enirops 
distance problem, as posed earlier l et f , and Id 

• v:i 


■ W, 0 

UK , U ,» « ♦ Q,, Q., 

W. < C> K,.*0^, L>.. 

U4 ' C^44 . 

I vinhcr H* C.^ ' * V\w.> **' all pass and 

(.1 

Stale sp-HC reahzainms o( and arc avadabk m 

(ilover ft ai m terms o( the reali/aiion <t( H and the 

soltibons lo iwd algcbraa Riscaii cquatirms These 

realizations will tx stared and used m Section “t 2 

Ihc ncxi lemma relates (be cnifopy of the linear fractional 
map "f an all pavs rnairu / and an arbitrary viable 

coniraclion T to llu: enirotyv of ‘V itM?ll 

!,emma ^ Suppose 


m, I 

r:l 



tsc given where 

R'‘^ m, -pr 


(HI 


A. 

■'m 


7;,. 
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i.>i all-paiys, and f MH^ Then 

nrfu. 'vy. y..t„) - v'n'v, 1 . 1 „) + /'/(y,,. i.^„) 

+ y'(Rc.i,|) In Iclet (/ - y 2 j(j„)H'(j„))|. 

Proof Throughoui tKi5i prend ukc j ^ fw Since 7^2 
an all paM malrix, liyii'd - * llicrcfofc ||y 22 '*^IU'^ * 

because ||‘P)|, < 1 fhiii, logcthcr with the a.iKumphon that 
c^/L^ implies that det (/ is a unit in it//,. As 

y IS all pais, we then have that (Kedhefter. 1%tl) 

Irw. 't<)nr:*l-'.v>l- y'i. 

jw> the entropy /(y:f(y. 'P); y, io) is well-defined Using 

JUituUijio)^ ! (10) 

in hlock'parlitioncd form, il is straightforward to show that 

-yj,|/ y„>Pi •(/- wK/ ‘y., 

From this, and the fad that for any square real-rational 
transfer function mairix f/ 

In |dct )| j In |dcl ((f')| 4 In |dci (U*)| ^ 2 In |dct (G)|, 
we obtain 

ln|<lcl(/ r 'lr‘*U. '«')ny:(f(y, 'V)|)| 

“ InlUcK/ - 

t In (del (yT,y,|)| 2 In |dct (/ y>i'P)l 

Substituting this into the definition of /(y:P(J. 'P), y, r,,) and 
using the U D block of equation (10) lo write 
I J*^J ^, it follows that 

ny^iJ. y.-vj - y'/(T; i, v„) 4 y’7(y,,. i,.v„) 

^ I ln|det(/ y,,(yffi)^*(yifi))| dui. 

n J , " 

(11) 

But, from above, dcl(/ y./P) is u unit in JIH,, which 
permits the use ol Poisson's Integral Ihcorcm |sce e g p 
343 of Kudin (1986) . as done m Limebeer and Hung (1987)) 
to evaluate the inicgrul in ( II). giving 

/(y:#(y. 'P);y..v„)- y-7(9'; l. vj t y7(y,,. !, ',,) 

4 y^Ke.v,,) In |det (/ y,,(A„)T(i„))| 

as claimed 11 

We arc now m a (xisilion to derive the unique, stable, 
contractive <I> in the parnmeln/aiioii of all error systems, 
which mininii/cs the entropy /(/.; y, v„) 

7’6rorfm I ( onsider the class of error systems F which 
satisfy the condition ||F|| . • y as piiniinetn/ed in Lemma 2 
by 

+ [11 " [). O-f ;<;«»//,. (12) 

Then the entropy /(F. y; is mimmi7cd over this class of F 
by the unique choice 

^ - L>IM 

Proof Here we adapt the approach of Arov and Krein 
(1983). also used in l.imcbcer and Hung (1987), to the 
present setting Lemma 2 gives all error systems in the fvirm 
(12), where 4 is all-pass Also, 




0 0 
0 0 * 


0 Qu^] 
0 Qu^i 


€ MH^. 


because ^ 14 . and <l» are all in Hence, we may 

apply Lemma 3 to F to obtain 

y(t; y;* y'/(it>; i;.«„) + y'/(|R„ + C«lii. i;in) 

+ y'(Rc . 1 „) In |det {I ~ C 4 ,(-'ii)*K^ii))l 


If Qlg{Mu) * 

/(£; y;i„)= y'/«I., l,i„) + •/*/([/?,„ + 1 ;.„) 

which t% clearly minimized by the unique choice ( 1 > « 0 ~ 
QtiUfth and there is nothing more to prove So. henceforth 
in this prcx>f assume Define the constant Julia 

matrix H (see e g p 148 of Young, 1988) by 

H.(»" 

IH 2 , H„ 

^ (/- C>L<v„)C«('.,)»' 

I C:^4,4(bf) 

where f )*^ denotes Hcrmitian square root It is easy to 
verify lhai H is unitary Also, 

H:;;4>(i) -- tJ 44 ('o)**>(') 

which IS in MH, l,ei us map the unit ball in JIH. onto itself 
by the linear fractional map 

i ^ .F(H.< 1 >), *l>f ^JtH. 

Note that this maps - yi 4 (,v,,) onto <t> ^ 0 fxmmii 3 is 
applicable 

/(4>, Li,,) - /(•!». I ;,v,,)-h/(C^: 4 (^J,l, ^,,) 

4 ^ (Re i„) In |dci (/ C^4.i(',.)4M V|,))i 

Use this together with (13) to relate the entropy ol F to the 
entropy of <t>; 

/(F:;y.i„) - r7(cl>. l.ij 4 y7(|W,, 4 CL.J.P L vJ 

y'7(C?:4(i„); l.i,). (14) 

from which it is immediate that /IF; y..v,,) is minimi/.ed by 
the unique choice tt> * () Hut from above. d» IW* 4 » 
C^i,(v„). and the theorem is provetl i i 

Denote minimum entropy quantities by ( )mi An 
cxprc.ssion for the minimum value ol the cniiopy follows 
with case from the alxive prixil 

Coroilarv I 

/(twi . r; >U» - Y'H\K„a ♦ l . 'n) 

1. v„) (iM 

yiRci,,)( “In idci I',,))! 

In Idcl (CL.l'ii))! 

4 (1/2) In Idcl (/ CFL('i.)Uw('u))!! (lb) 

Proof Fquaiion (I,*') lolloyss iinmcdraicly Ironi equation 

(14) on setting d> - 0 In show (16), recall that W,,,. + i>„, is 
all-pass i.c. 

The (1.1) blex'k of this gives. V.v ■- pa. 

/-(«„ + e„.ir,l«.„ + c.,i,, = IK... + + cc„i:, 

M> that, along the imaginary axis. 

In |dct(/ - + + CCJu'l 

= 2ln|d(.-l(|/(^. + (17) 

= ;in|dct(«:,)|-r ;in|dcl(C74:)l. (I«) 

where (IH) follows from (17) on examination of the structure 
of in Lemma .VI .Suhstiluimg (IK) into the 

detinition of entropy, we sec that 

+ e..l,,; 1 ;Jh)= - ^ I lln|dct(R:,(yiii))| 

Rev 1‘ 

4-In |dci (C/4,(/<^>))l} " do; (19) 

L|.s„-/Wi 

Since W?, and 04 , arc units in s^F/, (Glover rr aJ . 1990), 
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Poisison & Iniei^al Theorem may be used lo evaJuaic (19) 

r^Hlf^sa 0-«li 1; 1 iJfo) =" “ y"(Rc ij 

X (In Idci (R?,(jj,))| In [del (21)1 

Tlic second term in (15) is 

" * ; «n) 

= ^^ln|dct(/- e«U„)C?:4ti„))l f I I'du, 

^ I Uo “ /tili i 

Idcl ( / ” C?44(A<\)^-''^ ( Re J(,) 

and ihiN with (2()) gives (16) 

3 2 £n/r(jpy a/ in/inm We lurn our aiicruion in this 
section to the special ease o( entropy at mhnnv i r when 
along the real axis See Dym (19K9) lor entropy at 
infinity in a different setting, and Ciohberg er aJ As 

remarked in Section 2. this is the most interesting and 
important case l>ccauM: ol the strong connections with other 
control problems 

The entropy at infinity ol (;. ( where l|(f (L * y) is 

/(fi . y; x)- j Injdetl/ y O*(/a>)0( d.«f 

which IS finite il (/' is strictly proper f-nr our prc»hlcm. where 
we minimi/e the entropv of the error system f . this mciins 
that the minimum value of the entropy ,ii infinilv is hmic d 
IS siricllv proper, this iKcurs when H m ihe distame 
problem ol Lemma 2 is stricilv profH-r This m turn txcurs 
when is strictly proper Referring ti» ifu standard 

configuration of Fig 1. this corresponds to no direct 
feedthrough terms from the exogenous inputs m lo eontrollcd 
outputs c. 

The results lor Ihe minimum entropy problem at inlinitv 
are particularly simple The minimum entropy solution is 
obtained bv setting the arbitrary stable toiiiraction d) to zero 
I e by choosing the “central wilutiorr out ol the set of 
ailmissiblc E. and an explicit formula lor the minimum value 
ol ihe entropy is derived in terms of ihe statcspacc 
reali/aiions mhcrcnl in ihe solution ol Ihe distance problem 
of Lemma 2; these slate-space reali/alinns are staled m the 
Ilex I lemma 

lemma 4 ((ilover er al (Tmsider the disiaruc 

problem ol Lemma 2 m the case W( ') tl Supp<»st' H has a 
realization 


c: f> 



Then f- as in the parametri/aiion o( all solutions ii 

the distance problem ||A,||. • y given in Lemma 2 has a 
realization 



i b A] 

fi .. y y ''«:• -r 

f) y ^ 'YZ 'H , - y ' ■ ( 

y ‘'r, b 

y '*(•, 

-y y 

0 - y _ 
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Applying the rrsulis lv| ihe piesums KctivHi using this 
rcaliXHlHxi. ATh\ taking isiivcs us the lollowing 

imporlnnt theorem 

7Tift>rrm 2 Ibc eniropv :ii tnhnils J{E r * l us nunimize^d 
over the clinss ol erior sysirrn% t in the disuiHt proHcm o( 
lemma 2, bv the unique cLokt - b 

If R(^L*' b. then the mmimum entropy crtiii system ix 
Kimpfy 

^ i» I « 

II_ 1 _ i " 

(, II ‘ ~j~""ii 

. ( : ; \ \ <1 

and the immmum alue o( iKc eiiiro(>v r> 

/t/,„, . y ») iiairUi;>/Ll 4 iriui |W!)/ H,\ C-li 

iiau'lt ,A'( l\ * iiaa:|( / 'A( !| (2^1 

/Voo/ I lom Ihnuem I, ihc minimum eniiofn ciroi system 
IS iharaclcnzrd f'V ihr unii|ui ihouc d> > d Icbmg 

»„-• * along llu leal axis givc*\ ihc mmimum cnlropv al 
inlinitv choice as iF C/* 4 t * I " beiausr is stintlv 

pfO|X*i Irom lemma 2 I oi details ol the Imiiiing aigument 
see Theorem ^ 1 ol (ilover and Muslalu (L>K9) Hiai i)»c 
mininuirn enifopv rrroi system has a rndi/alion (2\) follows 
easilv bv vi'fiing <l» <• in (9ji and using I einma 4 

1* ohiain ihr‘ mmimum value ot ihr eniropv wi lake the 
limit as • * along ihr re al axis of the icsull of ( oiolhnv 1 
That IS. 

/(/ mi'V- ' ) liiti j y in uiri I Id V.) Ii 

in iilel fC' 4 .ld,dM 

• 11 2 ) In idei I / C^*d'.dId I 
C onsider a typical term from t2t») 

Inn 1 1 ,, In del [I ^ r (»^,/ A f ' M)\ 

Note we fiavc dr(»p|Hd ihe modulus sign beiausc is real 
hrie Ntsw, 

( li,J 1 ) B ( Hu, ' 4 < >( v^ d 
so bv Lemma A 1 tol ifu Ap|x*ndix i wt have 
I,. In del 1/ * ^ ts, / A I ' H ) c,MTau' |( /Is,, ') * <>(»,, )) 
TTicrelnrc. on i.iking hmiK as v, * * 

hm (v, IridcH/ ‘ ( 11 ,,/ A) /l|) i(aer|(/i| 

A similar result h'l vaUr systems has been lienved 
mdcficndcnilv in a di fie rent ion text m A rule i son and 
Mingon (IW ,1 Apply iho m ihe lerms in (26) using 

r* y HU'.J ‘ yif, 

■ I r H'.UJ A\ Y/ H, 
from lacrnma 2, to gei 

M» >' f bacc (fl' >7i,] 4 ir,Kc \ B : >'/ ' WJ 

as reqiuircd Nf»ie that the third term m (2b) tv zero in the 
limit betrauve is slnctlv proper 
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Tile duiti cxprck^ion (25) (oUuws in an entirely similar 
one nolc\ that /(/^mi K ' ) “ Mf i *). leading 
tn 

^ K- ') ' In Idci 


In 

^ (J/2)ln Klet (/ 

which givcji (25) in the limit D 


Hrmark 5 Ntnicc that the entrnpy lormulat (24) and (25) 
depend nnly on the state space reali/aiion of H and the 
sfilutions X and Y to the two Kietnti equations (21) and (22) 
which arc inhcrerit in the solution to the distance problem 
C alculation of the minimum value of the entropy thcrclorc 
imposes negligible extra compuiiiiiorial problems Further¬ 
more, the minimum entropy error system (21), being the 
linear Iractiunal map ol *1^ - 0. is simply y nmes the p, by m, 
(1,1) bli>cK of t which is also uvuilahle Irorn the 

solution to the distance firohlerri with no extra computation 


Remark 6 Recall, from l.emma 1 and Remark 2. that 
/((/; *, ') ' ||(#T|J for strictly proper r# Thus il we let y * 
in our minimum entropy solution we should obtain exactly 
the A/rOpfimal S4>lutinri We show here that this is indeed the 
case 

By using Wimmer (1%*'), ii may l>c shown lhai the 
fHisitive senudcfmile mjitriccs A' and V' are monouinieaily 
decreasing as y increases T aking y ■ • r we obtain 


and 


- Ric 


0 

/t 

(27) 

Ric 

( !c, rl( . 

0 

A' 

(2H) 


... - - 




(with an obvious iiolulion) Lquahons (27) and (2K) identify 
the matrices A\ .. and .. as the controllability and 
observability (iramians of W( s). respectively Using this 
fuel, a simple calculation shows that 

lr«a:|W,'V,, 

+ initxIH.lV', I 

iraa-IlH, HA'\ y\..\\H, /J,l| 

I-"' 

Also, inspection ol (21) as y » ^ leads to t) li is 

well known that the 0 » HH. which niinimi/es 


IS () ^ //.'Optimal solution) and m that ease 

l|/” ^/,ll • l|//||; ( Iniiparing this with (2d) shows that we have 

/(/'Ml ' ^ " 11^/oil;- dUisiratmg the equivalence btMween 

the minimum entropy distance problem at y. .v„ ♦ ^ and the 
//; optimal distance problem 

Remark 7 Note that if y ^ y„p,. Ihen /"mi 
//, tipumal solution Also (Remark f>), il y - then 
f'Ktt I' easily shown (hat /(/Mr-V-^) >'* 

inoiiotonically decreasing function ol y T hus y can be used 
Iti move from //,, optimal to //.-optimal via the minimum 
entropy solutions lor y„,„ ' y • 


4 ( o/t(7uAton 

We have jxischI. discussed aiul Mdved the problem of 
minimizing the entropy of a general A/, control system. TTie 
solution was obtained by solving the minimum entropy 
version of the equivalent distance problem—the distance 
problem being, until recently, a necessary stepping stone to 
the solution of mi»sl //, control problems In the ease of 
greatest interest, when entropy is evaluated at infinity, the 
minimum entropy ssdution was shown to be the central 
member ol the admissible cUuvs and to Ik an inierc.stmg 


compromise between H. and LOG or /A control. Beginning 
With the relevant state-^aoc data for the distance problem, 
explicit siaie space formulae for this solution, together with 
the value of its entropy, were derived in terms of juvt two 
algebraic Riccali cquaiHins Since the relevant slate-space 
data for the distance problem arc determined precisely by 
the standard plant in the original minimum entropy H, 
control problem, back subslilulion could be carried out to 
find the minimum entropy controller m terms of the standard 
plant only It is, in fact, possible to bypass the distance 
problem entirely and solve the minimum entropy control 
problem directly in terms of the given standard plum, us is 
done m (ilover and Mustafa (IW) 
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Appendix A : Proof of Lemma 1 

I'he following technical lemma is hrsily needed 

l^mma A.l Ixt M be h real square matrix, let A tv a 
matrix and let f be a real numtvr Ihcn 

(i) - lndci(/ - f M) = r trace |.\fI ^ (Ht ) 

(n) " In del (/ - f ) . - f ’ i race ( S' * S’\. 

Proof Part (i). Use the Faddeev formula (m-c p HH n1 Vol 1 
of (iantmacher, 1959) to obtain 

del (/ fM) - 1 f trace \ M\ ♦ r>(f ) 

and expand ’he logarithm of this as a power senes 

Fart (ii); Using the well-known inequali(> thai In (1 


-t') . 1 ' for }.i!I, WT |r t 

■ - In del (I t ' ) u... .. V In (I • i' A J }) 


-- V ,'U,|.V.V! 

» = Cr»v<-|,V,V|, 

US ciutmed ^ j 

W'e mxy now pixKred with the pnxd of I emm« \ 

Pn*of (d Lrrnma I Pan (a) B\ l emma A I wc can write 


1 1 ' 


/(Ci . j trau-i(t 

He V, 


ly. 


dri> ♦ ( h y 


1 

7,*t 


trace I j 11 < /(it) 


Rc *„ 

fO,, ♦ I 


! here lore. 


Kri,, 

( I ( Oil' f * t ,#( I' ’ t 


l{i».)\Sts\ iiti(v)(Kc ^ fMy (30) 

whuh IN part (aHitl as clairnri! Noimg iFuil ihi (fX y icrins 
art non riegMlivr we have 

/((., r • iJiilthHe t U||y 

which IS piiri la Ml) as claimed, whilst 


• , yj |U;(>HRe OH.' 

follows by taking y • • in (Xl) 

F*art fb) I iiniIv ni»ic that ihc integrands in | XI) mIhivc arc 
monoioiiitahv increasing wMh y, and air coniitiUi>ux, and 
henre bv dominated convcrgrntr Inith sides td t Xlj tend to a 
limit as y, •* Iwch side is hrnte Ivtiinsc 1K»|1.‘ y and 
<»(») 0 by assuiTiplion llic result then follows in u simiUi 

wav * ' the priMif o| part (a) ! ) 
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On Slowly Time-varying Systems'" 


MOHAMMED DAHl.EHt and MOM HER A DAMLEHI 

Kty Word^-^Skmlv ..mc-varvm* sv..tmv lr.,yen i.mc .kM^.n mf.m.c .l.mc„.K,n.l 


Abjslract' A charactcnzution of \fahili/ing amuolkiN 
viowlv iimc-varying sysicms hast'd on input output dtrsenp 
lions of the plant and !hc wnirollcr is presented Ihis 
approach generalizes standard results on slowK time \arsing 
systems with hnitc dimensional slate spaee reprcM'iiiaiion 
and allows both the plani and the controller to l>c infinite 
dimensional The controller design will he hast'd on 

Irozen-time verMons of the plarii ohiained ai cquallv paced 
instances in lime 

1 Inlroductirm 

I ili PKOBI l M of controlling a imic varying plant ari'^'s in 
many applications In the ease when the plant is slowly 
time-varying, many control approaclu's have been used 
successfully For example, in gain scheduling, ihc plant «n 
assumed to Ix" varying and at successive ixiint' in tune a 
controller is designed to satisfy a stt of [ucstfiht'd 
sfH.’cilicaiions Ihe vcquenee ol scheduled controllers 
compensate (or the time-varying naiure of the piohlem, and 
I heir performance is expecied to lx accepiahle if ifie planis 
are vursmg sulhciently slowly 

The rca.son to study slowly iime-varying systems is l>oih 
the*>retual and practical The practical mifxiriaiicc is clear 
from the multitude of cases dmurncriled in the litcriiiuic. 
and the wiilc success of the method ol gam scheduling On 
the ihcorciical side it gives us a tool to iiisesiigaie which 
syslenis can fu* effeeliselv controlled h\ frozen iime methods, 
anti which ire the suitable tlesign techrmtucs Also m a 
related problem, which is rhe problem td ,idaptivc mntrol h 
luis Ix'cn shown that the study o( slowlv tirru’ varying systems 
IS crucial to the iinderslanding of ihe ailaplive f»rt»hlcni 
espt'ciallv m the prescmcc t)l disturhances 

The goal of this pa[X'r is to preseni a new meih'Hl ol 
analwing skiwly time-varying systems which is based im an 
input fiuiput approach Most ol the results m the lilcraiurc 
are eoncernetl with slate space a|>proaches (Devna ainJ 
\idvasagar. I97.S), which lend to have many shortcomings 
One of the major drawbacks ol ihe state space appn ath is 
the neeesMiy ol restricting the analysis tti an <i /»nor.' 
fixed order controller, whether ii is statu or dynamic this in 
turn makes it impossible (o analyze controllers ihai are fiased 
on general design approaches, e g //'. /' (Vidyasagar IVKS, 
Francis, H^K7. Dahleh and PearM'n ldH7a) m a unihed 
framework ITc method presented iii this pajx'r allows the 
consideralion of infinite dimensional plants and cnntndlcrs 

Ihe results will be given for discrcle-iimc single input 
‘'ingleoutput planis. The plant is time varying and the 
controller is designed on the basis of frozen time versions of 

' Received 2^ February reviscil ^ December 1‘>H*T 

received in final form 12 February 1^.^' The original version 
ol this paper was not presented at any If AC meeting flu 
paper was recommended for publication in revisiul form by 
Assixiate Fdrior H. Kimura under the direction of I clitor H 

Kwakernaak 

MJcparimcnl of Electrical F:nginccnng Texas A Al M 
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I I>cparimcni of Electrical and ( ompuler f ngmeenng 
Science and Lir>S. Massachusetts Institute of Technology, 
f ambndge. MA 02139, USA Author to whom all 
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the plant A ihjvcMv i>l this iww jAfVftrtviich is th»l ihe 
contfollci 15 not ncccssanlv adjusted for rveiy insiafioe of 
time, and thus can lx- used li%f a fixed iifut wimk»w bcloic a 
new Lvifitioller i> impleinenlcd This sOualion, which is thc' 
norm tn a 4 >(viicalions, wav ruH analy/cd in jxevtous rtMUfch 
on this prohlriii The length ol ihe time wintiow now enicrs 
as anoihrr jwiiamcler in the siabiliiy analysis 

An apfdicalion of the results iti this pajKi n the study of 
the problem »*( designing /‘ «vptimal contiollris (l>ahleh ami 
Pcaivm, hi lot viowlv lime varvmg systems h is 

shown that undei coiHliiionv ol slow variation, it makes Krise 
to dcMgn Iroztniimc T optimal conifoUers This gisrs 
preciM I'ondiiioiv for ihe feasibility id using gam scheiUiled 
lonirollrrs h« saihlv internal siabdilv amt opiinuil disiur 
hiime irieclnui ITie dclaiis oj iho apfdicalion have fxen 
ie|voiicd m (fiahleh and Dahleh l‘r*Mlj and will mrl Isr 
diviU'-NCiJ m this piijxi 

2 /Vr/i/mnuori 

7 1 K1iithf‘frwni lil /'rrhmmijrfrx This sectuvn iruludcs 
pielimmnries nenltd in the seijncl More ifetaib can lx 
found in DcMHr and Vidvasagar tl97^). MiHe and Philhfw 
Vidyas.igai and Willems 

/' denotes ihr thisMt ;d lianacli sjiact on the non negative 
iiiifgerv with the awHiated T noun f*, denotes the 
cv’cmlcd space of 1^' 

.y,>, dermics Ihe algebra of lincai iRiurided ofHMaiors on T 
which are hiumjI. i c for anv o|X'ralor / * .7,^ 

/; f i\ J f\ S/k Ml 

where is thi standard A lb Irviruaiioii ojxrator It is 
siraighifons aid I'l vhovs ihal ihc at (ion of any such T on any 
/ f /' has the kernel repfeseniaiion 

n Ml 

where f H Du miluced i>|Kra(oi norm on / is given fry 
^ 

With this rfprcMf'ntaiion o ideniiliciJ with the m.-! of all 

rnlinile lower Inangvjiai nialritC'. 


with Ihc af>i*vc norn’ 

l.el .7,, be the Mifjalgcbra »il J consisting of time 
invariant operator The corrcsfMmding rnatrii representation 
has a I iK [ditz vlructiire. 



and the induced operator norm simplifies to 
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Hcritc, iwimclncally is<»morphic Uj A^jMKialcd with 

/, IS ihc / iranslnrm ((iclfand Iranslnrm) 1{:\ 

fin 

wiih (he iissociaitd spcitial norm |rir //.-norm (Francis, 
I9K7; Vidy.is.igai, M^KS)| defined js 

!|/ |L - sup !'/(.’)) 

|..•l - j 

ft IS well kn<»wn (Hillc and Phillips, rv‘i7, Vidyasagar, l‘>H.S) 
lhai if I ( /,! then 7 ' t 7 ,, d and only d 

inf I7(.’)| 0 

i -1 » 


discusML-d later on, Londitioris in terms of the //.-norm are 
easier lo check, and therefore a chariiclcrizalion of when an 
operator has a hounded I l A! in terms of an //^ conditkin 
can be inferred from Section S 

2.2. /Vorrvv model A general process model can he 
described as 

s- A ^Hu 

where A, fi f cjiosis as an ojK-raior on T. llie 

assiKTiaied lower triangular matrix representation (d A, H is 

A - iaSt })) H ih,(t ■ /)) / ' / t •- 0. I, 1 

Ihc operator .A ‘ is well ilcfinid d and (»nly d ^ 0 Vr 
F.quivdlently. the poKcss is destribeii as 


(oven a set (d |iolynomials ) 
A,(J ) ^ 

t n 


where 


f/1, V )f/) l/^,u)(r) V/ ■ 0 

A,(") ' ^ /id*') \ 


for each fixed r. A, delmes an oper.itor A, i J , j 

X 0 VA “0 

On the other hariil, this colleLlioii ol [xilynomiaK defines an 
opcTJitor A on t' rielined as 

(AlHi) (.'!,/K'l • i ",(')/(/ <1 

A IS precisely tfie lower inangular matrix 

)) 

n,|()) (I 
a,(7) i/.(l) 11.(0) 



lor i iinvenicnce, the lolloping noi.ition is ^ulopted 
(Dahleh and Dafilefi. (loodwm and Sin, l‘)H4), 


AJi,{: 

) X /):''' 


) ]^ ^ ,(/)-•' 

.11/11 

pioduci 

IS Ifie Iranslorm ol 


The Inst piodiicl is the Iranslorm ol the standard 
eom|ioMlion of (he linear lime invariant o|>er.i(orN .1,, H, for 
some lived / the second pioduei is the eomp^rsition of ific 
lime varving operators assoeiaied with each of ifie lainilies of 
(xrlynomials --1,. H,. I 1), I. 7. I Hiiivalenllv, the matrix 
representation ol die lime vaiving ofieialoi associated with 
A, H,, r (), I. 7 . . is precisely the product ol the matrix 

lepresenlJilion ol each ol the individual lamilies (li iiiiikes 
sense to Iransfoini every row in (he matrix if / is thought id 
as the unit shift opeuitoi ) 

I he o|x*riiUn \ associated with .A,, i 0, 1,7. .is 
slowly liine-varvmg d there exists a constant y such that. 


A, A,! )' |/ r| Vf. r. 

Such oiH'tators are denoted hv SI V(y| I i.piivalenilv. 
A,( S1V(} ) if the .issocnilctl operatoi M is slowly 
hme-varying 

Ciiven an operator ft the IfiHf^nil I mu- Ah.soluie 

f.mtr IT AF is delined as 


i rAi:(r ) v * i,j 

k « 0 

Let /(:) Ih‘ the assmialed / transform of T. /"(') ' 
(d/dj)/(:), and / is the assiKiaied titne-invarianl operator, 
referred lo as the denvatnr o(Kraioi. then 

n'AFf/') - iK 'll r,,' 

( Icmly. not all operators in have fkiuiulcd ITAF Also, 
boundedness of the lirnriifri'r Ofvraior m the //, norm docs 
not guarantee boundedness m the 7/,,-norm As will fic 


f he linear iirne invariani system associaicd with W,( ;• )//\,( *^) 
IS referred to as the /ro.'efi-fimf system. 

Ihe above description does n<il meiude every possible 
linear, causal, lime-v.irving system However, it includes 
most systems of interest It lollows Iroin an argument similar 
to those in f raruis (|dK7|, ihai il ihe lime varying plani is 
slabili/ahle by a iime-varymg coniioller then ihe plant admits 
such a rcpreserilalion In addition, time vaivmg systems that 
arise through estimation procedures are automalieally 
descnbeil m terms ol the iihovc model 

fhis general descnpliim makes it [xissiblc lo consider 
infmiie dimensional time varying svstems Muis, the results 
of this pafKT go fH'yorni Ihe staiulao) results that assume 
finile-dimensional systems, or ei|uivalenllv, reL|Uiring the 
fxilynomials /f.U) to fiave a prior/ lived degiee lor .ill 

/. Il IS exaelly this point that makes the anaivsis more diffieull 
than the Mandatd siale-spaee analysis 

In manv appiiealions, meludmg adapiive eoiitivil (D.ihleh 
and Dahleh, I'f'X). (iondwin and Sm. the opeiaiors 

anil H, are limie pulse response sei|uenees Siah seipienees 
may arise due to an itleniilieaium (Moceduie lo L stmiate the 
eoeffieienls in the tmlynomials that ilelme a ration.il process 
nuHlel 

7 V hro:en tinii- control As was (X)iriied out earlier, Ihe 
control law is designed on the basis ol the (ro/cn lime plants 
The design pOKedure can be edleeletl to perlorm anv nunilKi 
of tasks, for exanifile good Hacking .ind disturb.mcc rc|cciion 
properties l.ach lime a conimllcr is designeil, ihc f>lanl iv 
thought ol as a lineiii shih invariant plant wiih its delming 
operators fixed at the values thev had at tfial pariiculai lime 
In allow ourselves the Hexitnlilv of using the eonirt*ller loi 
several inslanees in time, we will eonsidei the eontiul design 
every 7 lime steps For notationai reasons, delinc rp n f 
where n is the smallest integer such ihai / lies in the mlerval 
\t\f\ (n 4 1)7 I f he controller is designed at the lime efxichs 
nl The methodolugN by which the eonirollei i^ designeil can 
vary, and lor the sake ol keeping the development as general 
as jHisMhle we will not reslnet its degree 

C onsider the closed loop system depieled m l ig 1 f he 
dosed loop system is said lo be siable if the map horn u,. ii; 
lo v,. V . IS hounded (Desner and Vidvasagar. 1^75), The 


i 

-*1 


1 

1 

I_ 

i 

1 

! 



Fki. 1. Ocneral form of Ihe dosed liHip being considered 
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dynamics of the amirTo4 law will he pven In 

where ^ 11 each index I'hc cvtdution (d 

iheii^ operators is given by 

^ L.il ~ 

) ^ ■ iW* ,(n 

I»II 

llic fnr/:en-umc operators ihai dcliiic the aNfvt uintrol Uw 
satisfy the following Bczoui ideniiiv 

where i for each fixed n, ( quivak'iiiK. the 

avMKiaicd Zdransform, is a p<i|ynornial wiih no /ciik msidc 
the closed unit disc, li is imfHtnam lu stress that the drgrr rv 
('f these polynomials may vary for ditlereni n, 

^ Prithtem /(frmulutiori and ihr mum riMilt 

llic mam goal of this paper is m show h 4 »w the slow 
variation properties of the plant, the LiUiirollt.r the elosetl 
hHip jxfiynomial mlcraet in order to priKtuse an /’ statMe 
system The fad that the coniroller is ujKlated onK everv / 
Steps introduces a new paranieict in ihi siahilin an.iKsi-^ In 
what follows It IS shown how large J ean be withoui 
endangering the stahilitv of the (.loseil loop ss^teni 
Intuitively, the larger / is, the slower the plant variation 
ought to be, and lor the extreme ease o( / • r tbr system 

ought to be time-mvanaiit 

f rom Fog, 1 we can write down the closed loop npi.itionv 
for the controlled system as follows 


V,)( /) ( HAu , V,) Id I d ) 

v.dio- (^ \i))(n I:i 

A„l.„ ^ ( d 

Next w't* will obtain a lelalion lhal eonrnHi'« the irifnil 
sequences lW|(r)} and to the outputs iVjiri; and 

{ vd/)}, OjXTaling on equation (1 ) bv /., wi. get 

(/ „ - (7-,,^ H,uAH) il „ //d lb) 

Hv adding, subtracting, and grouping eert.nn lerni'^ wr g< i 

^ (U M,- 'VI ^ 1V., T I ,./t„ I 

^ |/y,. 

Wrl - \f^r /-.Jllv !IM 
' ( f ,„ H.u ,)( n ( /V n )(f) 
where wc uscil the notation 

|/T, H,\ - A, h, A,H, 

fo obtain the second closed I'Mip cquaiiun nmliq'b 
equation (1) by M„ : 

fi,uAin ^ 

Again, by adding, subtracting and grouping wi gel 

•> 'I'C,. K,\ 

+ (M„ 8, - M„ H,J ^ I V I J 

4 [A,L„~ 

4 (|4t,. - (V,,,, .•Vll'i''<'» 

-- (M„ *- (/V 

Dthnr ihc follnwing quantities for i I .. 

A', = |r„,/i,i4(/.„/i, 

4-(«,. w„i4i/»,,ve ^ 

X, = \M„..A,\-\A,. WJ, 


|.w. , i 

’ j 4 I „ ! • i \ l / , I 


V'Mn|{ equalHwi j V wc can wiite the cIckc-c! K»«ip c’c|U.mIh»ii« a* 
f*>lkiws 



\ 





■w. « 

(4) 


lVem>fi; t'v V y / U t> tlu* Uiiu v.ovutg o|>< !'0oo (lowc' 
trungulain axsotcnilrd wiih !hn lanuhis A > / W 

"b respi'vifvI b the hasu thi inv ol tins pajn t is to .inalv tH' 

ihr alHivy system Itv i-nuidiung du o[K’i«ieus V ) / U us 
f>criurhai»v»ns Ihes* (HMudimg isjKiaiors an rn.uk up of a 
sum oj stmplei lommuicitof ivjv o|Vci.4ieus Hsiurnh im ihv 
norm^ ol these opci.itoiv wilt U denved IjiMf 

Ihe mam lesult ol this p.tfNii rs suiiHnaii;etl in (he ihiorvm 
IhtIow 


Throrrm I | m ihe syarm ( 1 1 .isMiim ihe lolk»wing 
( AS I I Ihe ojvi.iti'is ddming the plctiil ate s|owl> 

imiu s .trv ifig wilti rales ; „ .muI y,, lhal is 
i I M \ ( , ami H i S I \ ( I 

|AS?I 1 ht scque'aa ol lonlioileis an sUmb lime vaiviug 
(h.it IS Vf^ f S I \ I ,1 and ( ^ t S I \ ( ] , i 

(AS b The /(.rionns ami iht 11 Al .d du otHr.Hi>rs X, 
//,. i'.. Af,, ale umlormb Kumded ni / 1 hn is 

[HI I iseh equoalcnl ii' 1 / AT 1 . I 

I whetv \ H i M an (tn intu: vatving 

otx raiiiis asMHi-iled with the above l.umlus aiid A . 
H i M all (he ou n s|*onduq’ df tnuitn^t 
ojKf.ilor, I fom this, ,\S 1 AS and ilu He/onI 
id< niit\ ii fiillt>ws dial (be tK>‘iei! lonj* opu.Moi will 
als^^ b( sltiwlv him vaivnig .iml dnn w. i .in wuli 
< SI\(v ) 

(/.S'l| I hi i',,noims and itn IIM ot iIk (io/rn tmu 
Imu ai shdl iMvanaiit op<ra!iuv m ,»n l»»tundi:d 
undoirnb in / Mho, nondihon vsill (h dismissed 
!uMlu r in Sci \ n ui / 

I hi. n Ihi. n' esists ,i non vTIo t,onslarii ;> vm b tba! il ^ 

y, ■ •' the t lost d loop sssb'in n inlv in.db, 'd.ibic 


4 Siutnhix ufuilwiy 

In this seviioii, the siabibtv ol dti ilosed loojv svsii.rin 
ansiiig fiorn the (ri»/en Iniu desqMi i, slndird |l\ rvaiininnt..' 
dw kl'ised liwip qM.uii'te (3) w), vei (bat dn iIomiI li»op 
inirisleF fum. don f i' |si rluibcd l'\ a b w opeiahus i .nil id 
w hit h l.ill'’ iniH one t •! (be b,lit won 

Ml I'V, Af, i 
(bi AT (.4, 'T 1 

Ihr, followmi; |( nirnas 'b imjirsinm liow dn indm. eil murn . 
o{ thiM ojK ral'Us f.niing friun / (o I ) t ,in r»i niadr ’ inatl 
I'V r ' ifUfoIbng tin i.ih' m| \;oMn Hi ifiVobcvd m dn (uoltb jik 

I rmrnu J Ir i \ » Sl\ly,i Af^ . S I V ( ^, I and A' di, not i. , 

du‘ time varving wp ralot .e.vKiated widi (be ‘ orrmndalois 
d, Af,^ } ? hi, ) hr n A'< /, ,n»d its mdm ed 

norm %.jhsfit’. 

; Hi , ^ '.Up 'I A Ii , 

'y,^7 yi sup ^ ^ sup k iud/i ); 1 

i ' * . 

PrtKtf VAc daft bs showing Inm the ojHhator |4 , Af,7 
ojK:r.deon/' sequences ! ,i « r » / then 

|.4,. Af„ ]rb't ^ ^ u,(/ 0 m,Ak rlpdrj 
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1 »king the value of the abavc cquaikm we get; 

t k 

IM„ X |a,0-t)l2^ 

h m t • <) 

' \m^Jk 0 - mjk - i)f Hi»|U 

/ i 

“ X I"-*'' ‘‘)i X 

i-n loO 

X -- Ill'll. 

'■ V |fl,(/ ■ A)| ||M,^ ■'M„ll^„||i'!|.., 

ir -K 

Yu X M' *) II''. ~ '•ill ll'’ll- 

ir -1/ 

However, 

|fi* n,i \nj^ k ik t ^ t ■ n,\ 27' f |/( ~ /!. 

I hercfore, the above inequality can be written ns: 

lll'^,. W„Ji'||. {iYuT ^ |u,(A:)| + ).„ X * M,(*)l) ll"ll. 

A -II A «ll ^ 

l.rmmu 2 liniler the assumptions m Lemma I, let R denote 
the lime viirying operator aivHocialed with the family 
A„ }, f “ 0, J. 2, Then R f and its induced 
norm salislics 

|IW||,,,„ ..up ||M„/A, - ,^„,)llr,, ' YJ^^ 'up X l"'-.,(*)l 

' ' A «,l| 

Rroaf I'hc proof follows in a similar fashion as above and 
will be omitted 

Ncul, the proof of Theorem I is presented 

Trofi/ of Thtuirrm 1. ( ortsidcr the first equation in system 
(4) expressed in an operator form, 

(/'y, f Afvi 4 Yvi - I' 

where i»(0 (/„, W,u,)(r) (/f, u,)(0 l.etting t be a 

fixed time instance (r r / ' ). we can write 

y, ^ {(• fv,)Vi ^ A y, i Yvy r 

where Henolc by the inverse of (/„ By 

assumption (AS-4), //„ t -/,, Therefore, the above 
equation cun be written as 

V, ♦ //„ I' 

I valuating the above ofxralor equation at time t. the 
following equation evolving in r descril>es the same dynamics 
of the alxtve equation, 

v,(f) f + (//„,A>,)(r) 

Similarly we uui wnlc 


(//,/v,)(r) f i,(tM (//, KV 


where nq/) ‘ (Af^ HA, u^Hf) C ombining the 

equations alcove, we gel the following closed Uaip system 


where 


(/ ■* /•)(|!q(f) 



+ W.,V IlnJ \ 

' IK/ <-.,) +1C, 

Lhe idea is to show that the time varying operator F 
mapping T into itself has an induced norm ihal is maiorizcd 
by the rales of variation of the operators A. H. 1., M and G. 
In other words the induced norm of the perturbing operator 
f can bi' made levs than one by choiring the rales of 
variation suflicicntly small from the previous lernma.s, and 
the fact that is uniformly fniundcd. it is clear that each of 
the lime varying operators generated from each family of 


operators H„^X, H^^Y, H^W (mdeaed in r). have 

induced norim that arc oontroiled by the rates of variation 
Ya* Va- V/- Kw- y<, inicrnaJ stability will fallow from 
the small gain theorem if we show that the induced norm of 
the operator H^iG - G„ ) can be analogously controlled 
Neil, a detailed calculation of an upper hound of the norm 
of the operator (G - G„ ) is given Let v t/' and the 
output of the operator is x, titen 

■*<0 “ W„,(x (/?„,<* ■ ')-«„,(* - '))y(01 

I - rj 

f A 

= X X - 0- 

A «<t ( «4J 

Taking absolute values we have 

T A 

* X X " *)l • 0 - Xr..(* - 0)1 IIrll. 

A-() i~ri 

by an argumeni similar to that given in the pr^M^f of l.x'mma 
I it follows lhat 

||.t||, 5, (y,, nun X l^,i,(* )l* ^ 2y,, f sup X !*,,(* )l) II' ll. 

By assumption AS T it follows that there exists constants 
(“,, (\ ^ fl such thal 

IUT1-. -(yof. ^ 2y,.7'G,)||v!L 

With this priHif we have shown lhat the induced norms of all 
the perturbing operators that comprise h can be made small 
by chrHising Ihe rates of variation suflicicnlly small 
Tlicrcforc internal stability follows by an application of the 
small gain theorem 


S Duruxunn of ihe results 

Theorem 1 indicates that if Assumptions 1 4 are satisfied, 
and if the variations are small enough, the closed lixip sysiem 
will be r-stable Assumptions 1 ^ are rciisonahle for the 
plant, and easy to satisfy hn the comfu'nsaior Assumption 4. 
however, is harder to satisfy Necessarily, this assumption 
implies thui the zeros of f#dz) lie outside a disc of radius 
I + f, for some < >0. the converse, however, is nol true 
The condition on the zeros can be precisely stated as 

inf |G;(z)| iS -0 Vr 
|.'h» 

Hence, from the spectral theory ol 7,,, (i, ' is in 7,, foi 
every fixed i In addition, the //. norm of G, ' is uniformlv 
bounded in /, since 


'lU- u - f 

i/ho|(/,(z)| mfi. 




1 

■ 


V/ 


Note lhat this d(H*s nol ncccssarilv imply thai \\G, 'll /,, is 
uniformly bounded in r In the case where the degree of G^ is 
fixed a priori, lor all /. the uniform boundedness of the 
IIG, 'll, will imply the uniform fx)undedncss of ||G, 'll /,, 
(Doyle, IW) 

In Ihe following theorem, we will show that with some 
mild assumptions on the spectral condition is enough 

to verify the uniform bounds on (he 7,, norms and the 
ITAl- of ' 


Theorem 2. Given the following conditions 

1 iG^fzllSiM, V|r|--.'1. Vr 

2 |G;(z)|:s A/,V|z|-i.- L V/ 

.1 |G:(2)1s Af,Vlr|-^ 1. Vr 

4. inf |G'(z)| A >0, Vt (spectral condiium) 
l^l'i 

then the 7| ,-norm and Tl AF: of ( f ' arc uniformly bounded 
in t 


Troof. The pnxif i.s based on an interesting theorem by 
FFardy (FfofTman, l%2), which can be stated as follows 
Given a function R e H, with 

«(!) - X 



then, the c*K*flicicnij» r* sat^fy 
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i 2.1 I'JAeiu 

* - I ^ 

Hcikx\ lu how that !!(;, i% umlormlv ^xiumicd wr 

jpf^ly HafdyV theorem on /«(r) id drK; ‘i:) n^ic that 

I* (;, '(’) 

Hence. 

Ixi a, ‘(r) he given In 

(>, ) - V h [k\r 


1 hen 


«(:)- y Kh,ik\:‘ 


Applving Hardy s Ihemem on 

\h,{k i: ' 2.1 Vf A 

Hence. 

ij(i\ '|<- 2.T ' 2.1-A/ .S 4 ,s ' 

\ sinnLo argumem vsork> Im II Al |ti | h\ consulrnne 
|f/ ' I The deliiiis are omitted 

f rom llu’oiems I. J ue <dilain Ihe InllovMne rcsuli 

Ihritri'tn ^ Vvilh Assumplioin I V the >|v^ii.il unuhtion 
[A. Iheorem 2). and ilic miilorm houndedne^wK o| d»e 
kliiantitu's (i-'\2!i , . I /V,li. h/ .V , VI du ilnvcv) li^op 

s\ VIem ( 4 I IV viable 

rroiif Ihe [fool is viraigln!oiVAaikl since (he ^muliiinns in 
Iheorem 2 w.ill he satisfied Irom ihe Me/oni ideniiiv rel.iiiin' 
(I, lo ihe ahn\ e ijiMnlilies 

li IS unrthuhili noting at Ihn p<iini tha! siarulaid lesuliv in 
sldvslv \arving v\siemv ^issume hmie dmiensioiialitv In iho 
setup, ihiv is eipJivalenl lo rcstrHlmg S fi I , M tohavme 
a fixed degree If llie coellieienis o( Iheve Iviruinms an 
Uninded in lime, ami (i. has all ilv /eios oulside a iliv< <*! 
radmv I ^ t. Ihe eoiulilionv ol Ifieorern 2 art immedialrK 
salivhcd. and ihe closed loop sxsicrn n vl.ihle Ihe result in 
this |)a|H.‘i IS a gerni ali/alioii o| ihc aho\e to mfiinie 
vlirnensiona! svsiems 


h ( oni tusiAkn^ 

It IS sliMtxxn ih,ii a iomtovller dcMgri hji'wtxi cm luwn time 

xrrsions ot 4 sUmh tiim vaivmg fxiam staiixlij^t‘% t^H' pUtil d 
the coiKhtHms in !hcs>ri rn j jor; met Hh dimcnviiHU o( tnnh 
the pHnt and osiiirolk r m ed ih>t Ik hiule, and (hr ^oritissUt i 
can tH' ckMgncd at evjccaUv rnstamex in time 1>H 

inhfwte dimeiiMcxnani < oj en the sxvnifcdk'j (iieMi's 

tcchnnal diftk ulin^s m ponmg sixtbihtx. und loi that 
putiiov. s ihesntTm «s noiiVed Ihe ir^uits u» {has 

p.i|K'i wiH ini' doeiht have »r mipxJitt *»ti the drMfjn td adaptor 
coiilToUers (Hahlelli and Dahleh PWip tti^njlwin and Sm 
l‘*H4i ,is well a' the ikMgn ol gam vcheduled tt'nlodkrs 
I Shiimma i'JSKj 

'Ai dre/cyme-M/ Midtammed Hahleh o su{>jmrU'0 h\ 
U\jis A A M I noervirx l iigmrcrmg \ voeiiciua I imd. and 
Munlher A liafilch is vopth>ned m pa»i tn ihe aims 
researHi ottier l enter I ; Intclhgrnt t ontu4. under gfiiiil 
P A Al tH K/> K tn M, arul m pan h\ NSi imdei giaiii 
amor's I ( s 

Rfh'H’ni f 1 

Dahleli, M \ and 1 It iVaison lids Vi) / opinuat 

eoniiolleiv |oi MlMt) discrele lirm ss stems If f i /".no 
In/ ( orio,.; \i .\2. M i V'' 

I)*ih)eh. M \ aiii! I H 1‘rarvon (lOS’ln i ‘ o[viimal 
com|H'nsaiors hu i emimnous imu v\sti (iis if I I h*ins 
'\ui‘ ( ofii'fd'/ Ad KKU 

i'.'hleh M and VI A Dafilrh t)(>tinui) u jccdcm ol 

|Hrvisitf»( ami tHuimlid disioiteim.rs t oniiriuHv |>io 
(Hiiu v aiul ad.iplaii'*n II I I .tri/ ( AC-.AS, 

I >i SOM t A am! M \iLhasagai tl''’'^) htilfuul lo/roo 
Inf'it iU4(fU4i Tof/u rnrs Ai atlenm l‘u ss Ness >’oM 
1 toMe I i \|nu tun d umc riamix lui« ail jol design 

II A( WiMkshop on I siimalion a nl ( iUNtiol ot I tui iiam 
S\ siein^, hi 'sron M A 

I ram I' li \ \ ( .ru,»w tu f/^ ( fhr*tr\ 

Sprmgei Heiliii 

(iinhIwu! (j ( am! K S Sin 1 I'iH-t) '\ihtputi f iltfun^ 
^'rt iiii t!i >>; unil ( I’M/r,./ Ihenlict llall I nghsc.MHl ( lills 
N.. 

Hille 1 ami K S I'hilljps (IdS’i /un./.-onu/ Ariix/vso ‘inti 
Sf'rm yntupk Ameruan Mai liematn, al Sim.uIs 
H orfinan, K fttinn\ h Spm e- >>t Inu/em / i/rrM/oio 

hfentn i- Hall I ngIccfcootJ I liJU Nl 
Shaimna, I Anaivsr ami design of gam sHnilided 

omiiol ...sotne. I’h I > IhesisllHS IH I TV) Mil MA 
\id\asagai M (1'*.^^') (♦-nrrrW 'iM/em \ i fi/krc/v \ 
/ fit/orcum av \pi>rn,(>h SI I I hievv < andiriilgi , M A 
\S illriTis J f I I1 I f ht XfUiU'i^ I'f I ri'ifhnt I Sv\/i’'mi\ 
Ml I Ihew 1' andnidgi M A 
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Parks Road. Oxford 0X1 3PJ. UK 

ijKf Tiif quesf for the philosopher s sionc ihe dream »>( an 
asiaplive coni roller which su-stain^ optimal jH‘f(i>rfTKince 
despite changes in the plant iind its environment has 
stimulated many theoretical and algonthmic deselopments 
An early requirement lor adaptation was j>crccivrd with the 
new supersonic aircraft, where large dynamic variations are 
lound in passing through difTerent flight regimes, and ‘ MmJel 
Reference" methods were the control engineer s reqvmse 
These were evsentially heuristic, involving simple maihe 
malics and many simulations a typical leading approach 0 } 
the period was the “Mil rule", in which a eonfrotki 
parameter ff is adjusted according to 


where e is the dilTercnce between the imipuis of the plain 
and reference itkkIcI At (itsi n appeared that tluse methods 
could adapt quickly and reliahls. luii ihe overcontidencc ol 
the with Model Reference Adaptive Systems led to 
disaster. There was then a reticai to first principles Uhiking 
tor proofs id slahiliiy and for new methods with guaranteed 
behaviour Applications of MR AS wilhcretl conirol thcorv 
became dominated by the new slate-space l (>(i methods, 
and gain-scheduling using fiili»l pressure to index the 
appropriate conirol parameters was used lor aircraft conirol 

PriH'Css control lagged iKhind acrospaie ilevclopments, 
with the (irsl Direct Digital C onirol svsterns appearing m the 
iS(K, and with DIX' iiniversallv employing PIf) algonifiins 
These vometimes proved difficull to nine, particularIv i<»r 
slow priK’csses or, more signilieanlly, lor sysienis with 
dead time I he position was iransloimcd in bv the 

seminal paper by Asiriim and Wittenmark which o|K’ncd up 
the new field ol Self-Tuning fOnirol Here ihe ainhitims 
were different: discrele-lime rather than continuous time 
control [though (iawihrop ( P/K7) develops self lumng liom a 
coniinuous-iirnc viewj>oint|. plants a.sMinuMl nwisiani lor 
slowly varying) hut unknown rather than rapidb s.using 
dead-limc and M(K.hasliL disturbances int lulled I ho fuqH r 
arriving at the time of the energy crisis (and hence the need 
(or improved priK'css cflicieiicies) and the advent of the 
micropriKessor (giving a cheap route into implementation I 
aroused intense interest many new developments and 
important industrial applications were soon rep«irtcd 
( ommercial prrKlucis became available and there was lapui 
Iccdback from praciice into new theory (see Harris and 
Hillmg.s, WKT) It was found that in mamy cases ihe simple 
tuning of a fixcd-parameler PIT) regulator was vufficieni 
rather than continual adjustment ol the more complex 
algorithms provided by ST(—a tradeoff between jx-rfor 
mance and complexity This sparked oft the development of 
Auto-tuning" (asscx'iaied again with the name of Asir<)fnl 

Meanwhile the MRAS schixil produced some lundamenial 
stability theory which revolutionised the field Liapunov 
mcthixis were used to ‘‘redesign” the Mfl rule to give global 
''lahiliiy based on the concept of Positive Real transfer 
lunctions H i]H;rsiiihilitv and passivity arguments were also 

* Aii^ipuve C ontrol hv K J Astrom and H Wittenmark 
Addison-Wc.sley, Reading. MA (19Hd) ISBN (T2fn ^W72()-/v 

2frj 


rmf»4oved Nim iHuitive real trainlri fumiicHis ^ru timled 
asiiig ihe rdm of augnienicd error A rajiVfuiHTit itietti between 
SH and MRAS was made and ihcie has Ixm Mgmfkimi 
criHs feriili/ation txiwcen Ihe a|vfM»>acKe> (Sitsirv and 
HiHlson. IW)) Though effectoe designs (virtinc av^^ihiiblc, 
the evseiiiiaflv ivmlinem nature of ada}siivf eoniiollrts nienns 
that ihrif behaviour in non ideal o gcnerallv difficult to 
analvse indeed Uik o! robusincviv iinimHkTIed dynarnkw 
has been seen to lx a vigniluiint problem and Uses such as 
norma heat ton. vlcad barnK. and regreevor hfiertng have been 
develofxd With slow adapiatiini the two time sl ale natuir 
of the system admiis the use ol as*erag<ng methkaK 
( Andefccui ri al P>#.sfd st' that sorne geiu fiii anaivtrsal IihvIs 
have fxcomr iivailatdc 

Adaptive contic'l ioseis an immense range of subjects with 
links to miinv ol Pie idtiis ol mi>dcin lonirol theory Ihere is 
no general fhcoiv (unlike sjiv for linear systemsT bul w 
iCHilIxiii of approaches [see. loi exjimpir, tiuplJi (l‘')Kf»)| 
which fuivr piosed usclul (01 analysis or appircniion The 
choivt of whuh lopus to cove? is diffuuli. (vaitn uUirl. (01 an 
irUi<Klucfor> ten Ihc authors deal with this problem with 
great skill Dearly drmonstraiuig then unroalleil ex|H’nc'iu‘f 
in gent ruling and n|V|>lying many of the leading mctlviHls in 
the held 

AtJaptHfv f onrro/ o intrrKicd as an introiluctorv couim* Ioi 
students who are presumed to have a iMckgiound 111 
automatu control and sampled data systems ami iv aiiCsMble 
also to an indusinal readership Hence, unliike rnanv ben^ks 
whic ‘ com entf ale just t»n Ihc theory, Ihe lecpu is sitoiigb 
motivated bv a disc ussion of the c lass ol pi at lu id pinblein 
which might require adtipirve tohlod and “I the design and 
use. of currcni commemal adfialivr, lontiolliin Due 
discusMOfi irnludrs eases where iotislani h;edb,uk |s 
sufliin.ru and a deimuistraiion ihai sinipb oisjK.etirig the 
variations of rqxn hwip step rrs(vonse is noi suHreirnI for 
determining the neeil lor adaptation Anottier sigrufKani 
]jx-diigngual feature ol the ftook is the laige numlxr of 
simulaiMms lognher with SIMNON programs, so that the 
siudent IS rntouraged to refxai the exercises and diMovcr 
the eflec I of rnodifu ,toons to the itlgonrhms 

After the mlriHfuclorv rnotivnOon lefursor par.uiirlrr 
eslimalion is liealt'cT eomenOating on HI N fwiili (oigetongl 
bul with a brief mention of (fu pO/jeiiion a!g< 111111111 (crriaililv 
much less detailed than m (icKKlwm and Sin (IWIjj and a 
diseijssion id square ihmu mrlhc*ds (or ensuring g<H»it 
numeriial projx-rTies Ihc RTS scheme is di vch>|>ed from 
classital Of line least sejuarrs foltoweri bv application of 
the matrix inversion lemma Iherc is a comment .dvoiii bias 
when I S IS fii>i'lied to stcKhastii mcMlcIs and wUh eorrcliiled 
errors and some brief discussion alviut M S/RMl . hut no 
dernoriMration of the mugnuiide or source of the bias is 
goen, which might worrv the non-exjxri reader This is (he 
least satisliictory chapter rjf the Isook as f>o sirmdiuion is 
given, nor is Tjung v flVKTj useful frequency rcciKimsc: 
interpretrilion of least squares ami the role of frequeniy 
weighting dcMTilvcd Ihc diMusMon of ihe im|vorianec of 
rcgrcswri filtering n Icit to much lau r in ihtr context of 
applications. this perhaps is the appiopnalc fviiue lor 
square fool methods 

In contrast the ehapicrs on MRAS uid Self tuning 
Regu)at(»fx are nicely judged siariing with dear deiwriptionv 
of the basK problems and a methodical development through 
the irKTcasing comidexniev of Ihc vub}ecis Tor the 
mirdd rcfercrK:e afifiroach, variants of the MTT rule, 
Lyapunov and hy(>erxtabdit> methiHls, positive real systems. 
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pasMvny and uut^mented crrrKs arc divcu^^cd, leading lo u 
MkAS fur a general linear nysicm Sclf-lunirig is intrixluccd 
tu iwu simple iridircci examples wiih cummenu afvout chc 
diffuulty uf anjilysis because, fur example, the csfimaies map 
iniu the (.urUrullcr parameters in a (:4>mplicated way which 
may have singularities I he classical direc t methods uf 
minimum variance and generali/eduninirnum-variancc are 
devcluptul in an elegant unified style The mure recent 
indirect approaches of {,()(> and adaptive predictive control 
aif dcserihcd 

Hie liook then changes gear by giving an overview of the 
analysis ol stability, convergerue and robustness in adaptive 
schemes It emphasises that there is only a partial collection 
of results because of the underlying nonlinear character of 
adaptive systems. A typical global stability result (using the 
Key lechnital l.enimaj is protliiccd for a spc'cdic direct 
|;>ole placing law lor a deterministic minimum'pfiase plant 
with known dead time, ami by example shows that certain 
disturbance paUcnis added to the plant can produce 
imiHturuJetl l>ehavioui I his motivates the use ol dead-zones 
to recover boundedness I he principal theme ol the chapter, 
however, is the irilroiluction to aiul use ol averaging analysis 
lor slowly-adapting systems The examples are carclully 
choNcn to give insight into adaptive behaviour for example 
It is demonstrated that the Sf'K rule is sigmlicanily less 
robust than the Mlf rule (or even simple unmoiklled 
dynamics, with the eomment that analysis <il the ideal c.ise 
can be quite misleading f or stocluistic systems there is a 
heurtslic discusMon of slocfiastic .iveraging leading lo 1 ping s 
mclhod, with an illuMialion (d iis a|)pliealion to the 
moving aveiage sell tuner (here is a Iniel ilivcussion of 
livstiihilily riicchiinisfiis and tjf Nussliaurn’s universal stabi 
li/ers, (hough chaotic bi haviour m atla|)livc systems, winch 
has aroused recenl inieresi, is not included Ihis cliaptei. 
together with its sueeessoi on the subject ol sloch.tslic 
atiaplivc lontrol (dual control and suboptimal methods such 
as cautious control), provules a niosi inU'iesting siimmaiy «d 
the theoretical liasis (or adaptive contiol which would piovc 
usclul to student and teacher alike 

I he next chapters, on auto tuning and gam scheduling, are 
novel m a book ol this natiiie and show the applications 
commitment ol the autliors (hough relaiively simple m 
theory, the techniques are likely to In- ot the greatesi benehi 
to imliisiry The raihei briel aceouni ol tiuio tuning (oi 
|ire tuning) coneenliaies on the ofien Imip step response 
approach, the /legler Niefiols inelluul and its more recent 
development using relay Icedback (he basic ideas are 
clearly explained, hut Ifie readei will gam the impiessuMi that 
there are lurlher tucks which need to be up the 
manulaclutei s sleeve m order to design a satis!actors 
product (iam seheduliiig is Heated by a senes ol interesting 
examples a nonimeiir actuator, lank with variable 
cross section. eoncentialion control, a large ampliliide 
pendiilum. ship steering, pfi control. coinbusiion control, 
fuebair conlrol. and flight control The siudenls will en|tiv 
working through these, the teacher will be reassured that 
conlrol theory can be usclul' 

There follows a short chapter on alternatives to adaptive 
ccmirol including idbtisl control, sellosedlaimg systems, and 
vanahle structure systems Ihcnigh this contains interesung 
rnutcruil. n is jhismIiIv out of sequence and better read m 
conjunction with the coiuludmg chapter on jKOspcctives ol 
adaptive control there is little space for issues such as the 
trade-ofi Intween perlormance and robustness in adaptive 
control (i e distinguishing iH'twcen robust adaptive control 
and adaptive tolmsi control . ) 

A high ,s|H>i of the IxHjk is the cliseussion ol piaetical 


aspects of adaptive contrcjl, which should bt‘ compulM>ry 
reading for any praciiiioncr Signal conditioning (eg. 
anii-alia.sing filters and their effect on the estimation), the 
filtering of data against disturbances and unmodclled 
dynamics, estimator and integral windup, and the interaction 
between estimation and control are described A prototype 
algorithm which combines these features is presented. Many 
of the recommendations are based on engineering judgment, 
developtnl from experience, of the important factors for 
creating a successful adaptive controller Ihe experienced 
reader will be able to read lieiween the lines and recognise 
the many pilIalK thiii arise when the advice is ignored, the 
student may be overwhelmed by the details Phe following 
chapter on e^irnmcrcial systems and applications confirms 
that extensive built-in knowledge and gcK>d user-interface 
design i-s essential for worthwhile use of adaptive control 
Adaptive control is a minefield it is always ptvssible to 
“break” an adaptive controller by inappropriate use, such as 
excessive adaptive gain, unmodclled dynamic's, non-linear 
(e g hysteresis) aciuators, bad disiurhance patterns, lack of 
excitation, etc I his exccllenl book gives an authoritative 
guide through these dangers wiih clear descriptions of the 
principal leehmqiies and their properties Ihe breadth of 
topics covered is very large, so lhal the student will often 
need to read supplementary material to obtain detailed 
knowledge, but the range ot examples and illusirations given 
in the text will surely motivate this efiort Ihe luiok is 

destined lor every control engineer's shelf 
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Introduction to Signals and Systems* 


FcJward Kanicn 


Hrvifwfr J F BOHME 

Ruhr Univcrsiial Bcichum. Fakuhat lur Flckiirucchnik. 
Lehrsruhl filr Signalihci>ric. I’nivrrsiiiUsvtiavst {Ml. D 
Btx'hum 1, F R G 

Tui PI HP<»S> of the txK)k ts. toUnwing the auihiu m his 
Preface, to prcseni an inifoducunv vei cnniprehciiMw 
irealmeni of signafs and syMems. \Mih a siiitng cm{*h 4 Ms .,n 
compuiing, using programs wniten in Basic The fxK»k is 
addressed lo sludcnls and prolesMonal.s not m vUtinea) 
engineering, hul also in mcehaiiKal. chemival and iridusirial 
engineering, and maihemaiics I'he hackguumd necilcd )ni 
reading the fxKJk amsisls ol the lirsi and second vear unnses 
in calculus, physics and elemcnlarv dillerential cquahori' A 
course in clcclncal engineering is not requnn! .ililHUjgh 
cleclrical cireiiils provide mans exampU-s gisvn ui Ur K»ok 
Over 2.S() examples and 2Hi) homewnik {nuhlcmv help !»» 
make the scofK* of Ihe work quiic hiuad I he dcrivaiion o( 
results usually siuits walh hasic lads and r (R use. ^c! 
malhemalical ngoi is nnl overcmphasi/cd 

Apari from Ihe broad engineering sc<nx- iIr uilhoi 
follows [he mleresting concepi lo develop toiHinuouN iiim 
sNSlems side by side with discrete lime sssicnn lor loerv 
model gisen in the conlinuous-tiiiu case, the entrespondioe 
discrete lime system is also siudicd and I'h i' I'rr vj, SH 
iliflerences and similarities cai> be poinied oui thiovighoui tin 
bo<»k Addituinallv. the gcneralion u( diM rctc-iinu mi 'dc)' 
from connin'<''is time ones b\ Rocral methods o discusM d 
in some detail 

Beginning the h(H>k with clcmeniars desviipiioiR nl sienah 
in ihc time domain, the author uses input nutpui diMcri iiiial 
and difference equations to inlniduic liruar ,m*l lime 
invariant systems I hev are illustrated In ariahijj R| t 
urcuils in the eoniinuous time ujse and bs blotk diagrams in 
the discrele-lime case I imen iir\mg. non linear and 
multi-input niulli-oulpul systems are hrit (h dcsuilnd I In 
ouivolution representation, i e the umviiluiion iniegial .uu! 
the eonvoluhon sum of the system outjHil arc mi!otlui.cd A 
large efiori o( the book is ilesnied tn the Lapl.ue and the 
.r Iranslorms. the (iroperties of whuh are 'vtudna) and 
compared l;xiunplcs are given as to how in fiaiidle l.near 
svsiems with rational trarisler (unctions SliImIus profserties 
ol continuous-time systems and discrete (iiru svsterns t.iri 
now be discussed The asvrnpioiiL m.irgm.d and HIBtt 
siabiliiics are studied, and eorulilioiis .iru) tests ri\ s,Ldnli:\ 
are given I’he r<»le ol IrequencN respuoc ol a swtim is .d-n 
studied 

The lollowmg topics concern Founei sctrs as vscll as 
Fourier transforms and their properiies (hen rn 

anaivsis via the Fourier transform is eliscusvcd m pariRulai 
the ouipul response, amplitude modul.ilion and puKe 
iJmpliiude nio<lula(ion m connection with sanq'lmg I lie 
discrete Fourier transform and its prnpciiR-s. sw'em an.ib as 

(f\{rf)(i\ACtion lo Stj^nals und S\or‘m^ bv I Kanuri 

Macmillan. New Y*»rk I F^H7) ISBN b tt2 

F S 116.(1(1 


[K»SMbihlR's and the I 11. algoiuhni arc slu»lRd \vrx"its tU 
aaalog loaligutal eoiivcisiom. ihgila) analog et*nvctMOi\ 
matched fillers and digu.d conii.d ate bin fF dts^vicsed Ih Ioic 
ihc l»*H»k toruhnlc' wilb a ihaplcr ■.«n siau spavC 
Ieprr^cn^'lt^ol 1 l^ cd ho- ar ss uctro An ApjH-ndiv contains tin- 
Basic piogtarns and biu l tcuewv ot complex vanatdrs and 
mainx .dgefna Hu tirvblh»gtaph\ loiv Mkatron td odated 
lexltHkoks 

Sofiir reniaiks <,|i vjw ual (suno .if the f^mk aiv addeil 
l irsi. ihc Mdi (o suit lie Vi tot>im. Ilfs tt) voniirnKuiN tirru 

.md disiicu (inu sVMcnis an w( |l oig.nii/rd .oul In Ip du 
icailci to iHTiri uiuhivt.iiRl both the <s«inrepls ainl ifir. 
rel.Uionships 1 enjoy'd fi.uhng ( h.qUtr in whuh tin 
thicv thllcii tu U|M.'s o? sialnhu i a^x mjUiviu al niatginal and 
BllUh arc Wi ll dcsiotHd In parhvutai the mutual rt'i..nivms 
aii iic.jrb evpLi.iid ifo-dvmg' liilU m(iihcin.n(\ s Ihc 
examples ara illusJt .iloa . as inosj o( them aie ilr rocd (lOi'O 
IciMi I'hxMi s and i tiginccrnig hn is Ibr iiiq^ortamc ol 
• oiRtph ./( niaiciial btionu H.nisparrni MoWi\(i ni mv 
opinion till vv.impiis take u|t m cxiiwoi (lailnui f ihv 
ih<. riuirdH I (o\(, i .'Sto ts ton maro mtl sonc could 
havi. bin Cl lIcu loped ni less di l.nl Mlbough the tv*H>k 
vcntaiiis .nv( r*iWi pagv s ! inisM d icrlain dilaiK lot 
cx.irnpli, smIuImmis of di!h ii nii.d 'U difleti iKi lopiaiioiis um 
<»mI\ u nn\i.i u< led. In t atdaic (lan' lorms ot , ii.insloirns 
I !'SJH cto i IV I hr list, i! dill , ij ( h .o ai Ic c |\( u 

р. 'b normals is not indualiol I In aiiihru us; n dcli immislK 

urn.ils and ssvlcnc tlmniglu uil tiu t’lMik A sboii dcu iission 
ri| si.' h.isiii Mgimls lo di'siiibc noisi plirrioiiu na wouhl lu 
lu li'lul 1 tie author mdn uled .i sitong impliasis on 

o'lnpuiiiig, using programs written in Basn in he. Ibclaci 
lh(. 14 B.jmi progijim imindid hraArsir .tie weaklv 
documentid and ^'ocr tiid\ .t hmited si t ol ptobhnis Also 
visiiu' Hasu ti’ wntc scicrUiln and t ngnnr iing {Uogiams i\ 
MLit mJ dait I mails I ihmk ih.ii most readers ih* n-M o ipioe 
.lufhor s grri'giarn tHa.iUM llu n c a laig; nuildn i o) 
|siI•IcsMirnal siUtw.irr pa, k.rga^ lO.ulabh iti-o run on (•( \ arul 
(hat do- th'. s.irm task' and imndi rrnwi 

In ill! rivicwci s 0 ( 11 / 11^1 ihi tstHrk IS oIc.mIs wniicn ;iiid 

с. os to underslmd Mu aulhor lias in geinral h*'^ 

i,rivls Ihi’ icsilv.uu vjo o (tmirm mil il lo engnuurnig 
viuiKnl* in tin, m ., Mral ■ ilurd v *, ,n l-u nisiiiunns lluic is 
abo a well s-iliiUO sv la iluh, -d to.M i,igv l.a .i <’!u senusict 

' oursc '*! t" Ifit'ir-' i! oi miiuiU ' ilin-dnui 1 lu (‘ook will 
Inid Its plat I w iilmi tIu iai: laimls o| dill*, o, in book', on 
sign.i)'' -md sv'O, IT!' -ijid igmd jM'nf song 

A hour ihf n isf u f r 

pfiibsMU Hohrm '.Ut.mud du (iqdom.f m iriath>malics 
Irori' thi I eMusu .il I iii .rtsiis . U M.innos cr in urd ibr 

l)r Ing in l'd.'n foau Uu I rioiisi'v ■*! ( rlattgcn and tIu 
Sl.ibiht.ition ni I'F ’ Itrar, thr ( niSM tu, of Bonn both m 
.oiripun I stu nsi, (i. Was with Knq))* Atlas I h klioni^ in 
Bremen atul with f tiA*s in V^.*Mltb^ ig V\ < Ttlil'u *vcn Sirii.i 
(u has Ih ( ri Ftofcssoi of flca rrn.d I rigifMcnng. at 
Ruhr ( no' CMf i B'Mfunn lb’, n si ar' h mti r(Ai< ,in' m aririv 
sign.i) poMo’aur'g '|(.icit»-m ,im! vtimalion, {coaHcl algo 
nihms am.l ssstitln, arr.is* Mr o a f i How 'd tin If I I 
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State Variable Methods in Automatic Control 

K. Furuta and A. Sano 


Hnnvwfr J WILI,F-MS 

Rilksuniversitct (ient. Ciroolc Siccnwcj^j NcKird 2. B-MTIO 
Cicni, Bcigium 

If IS HAKD to chiiracterizc the objectives of this b<Kik 
compared lo the many other hooks available on linear 
systems (e g Kwakernaak and Sivan, 1972, Kailath, 198(1; 
Knohloch and Kwakernaak. 198^) 1*bc authors arc not 
helpful in this respect since the bonk docs not contain a 
preface 

The bmik docs not intend to offer new viewpoints or 
original results It contains more or less the material which is 
generally taught at the senior undergraduate level or first 
year graduate level in a course on linear control systems 
theory Although the title df)es not say so, the hawik only 
deals with linear coniinuousdime time-invariant (control) 
systems 7 he following topics are treated: impulse rcsptsnsc. 
transfer function, slate models, differential equations and 
the relationships between them; controllability, nbserv- 
ability, and the corresponding system decomposition; 
(minimal) leiili/alions and algorithms to obtain them, state 
feedback, pole assignment and decoupling, observers, 
LO optimal control. Kalman filtering and LOCi-slochaslic 
optimal conliol 

f have the feeling that this book is not well suited for 
independent reading There is very little motivation for the 
various topics <liscusscd Moreover the reader is not told 
where the analysis is rigorous and where it is not In addition 
somelimes I he analysis is not rigorous, even where the reader 
might think it is 
A few examples, 

Lhe controllabiliiy projseriy is dclincil with respect lo the 
jxissibiliiy of liunsferrmg any initial stale at time zcrc^ to 
the zero sliitc at lime t, No comments arc given on the 
obvious questions is r, given, is it arbitrary or should the 
projKriy hold any t,? Why only steer to the zero stale’.’ 
Ihe former remark is relevant if one thinks of 

lime varying systems, the latter if one looks at 

discrete lime systems Lhe condition for controllability is 

expicssed in terms of the nonsmgulaniy of the Oramiiin 

for /,; here the same questions obviously arise. Similar 
remarks can lx* made with respect to the dclinition and 
the analysis of observability 

In Ihe analysis of the LOf 1-problcrn the concepts of 
optimalily and linear-optimiiliiy are mixed up 

* .Vnjrr Vanahlf Mrihods in Aulnmatic ( on(rol by K 
Furuta and Akira Sano Wiley, C hichester (19H8) ISBN 
47l9|«77b, lib 9V 


For the l.O-oplimal control problem, ii is not obvious that 
the limiting case of the receding horizon optimal control 
problem corresponds to the volution of the infinite horizon 
optimal control problem. T his has been discussed in depth 
by Callicr and Willems (19HI) and Willems and t'allier 
(1983) 

I have serious objections to the way L yapunov theory is 
applied flic authors do not seem to see the distinction 
between negative definiteness of the derivative of the 
Lyapunov function on the one hand and the property that 
the derivative is negative scmi-dclinite but only identically 
zero along the null solution, on the other hand 11 lhe matrix 
H IS not square, then -||//x||" cannot be negative definite 
(page 75)! 

Another weak pinnt of the binik is the list of references. 
The most recent reference is more than 10 years old. this is 
very surprising in a field where much new insight and many 
new results have been obtained during the last decade 
My conclusion i.s that this book is not really suitable for 
independent slutly It may be useful for a lecturer leaching a 
course on linear control systems theory. For him. the mam 
interesting fcalurcs of the book will be; the selection of the 
topics discussed, the numerical examples and the exercises 
The mathematics involved are much simpler than m many 
recent texts on linear systems with heavy emphasis on 
geometric control theory This may be an asset if one want.^ 
to use the fxiok as complcmcnliirv reading material for a 
course in an engineering school 
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Binare Steuerungstechnik—Eine Einfiihrung’'^ 

K H Fasol 


Reviewer R. JOHANSSON 

Lund liisiituic of Technology. Sch(H)l of Technical Physic's. 
Depariineni of Aiiiomaiic Conind, Lund, Sweden 

At TOMA I ION iK MNoi iKiv may aiver at least three 
meanings of ' coniror' which apart from feedback control 
may denote the important hichs of sequential control and 

* Huuire Steuvrunf(stechnik - Erne EinfuHrunf^ by Karl 
Heinz fasol Springer. Berlin (1988) 


supcrv'isory control. Manufacturers of industrial control 
systems have lately incorporated many of these aspects into 
their products, and thus ihcrc appear new- demands that 
application engineers should master several new aspects of 
control. The countries of the European community seem to 
have acquired a high stale of maturity with achievements 
such as Grafcct, and industrial standards for sequential 
amirol Adequate engineering education at a lower am) 
intermediate level, and thus gmid tcxtbcKiks. arc obviously 
prerequisites to the broad application of these new means of 
technology. 
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One book in ihis category i« Bmmt Sieuiefuni(stt%hmk-- 
Eint Emfuhrung li ines to fUl a gap bciwten the theoreiM:*! 
approaches of computer scvcfice and the practical attitudes of 
automation technology with a spcciaJ attention to the nced^ 
of mechanical engineers. Ilic btiok amsisu of two pam 
cohering comhinatonai arcuius (Chapters l-h) and xnuen 
ua! circuits (Chapters 7-10), the latter in turn divided into 
sequential machines and programmahle umlrollcnk llw 
inirLKludion slates the advanUges and disadvantages ot 
programmable and nonprogrammable soluiK>ns 

rrspeciivcly 

TTic first part of the book desenbes combinatorial design 
with Boolean algebra, predicate calculus and set tbeors 
(iraphical rcprcscniaiums .such as Karnaugh diagrams. 
contact charts, function bIcKk analysis and ladder diagram 
languages arc presented in a traditional way MimmizatKui oi 
k>gK circuits ad modum Quine, McC'luskey. Karnaugh and 
the CTinjunctive minimal form are treated in detail but 
illustrations in the form of Venn diagrams arc aNcrii Circuit 
design with implcmcnralion by NAND and NOR elements 
and the problems of hazard are prc.vcnicd in a iiiidiiional 
way 

Sequential machines are thoroughly presented with 
detailed functional bUnk diagrams including gate.s and 
dip-flops Some design examples are presented with 
Lomhinaiiinal and sequential circuits connected to the ckKk 
pulse input, although such a method is sometimes 
considered as piKir design practice The ailcntjon to logic 
design problems here dominates the problems of interest for 
programmable logic controllers. Ihcrc is a comparison (p 
Kll) between hardwired (Vcrbindungsprogrammiening) and 
programmed (S|>cichcrprogrammicrung) and olhcr scqucri 
iial machines but the section contains no iradiiional 
classihcaiion such as Mealy and Moore m«ichines S(H*cial 
cases ol finite stale machines in the form of sequential 
lunciion charts are covered m detail. 

The distinction Ix-lwccn single sequential lunetion charts 
(/wangsfolgesieiicrung) and methods alKmmg sequerKc 
selections (FTeilolgesieuerung) is carefully pointed out m 
( haplcr K 

( haplcr treats Huffman automata, with special attention 
\o the hazards and oscillations ap^Karing in asynchronous 
circiiiis. and the special coding mcthtnls ncccssaiy (or 
hazard iree design ol asynchrun<ms sequential machines 
I iiniiaiions ol the HulTman finite slate machine.s as to the 
siniultaneous synchronization and sequencing arc also 
reviewed Remedies by means o( coding arc presented but 


ihr priKticjill^ iifi|mm«nt (n ay h^vr fwn <imiltt>d 

The pfrtriniaiu’vn st\'W and the bKiwA t>l atiemieni cbntxgr 
txm^idcfablv between (Tvapiers V «i>d HI ilmpfrf Id 
miroduoes the programmable ovntodkrn mih bnun^cnl 
remarks arnl with ounmcnis on ihr impottincT ol 
nuixotXMnputer init>k*m<niJii<vnH .Srvrnil viifiiliii.iiitfe%. to 
computer pfogrammtng ate cmtvhmrrd with leev'mmtnda- 
iioiis m Uk iMogiiimming vtvic, r(HHfuUtizatn>n and 
pfogr nmmtng rnviumrnc nt> 

live opplKaiHvn i-x.ampl«s are icnicird atrinirtd a WmcfiA 
pit^grammaNc kiwiirrq svstem I he bvHvi olwo conftitns n 
valuable a|>t>ciHiix ihai mdudes Nrveml ciercms that make it 
suiiabk tof e4>ijr%<‘ w ork 

Ifi.vtimcal lemarks are, with ^cw cxceiMiims, gtvrn onH in 
the intriHluetiiMi which emphasizes the charigr ot ftHuv ftimv 
pneumatic arul des ironHxhaiiHail dev Hr> lo ekctiomc 
devices 

Reiereners lo induOiul standards such as DIN. V l>l mid 
ll;( have been made in a iMictuf wav ITvw'Csei ie(rrtticc% 
to lutgmal work arc mil quite svMcinatu m Itvr lext In 
partKuUi comiinpiiarv work imiudmg the titithors i»wn 
w'oik has N'cii given rnuih uiteniion mi the retereme Ibl 

Ihcre IS idniouslv a t-onsulciablc thfleiencr Iseiwreii iIk 
needs of logic design (eg \IM dcMgri) mid the 
usyiuhioniHis logn. cuv.uiis netcsMiiv lot aulivination mid 
aptahcalKm [Mt'bicms of mcihamcal engtncenng Diiv 
aLvountv for soitu m.ohrreni.e in ihr picscniniinn Mylr 
whuh IS most iMuivu lo the fcadei in ( haplerv and lb 

As an overall i valuation, tl inav tn* concluded that ihh 
UH»k IS tartiullv piescnicd and dlnsif«tcd with many 
examples Hearing in mind ihi' strong difTriciKYv in atliludev 
beiweeri ihe siImhiIs ol icchriologv amt the univcrxHiev i' dir 
t’duiaiional svsienis ol tentral 1 uro|'H this lexiKnik 
pfohrtblv saiislifs the need (or a mmprcheiiMbU' lextlnvok (tu 
a biiiadci and praciiialK oiunied engii’Mermg student 
eommumiv li niav also Ik rriomnunded as an miimlui'lofv 
textbook of automation l<u micrmediatr level rngineenfig 
ciirricul-» Among the deInKiuies it nuiv fv mentioned that 
there is u * 1 nglish vm abnl.irv and Ihrir is onlv one 
standard set of logic design sv minds I bis is tdivioudv ifl the 
spinl O' ihr iliisr rcleicMves to induvinal standiiids but may 
certainlv picseni a problem to a studeni of scterMdK and 
icchnical liicraiun in I nglisii and mav )nii a iimilaiion on 
iht: ustdulness o! ifie fviok Stiondlv (heie are no 
illustrations m rlu (oim of st,Mc iransitionv gtu(>hs. which 
miiv be .1 disadvantagi* for jh dagogual piuiHcscv 


Statistical Analysis and Control of Dynamic 

Systems* 

H. Akaikc iind 1 N;ikdiHJw*i 


AVi u Krr RUDOIT KULHAVY 

1 /cchoslovak Academy of .Sciences. Institute of Inlormalion 
Ihcory and Automation, Pod vodarenskou vtZI 4, 1K2 ‘IN 
Prague H. Czechoslovakia. 

Ihis RtiATivM.Y .short book does ntd belong to a group ol 
Haditionully treated textbooks on .sialistical analyses or 
>t‘Khasiic control although iLs title could indicate this. Its 
gnal IS lo communicate the experience of the authors with 
Ihe application of general Iheory lo a .specific example of a 
complex technological process—a cement rtilary kiln Ihcrc 
are ,i great many publications on specified topics of (hcory 
I'Xlay, but a book trying lo enlighten the nature of problems 

Srurijhta/ Anu/y.vtt and Control of Dytuinm ,Vv5/em.t by 
H Akaikc and T Nakagawa Kluwer Academic Publishers, 
fA^rdrecht (1989), ISBN 9027727H64 , 599 fKI. 154 (I) 


encountered ifunng Hr impk inerilation phase, through a 
verv detailed lavi siudv. o still laifu r exicptional 

ihis wav verv prnf>ablv the ri avon to iriiiixhive Hus Ivook 
m the Japanese vciks of the (>f(>gramrru Malhenuilicx and 
ds Appiicalioiiv e nuisl nigree with ibr iitvservalion of 
Pr.d M H.i/ewinkcl in the Scru v I diior s Piel-iee that the 
kind and level of MPphivtu alu>ri ol mathcrnalus applied in 
various sciences has changed rliastiealH in recent veais Ihe 
same is irui: .iIm* foi fhr are w of noisv dvnamital wstemv and 
(heir control, where N*ih fKrwerlul general theory and 
effective computer algonlhmv are now avaiUbk ll Civuld 
seem that it rirnains juo (,> apply ihc‘ ready Kaib However, 
the authors of the N>ok derrumviraie in a convuKinH nvanfiri 
rhat this last vicp iv far from fxing *iraightloiwan.i or trivinl 
and deserves rtuich more care than could lx expected 

[\ js fd real interest to Uitalizc the mam M.mrce of 
diflKuliitn Ihe authors notice that m conira*l to e g 
Newtonian mechanics where alvstract comTpti^ can \k 
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ukniilied with thrif real counlcrpari^ uniquely, *>tau.siically 
l>aw!:d iheorich arc much more scnsihvc lo miunierprciaiion 
of (hen baMC concepts Ihc theory provideni only a 
framework lor C4>hercf)t reaMrnmg, i c when applied to an 
ohjecl lialiNfying list premises, it producer a valid concluiiKm 
It mcam that before uhing t^uch a theory, the user muni hr»i 
c\tah)iMh the correspondence fieiwcen the theoretical model 
and the real process Underestimating (his point may form a 
harrier between theory and practice Whiit can help to avoid 
the harrier is proper slalisiical analysis of olncrvationai data 
in comhmaiioii with a deep underMandmg ol the physical or 
chemical nature of the process studied. Obviously, this stage 
IS unthmkahic without a team ciNiperation of people having 
spex'ilic knowledge of the process and periple skilled in 
statistical processing of real data 

'Hie auih^irs continuously supp<irt their arguments by 
ext>cricnce from design of compuicr control of ccmcni kilns, 
f he cement kiln serves to them only as an esample of a 
sysicrn that exhibits a complex iHdiaviour of mutually 
dcfienderii variables, similar features are typical for many 
other systems 

five chapters of the brnik deal with all the main 
prerequisites for a successful applicatinn C hapter I ‘ What Is 
the Problem'^" explains the need loi a ihorough prior 
slatisticiil analysis of any dynamu system, the behaviour of 
which IS lo lx: predicted and/or controlled SfK'cifically, 
structure identificalion iippcars lo be a very important point, 
as with data of a finite length we must constrain the range of 
possible structures of the system model. While in ordinary 
texitxHiks the statistical siruciuic of the system and the noise 
sources are assumed known and fixed, in actual problems the 
decision lies with the user A detailed analysis may 
sometimes lead (n a modilicalion of the system structure (if 
this IS not rigidly specified) I his coriliims the ccnlral role o( 
a human observer at this stage 

Chiipler 2 ' An Uxplanaliori ot the C ontroller [)esign 
I’roblems" chtiracieri/es difficulties with the impicmentiition 
of control ot ii stiKhuslic dynamic system The cement kiln 
pnx'css is described here in detail including the principle ol 
Its ofKiation and basic chemical rcuclions Process variables 
and Ihcir measuring fwiints arc also discussed However, the 
mam piir(H>se o( the chapter is lo lusiilv ihc choice of the 
melhtid discussed lurlher lo overcome esisiing dilTieuliie.s, 
the authors recommend the lollowmg procedure f irst, it is 
necessary to understand Ihe kiln as a stalisiical dynamic 
system I'hc need lor resfK'Cting siatisncal fUiciuaiions of the 
system was totally underestimated m the ctmvenlional 
controller design Seeoiul. the statistical characterisiics of the 
system have to he continued through a carelul statistical 
analysis I'hird. to design a lonlroller for a multivariate 
system, the dynamic programming approach should Ik 
applied using the stale space representation ol the system 
Hus can reiluce the lime and memory requirements ot the 
linal algorithm substantially 

( hapier ^ "Statistical Preliminaries ’ piovulcs in a concise 
torm a self-contained intriKliiction to linear time scries 
analysis and control design Spectral analysis of statumary 
lime senes, together with the task ol stalisiical estimation of 
spectra is treated. The problem of lilting an ;uiii>rcgressive 
nnwfel lo real data is solved ineluding the determination of 
Ihc model order using (he linal prediction error method 
Then Ihe optimum controller design under a quadratic 
cnlenon is described I hc authors provide ad h(H rules for 
the choice of the jxMuili/ation matrices entering Ihc 
(Krlormnnee criicnun A (xnsihlc extension of theory to the 
mixed autoregressive moving average miHlel is discussed Its 
use could decrease the number of cix’flicicnts li^ he esinnaled 
bill Ihc difticully of mimcncal calculation makes this 
approach still less favourable 

Chapter 4 "A Successful Appht^alion reports the results 
achieved with the help of the described meihrHlology 
Tcchmcal details are avoided |lhe interested reader may find 
them in Olomo rf al (to stress generully valid 
conclusnms I’hc reader may inspect some results of prior 
spectral analysis, e g compared power .sf>ccira of controlled 
signals, or coherencies between the kiln end gas temperature 
and manipulated variables Special care is taken to the 


problem of selection of variables to f>c mampuiated and 
cfipccially of ihrj^ to be controlled Then experience 
gathered with ihc hnaj realization of the control system b 
summed up. In airM:tudjng remarks the authors emphasize 
that the basis of their success was the esiablishmcni of a close 
c^xipcration between the groups of people concerned with 
management, instrumentation and coniroU and statistical 
methodology No doubt, this observation has a much more 
general validity 

The last Chapter 5 "C omputer F'rograms’’ lists the 
programs m the FORTRAN language that give the user the 
possibility e g to compute the estimate of ihe auto 
covanance or cross*covanancc function from a given set of 
data, to evaluate the estimate of a spectral density function, 
to fit an autoregressive model to a real pr(K:css, to compute 
speenra through autoregression, or to perform optimal 
controller design. A collection of these programs lotik the 
form of a program package for lime senes analysis and 
control (TIMSAC) To provide a brief review of important 
applications as well as a further development of the 7IMSAC 
package, a survey paper originally published in the Bulletin 
of the International Statistical Institute is reproduced in the 
Appendix 

The original Japanese version of the book wav published 
in IM72. Since that time significant progress has been made 
both in theory and software l et us mention al least the 
formulation of the Alf (Akaike's information cnicnon) 
pr(x:edijre for the determination of the order of an 
autoregressive model that made the first of the auihrirs 
extremely well known in the field Nevertheless, the 
methodological communication of the book remains alive 

Note that m comparison with the early iy7(K when the 
original version was written there is more optimism lodav as 
concerns partial automation of Ihc implcrncniaiion phase In 
faci there is now a giMxl algorithmic support c.g lor the 
determination of model orders and delays or lor the 
selection of relevant variables Other problems such as the 
choice of Ihc sampling jK*riod. or Ihc ad|Lisiing ol the 
penalization matrices in the quadratic criterion are under 
study. A tremendous progress in software technology during 
the last 15- 20 years is useless lo mention The use ol 
computer aided design IimiIs can draniaticallv reduce the 
implementation costs In spite ol these taels, to eliminate 
fully the creative role of highly qualified specialists at this 
stage Will be scarcely ever possible 

The Ixmk brings a lot of convincing faces that a successful 
application is a result of combination ot more laciors, mainly 
the availability of pow'erful theoretic lixils and elTcctivc 
computer programs, a deep uiulerslaruling ol the physical 
nature of the process under study, and rational inanagemcni 
and organization of the whole cflori Ihus, the IxhiK. is 
altraciivc both for practising engineers who may gei a 
better view of contributions that modern statistical and 
control theories can bring to them, and lor rcsciirchcrs who 
may become more aware of the nontrivial nature of the 
actual implemcnlalion of ihcurclical idea.s, 

Rt’frrfmfK 

Oiomt^, T , T Nakiigaw^a. and H Akaikc (h/7Z), Statistical 

approach lo computer control of cement rotary kilns 

Auiomuiica, 8, 55 48 
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Engineering Applications of Stochastic 
Processes: Theory, Problems and Solutions* 

Alexander Za\e/dny, lianicl lahak and IXn Wul.ch 


Hrviewer: J MICHALEK 

Czccbosk)vak Academy of Scicivces, Inshtuic of Iniiifmaiion 
Theory and Auiomaiion. Pod viHlArcii%kuu v^h 4, CS IHI (Ik 
P rague 8, Czechoslovakia 

This B<X)»t was published in ihe M-ncs Apphfj and 
Engineering Mathematics and in dcdicrtUd io n|X‘si;j1iku m 
cnginccring-oricnled disciplines As is said in the torewtud 
the main purpose is lo give a sysicinatK: prcseniainin *.t ihc 
theorciical and praciical basic nulmiis ot probabilisiu 
calculus and to show close connections with diwiplmcs such 
as clccironic communication, radar and auioinatic conifol 
The b<xik is intended for undergraduate and praduau 
students and practical engineers specuh/mg m the .mas 
mentioned above. It might be used as a self stud? text oi a 
tcxt-bfH)k for courses on applicatmns nl random priwesses in 
technical areas 

The authors chose a very ddhculi task lt> wiiu n Uw>k 
suitable both for practice and for students, in a field as laigt 
as utili/.ation of prohahiliiy theory aiul smehastu prinesM-s in 
engineering applications With resrHct to this l,ui u iv 
necessary to mention the contents o( the book tti vlnivv vshich 
parts o( the theory of piobahilily ami landoni prtM.esses 
were chosen by the authors iis most ifiip<iiiam (ri»rii ilu nh w 
of practice 

rhe hook IS subdivided into iwn pans Hutulum \ iVf/wh/Vi 
and Handom PnnrsMW Ihe first part (nrsents chiijMers 
dedicated to the prohahiliiy iheory, the other lomhes ihe 
most miporiani cases o( random prixessev which laii Ik nu t 
in practice 

Chapter I introduces the basic concepls and dcliriilionv ol 
probability, the basic rules ol calculaiing wiih fnohabiliiies 
and the conditional prohahiliiy ,ind ihc Ba\cs formula Ihe 
notion of mutually indeiK'iuJeni i rials and ilu ilr 
■Vloivrc-Laplace theorem are explained in ( hapter 
r hapier 3 deals wiih Ihe notion of a random v.iriable and iis 
proliability disinhuhon function T he characlerism I unc tion 
IS also introduced The notion of entropy, very irn(>onani m 
statistical conimunicalion methods, is discussed Iimi c h.tpu r 
4 gives a solution of a very imfKiiiani problem, lelaied lo 
nonlinear networks, finding the pr<ibahililv distribution of 
the function of a random variable I his topic is continued m 
Chapter 11 Chapter 5 is devoted to the rnuhidimt nsional 
vector—case of random variables with a s[X‘cial eiiif^hasis on 
the tw'o-dimensional case ( haplcr b deals with (nobabilny 
theory, and introduces the laws of large numbers 

Chapters 7'-11 form the second part ril the bimk. vchuh is 
devoted to random prixcsses The notion ol a random 
prrKess, correlation and spectral analysis arc presented m 
Chapter 7 Chapters K and h are devoted lo ihe canoiiual 
representation of random variables and random pi»Kesses 
Chapter If) deals with linear systems and their rcsfsinses lo 
random inputs The classical case with a urm invaii.ini 
system and a weakly stationary inpul is considered ( hapter 
LI IS the largest chapter and discusses some nonlinear 
systems and their behaviour under random inputs I wo 
examples arc presented: the mcrtia less svsiem .md the 
menial one—the mam topic of this chapter A variety of 
methods for overcoming troubles wiih the nonlinear 
character of such systems arc discussed m detail An 
Appendix offers special tables of probahiliis dtstrihuiions 
and their numerical characteristics 

' Engineering Appheattons of Stfxhaslu Pripi esses 
Theory , Problems and Solutions by A Zayezdnv. f f L'lbak 
and D. Wulich Wiley, Chichester ISHN (l-HbVHfWl769, 
CS4 50 


Alter getting at i^uairurd whH iht cunicnts «v| ihv mix 

cotitd, t?l CiHirv.’ dispute wnih ihi authors then \ ho« e cd c.tsc? 
uselul for pntclux llowrvc-i nmsi re«iU/c the 
impc»sMixlih »>( cvMi-videimg ih«. ex.iniiplf> td 
pr<M'css<'s icbiicd \o cngmcirmg puetHc Llx .m'.hois «crv 
.ds*> limited b? ihc m.ttheiiuou at means whuh aie usesl 
Ihe Kx>k van lx u ad ioid studied wiih oulv ** t'inxH 
knowledge ol highi i lu iihcmaiii • CsXn m,»mlv lx 

recsvmfnrncWd lo und< igradiurti vUidcms at irthmial 
unistiviires fm gr.iduiiie viudents and tor rngine^rs who ms 
more ihiouglib aipiainied ssiih umu nudheniain .d dis 
iiplmrs. vuvh us me.ivurr fluois and jlvviravt intt gruiion the 
rt'siewer w»vn|d res ommciKt Uook^* bash'd lUi vi d<e|x'i 
iiialhcmaiii al b.u kgr<'uiul A miHlrrn atspiouth lo piobabil 
itv iheorv wirhout the I ebesgiie inugr.d »v .dmosi iin|XisM)>b 
Moiiovri itu gviuTid iheors ol the L<VmS|i(u\ mtegral »s 
simple and more suitable IxiauM one need not i.h'vtmguKli 
bt'lween ionimuMUs .nul diMirle umdorn vanablr^ as o d<me 
III ihe prcsi.nl Ivh y At ihe fx ginnmg b> ihi. pn srrtiation ••) 
b.isK |>fO|HHicv oj piobabdils ihc aulhofs loulil mriiir«m in 
more vlel.ul ihe axiomatns nl probability iheoty and siail 
With a li.isn tiipli lU o P) bavrd im ihe ftolnui •*! o .dgcbia 
n| laridnm tverio. vutu denolahons m| n|>irai»<uv wnh 

random i vvnis are norisiaiuLitd and vuiuuli ii unliMing In 
Ihe opinion n| ihe icvicwcr ryiort ailenlion ondd Ix' |Mid i<' 
ifu weak si a lion,II11V iln mosi inipoiUmi vase ol t.imtoin 
pfoeevv related to ihe piaklHe. i g tht Wniu'i ( liiitvtn 
ihcorrm shonlil be intiodimd m an expiKii i<uin With 
rcc’aitl h' uscvl maihemain al lih*ls votnr muioiis aiul 
[iroblernv art oiitv oullima.1 .uni in.iin tirnrs ao oriipaiiK il by 
ruirr . rouN examples A ly pna) example e < hapter K 
loiKi rnmg (he e.momi, al i xpn ssioii ol iln. sniunl order 
ranviom pun ess wlmh i an lx described vurd explained in 
del.iil bv means ol Ilu sIik IuisIjv mlv gnd ( ha(Ueie Ml and 11 
arc prescnii d m a sirnilai wav f lorn ihiv bn l it should lx 
sonvenuiit let bung a luhei ha id suitable rs leorues vxtiivh 
eoiilil be at vlis|wi\.rl lor more ihomugh simh 

Alici tht elilual wools It 1 ' I mp|ius»/e alliimalivt sides 
ol the Ixxtk Iln teviewei sevs ii*., main adsani.ige m a lar^e 
mimlH-i oJ M>beii examples al ilu end id e?ei\ iliapir? 
whiih ixdif'v .ipjuoxunan Is 'me (hud ol ihe Ixm A In iho 
wav the Ixrok tan ;dso l>< attravhve lor \(»(tiahvis m 
prohabjitiv Ihc'uv .uul vliKhasln proi esses 

Wt‘ e.nn sumnian/t Ihe Iwioli .is usi bil f‘U sjudenls .md 
engineers in piruliei (ra the lust aupr.nntarKc wiih the 
theory ol random pfixesse'' and with elerru niv of tiu 
proltabililv Iheorv Keadmk' the boNik taielullv together 
with 1h(' worked exaint>li s i* also reenrnmendrd I his aihave 
(olWrws from the r« vn wc'i s teuivruion lhal the given 
examples illusUale uiili/jUi<m o| iheoirlual results m 
praeliial siUiahons I he t xanitdes < an abw lx. vtjibibU' bu 
lectures iri applied fields of probabilitv and sUKhasln. 
pi IK esses 


Abnut the rriHrwrr 

Ji/i Mithiilek was fxun ifi ( /ecKoslovakia in bine l‘/43 He 
grailuaied m Irorn the ( harles I inversit> ol 1‘rague. 

f aculty of Maihernalics and Lhvsus In \'H)1 he joined tfw 
l>t*partmenl ol Information Iheeiry at the InsUtuie of 
Information Theory and Automation ol the ( /eihoslovak 
Academy of Scrcrues He rci rived m (Ph (jj 

degree m pfolrahihty Ihc'uv and rriathemaiical .(alisiii», Ibv, 
rcscan h (.oruerns (irobkmy of estimation and »i,<ognuioii in 
random pnxcsvrs sfxctral dtumip<nH»on of rrorutationarv 
prfxxsxcs, detection of changes in Irchavtoui id randorri 
prixesscs and ajrt>lKaii(mv m prachc.4l problems 
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editor at large of the IEEE />amarm>ai on Automatu 
( ontrol His research interests are in robustness analysis and 
design of control systems. 




JuDM l>cali>a AMy is the l.xceii 
tive Director of TTie T uring 
Insliliite and, since IW2 Proles 
sor of Computer Science at the 
University of Strathclyde Me 
received his HSc. with firM class 
honours, and a PhD in nuiTcai 
physKA from (he Universiiv ol 
Ijvcrpool in i%l and P>bri, 
respectively f rom (n pf7,'! 
he was employed hv IHM iC K ) 
as a Senior Systems f rigmeei and 
Account Executive, consecutively. He then returned to the 
University of I.iverpcKil in 1U72 as Director of the tlnivcrsiiy 
Computer Centre PtoCcsmu Ally has s|X‘cialiscd in 
Man-Machine Interaction since 1^7fi and published (wnh 
M J. C'cximbs) C'omputinfi Skdh and the l.ser Interjui e 
( Academic Press. 1981) and E.xpert .Vywemi i omepis and 
Examples (NC'G, 19H4). His research inicrcsis include 
human-computer interaction and knowlcilge base d systems 
He has given seminars and courses in artilieui intelligence 
and human-computer interaction m Europe*. I S A and 
Australia, and has undertaken extensive consuliancy wiih 
industry. 




Mkkscl AtIwM was born in 
Drama, Circcce on ^ May 1937. 
He received his H S E E, in 
1958 (with highest honors), his 
M S E E m I95‘>, and Ph f) 
m control m I%1, all from 
the University of California at 
Berkeley 

From 1961 to 1 ‘JM he workcd 
at the MIT Lincoln Laboratory. 
Lcxingion, MA Siikc 1964 he 
has been with the MIT F'-k'Ctrica.l 


Engineering and Computer Sacncc Department where he is 
Profes-sor of Systems Science and Engineering He alM> 


serstxl as ditetiot of the MR Laboratory (ui }n|orinatK»ci 
and OccisKMt Systems tlormerlv the EjkctrrmK Svyirm* 
l^ix>rator\i fiewn o! 

ALPHA n I H. Burimgum. MA. wheie he is ChKf Sc'ieniifk 
Consullam and ( haimvan of ilw Hoaid of Dueshws, and has 
also consulted for oihtfr mdusuial oiganiutiom aiHl 
govcrnmciu panels 

Di .Mhans is author of Optimal ( (MiTitaw Hill. 
I%6). 5vvfem.i. \errtorKi and ( imyrutamm < tmifpix 

(Mc<ifaia Mill. 1972), iiod yvtrem.t. Verworl*. and 
( omi>uiaticn MuJtn^rwhie Methtnlx (MHiraw Hill, 1974) 
In 1974 he developed 65 TA lectuto and accompanying 
viudy guides on AEn/ern t onrro/ /hron He lias authored or 
authored over 25(t lechiikal pa(>rrs and icfxirts His 
research inieicsts span the areas of svsinn, control, and 
esiimalion theory and ilv a|ipluaii(>ns to the fields of deleiKe. 
acfosiiacc. iiansfHiriaiion. jH>wei, manutaciurin|. econoniK 
and iomme^nd. ci riirol and com mu meal ions (( *) systems 

lie has received many awards including the American 
Auiotnalu C onlri>l ( ourvcil s I9f4 Donald P I ckman awatd 
(or omstanding coniMbutioiis ii> the held of aulotnattc 
conirol: the IW I I leiman iiaaid of the Antrrnan 
S<Hiciv for I nginceimg L duialion as the outstamhng yming 
ekcitical engiiKcting educaioi. arul the PiHIt Idiicaium 
Award of the AA( C loi hts oulstaading coninbutioiu and 
distinguished leadership in aulomalH amiiol eduiaiion In 
1971 he wa.v elected f ellow of ihe 11.f I and in 1977 I ellow' 
of the American As.wxiation for the Advaiuement of 
Scierue He has served on numerous lommiilees of If A(\ 
AA( ( and II I I , hr was president of the lEM ( onirof 
Sysivins ViKiely from 197.? to 1974 In addition hr is a 
mcmiKT ol Ph) hela kappa. I ta Kappa Nu and Sigma Xi 
lie: wav aWMiiitc editor of the 11 1/ Iramuiiltois ttn 
Automata ( ontrol. c*» e<htor of ihe /tturnal of Ovnumu 
Economtr\ and ( onrod and as.sociate ediloi ol Auf<trtuitu a 


IBailtri P. BcftxHsna was Imm m 

Athens (oeece. in 1942 He 
rrinvcd a combined B S L E 
and B S M I: from the Nalnmal 
ti'chnnal tlniversiiy o( Athens, 
in I*^'5. the MSI L degree 
from (reoigt Washington Um 
vcTMiv m I9f»*)l and Ihe Ph D 
degrte in syslem science from Ihe 
Massachusciis tnsituie of Tech 
nologv in 1971 

ProfevMir Hertsekas has held 
faculty positions with the I ngmeering l:conoinic Systems 

Dept Stanford I nivcrsity (1971 1974) and the Electrica) 
Engineering IXcpt of the University of fllimns, llrfiMna 
11974 1979) he IS currently ProfcsAoi cvf Electrical 
I'ngi nee ring ami (ompuicr Siicncc ai the Massiichuiietis 
fnstjtule of TechrK>h»gy Hr tonsulls regularly with private 
industry and has held editorial fKnriiorn m M'vertil pWirnaU 
He w'as elected lellow of the II.EI, in 1981 
Professor Bcrlsekas has done research in the: aictis of 
estimation and conirrd of stochastic; nysicms. linear, 

mmlineaf and dynamic (Hogrammmg. data cfrmmunicatnm 
networks, and parallel and divtrtbuicd cj imputation, and has 
written numerous papers m each ol these areas 

He IS the author of l^^namu Programming and Stof hmtH 
C ontrol. (Acadcmif Press. New York. 1976). (onifriime 
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Optimixaium ami iMffranf^e Multtpher Methods, (Academic 
Pre^^v P>^2)i [>ynamu Hrof(rammtn^: Oeirrmmisiu and 
,SuHhastit Model) (PrcnticcHall, Knglcw(KKi Cliffs, NJ, 
1987), and c(» aulhr»r of Mochastic Optimal Control The 
Ihurete - lime luse (Acadcrmic Press, 197H), Data Networks 
(FrcrUiccllall, 1987), and Parallel and Putrthuted 
( omputatifm: Numerical Methods fPrcniicc-l lall, 19K9) 


of ordinary differential cquaiions and their applications It) 
amirol, circuit theory , and mechanics 

Dr Campbell is a member of the Society for Industrial and 
Applied Mathematic'S and its (bnirol and Linear Algebra 
Activity Groutes 


Chri«la|»hcr I. Byrnen was ht^rn in 
New York, on 28 June 1949 He 
received the B S degree from 
Manhailan ( ollege, Bronx, NY, 
in 1971 anil the M S and Ph I) 
degrees from the University of 
Massachuseiis, Amherst, in 197.1 
and 1975, respectively 

He served as an instruettir in 
the Deparlmcnl of Mathematics 
at the University of Utah. Salt 
Lake Ciiy, from 197S lo 1978, 
when he was rippomled Assislanl Professor in the 
Dcpartmcnl of Mathematies and m the Division of Applied 
St.iem.es at Harvard University, ( amhridgc, MA f rom 1982 
to 1985 he was Associate Professor of Applied Mathematics 
on the (iordon McKay I ndowment at Harvard University. 
In I9K4, he joined An/ona .State University Iem|K'. as a 
He,search Prolessor of 1‘iigmeering arul Mathematics. He is 
currenlly ( hairman ami Professor m the Department of 
Systems Seicnee and Mathematics at Washington University, 
Si Ltuns, MO, and Adjunct Professor of Mathemalieai 
System Theory at the Koyal Inslituie of Technology (K TH), 
SltK:kht>lm. Sweden. Dr Byrnes has also held visiting 
positions ill Bremen. Cironingen Harvard. NASA, Kansas, 
KTH. Osakii. Pans Dauphine. Rome La Sapien/a, Stan* 
ford and Tokyo I Iniversities Talitor of eleven research 
volumes and iiuihoi of over l(K) teehmeiil articles, his 
research inieresis melmie iidaptive control, algebraic system 
theory, distnbuled (laiamelci systems. Iinciir multivariiiblc 
control, nonlinear eonirol. ami the applications of nonlinear 
dynamics in eonirol and estimation A member of AAAS, 
AMS. H I T ami SIAM. Di Byrnes was named a Case 
( enlennial Scholar by ( ase Western Keserve University m 
198(1, a Lellow ol the .lapan Society foi the Promotion of 
Seieiiee m 198b and the Ciraduale School Distinguished 
Research Prolessnr at An/omi Stale University in I9KH. In 
1989 he was elected I ellow of the I LI I 
Dr Bvines has servetl as an Associate Ldilor ol .st* 
journals and is eurreiilly lulitoi ol the iwti new book senes. 
\vvrrm.\ and ( foitrol /oufuinnoro and Appltcalums and 
PrngrrV) in Systems ami ( onirol published by Birkhauser. 
Bostim, MA 


Ye-Hwi Clica was born m 
Taiwan He received his BS 
degree m chemical engineering 
from the National Taiwan Uni¬ 
versity in 1979, and the M S and 
Ph D degrees m mechanical 
engineering from ihc Univcnuty 
of California, Berkeley, in I9K3 
and 1985 

Trom 1986 lo 1988 he served as 
a faculty member in the Depart 
meni of Mechanical and Aero 
space linginccring ol Syraeu.se Umversiiv He then became a 
faculty member of the School ol Mechanical I'ngirveering of 
Cicorgia Institute of Technology His research has been on 
advanced control melhiHls for manufiiclunng systems, 
adaptive robust control of unceriain sysicins. large-scale 
sy.sicms ami discrete events Dr C hen has estahlisheil and 
served us the chairman lor the ( ornplex Systems Tcehmeal 
Panel of ASMF since 1987 He is a member ol Sigma \i 


Kminuiiiel (>. Uolim.s, Jr was 

horn in Monrovia. Liberia, m 
|9S9 He leceived the Inlerdis 
ciplinarv B S degree from More¬ 
house Lollege, Atlanta. (iA. m 
1981, the B M f degree in 
meehiinieal engineering from the 
(icorgiii Insliinie of lechnologv, 
Atlanla. in 19K1. the M S degree 
in mechanical engineering from 
Purdue Umversiiv, Wesl l.afaN 
clie. IN. in 1982. and the Ph D 
degree from the School of Aeronautics, Purdue University, 
West Lafayette, IN, in 1987 

In June 1987 he joined ihe Struclural ( onirol (iroup at the 
(iovcrnmenl Aerospace Systems Division. Hams ( nrpor.i- 
uon. Melbourne, FT. Hi.s eurreni research uneresis include 
robust analysis and control and the use ol homolopic 
conlinualion meiho<Vs for retlueed-order control law synthesis 
with an emphasis on application to Targe llexihle space 
structures 
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Stephen 1.. ('ampbell received the 
FI A degree in mathematics from 
Dartmouth College, Flanovcr, 
New Flampshire, U S A in 1967. 
and the M.S and Ph D degrees 
in mathemuiics from Northwes¬ 
tern Universilv, Lvanstun. IF.. 
U S A. in 1968’and 1972, respcc- 
tivelv In 1972 he joined the 
ITepailmcnl of Mathematioi. 
North Carolina State University, 
Raleigh, Nt\ USA as an 
A.VMStanl FVofcsMir. bcaiming an AsstKiaie Professor in 
1976, and a Professor in 1981 His current research focuses 
on the numerical and aniilyhcal solution of implicit systems 


IVIohimiiied Dshlcb wijs born in 
I Jordan in 19(S1 He received the 

3 H S degree in electrical en 

“ ginecring from Texas A & M 

‘ University in 1983. and the M.A 

and PhD degrees from Prin- 
J ccion University, in I9H6 and 

1987 rcspcciivelv 
Since 1987 he has fvecn with 
ITcparlmcni ol Filccincal Engi¬ 
neering at Texas A & M Univers 
ily His general area of interest is 
system and control theory, his current areas ol interest 
include robust control, adaptive control and disinbuicd 
parameter systems 
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DAM w». horn m 
iw>- He received Ihe B S 
«grcc in elcctrKal engmeenne 
from Texas A it M Univenaty in 
m3, and his PhD degree in 
electrical cnginecnng (rtwn R*cc 
Univcrsiiy. ,n iqk? Me ik an 
lently iin Aismani ProfcT^Mw of 
hicctrica! I:nginctrin|! ai ihf 
Masiwichujictu Imtituic of Tech- 
nokigy He has held am^ulting 
pt>siiions wnh NASA and ( S 
Draper Lafxiraiory wnce 19HM Hin cufreni intcrcM^ include 
iobii%\ control, idcniihcaiion of unccnain svMcim ami 
adaptation, control of umc-varying and inlimie dimcnviiinaJ 

jiyslcin% 

Dr Dahich received the George Axclhy OutMamhng Panel 
Award with J. B. Pearson m 




CMS include 
i(.knliticalion 


HiMeyiu l>rnilrrio|(fai wun horn in 
Ankara, I urkey in 1%1 He 
received his H Sc degree in 
dccironic engineering tiorn 
^ HaeeUc|K' UnivcrMiy. Ankara in 

Frtim lo IMHJS, he 

worked h reM,'iirch and design 
engineer for ASP I SAN (Military 
filectronic Industry). Ankara He 
has rccenilv ohrained his Ph f) 
degree (roni (ila.sgi.)w I'niversity. 
I K His eiirrcnl research inter 
adaptive and self tuning control, svsiem 
optimal and predictive control 



Jran'IVIkiirl l>lon was horn in l..a 
lr<jiKhc. France, in He 

grailualed in rnathematu's in 
pnj! He receivetl the "Ihesc de 
k‘me Lvelc and ‘ These d I'laf 
degrees both from the Inslilut 
.National Polvlechnu|uc de (»ren 
obic in and 1‘JH^ lespei 

tively Since PH'T lu- has l>cen a 
researcher at the ( cnire National 
de la Recherche Scicnlifique 
where he is presenilv Direcicui 

... Vice Head ol the Tabtifiiioire 

d AulomatH|ue de Grenoble He is author or co author ol 
over HO )oiirnal or conference papers His current re.search 
inlcresis arc in linear sysiems and atlaplivc control 


de Rccherchc and 


Lbc Dafiird was born M»me years 
ago in Viiry le F ranyiirs, not far 
from the (ainrius Champagne 
vineyards, France He received 
the l:nginecr degree in TJeetron- 
ICS m 1^7.^ from the Inslilut 
National Polyiechniquc dc (iren- 
oblc F^c got his TlieM: dc 
Doctcur-lng(Jnicur' degree in 
19B() and his Ihtsc de Dtictcur 
d'Etat Sciences’ degree in 
19H4. both from the Instiiut 
Naironal Polytechnique dc Grenoble 
Since 1977. he has been with the Uboraloirc 
d'Aufomalique dc Circnoblc. E.N.S I 1: G . where he holds 
a researcher posilion at the C' N R S (the French Naiiiwial 
Center for Scicnlitk Research) Fiis mam scieniifK interests 
in the held of adaptive control theoretical and 
methodological aspects, and applications to robotics and 



ihcrmai processes He *l«o otlhrt atid some 

etperiMie, atmuii oihen. *n Kpossnei'iiuns 


fririhiMiitf receisttil 
Fi V ami iW M Ss ikfiee* 
K5 ekctTiial cngiiw^enng loun th«^ 
lechnton Israel Inslituic ol 
lechtmdogy m ;iih1 

resjVrvMviiy and (he Ph D dc 
gw in ekvtrytAl «nginceriiig imd 
(h<* M Si flegtct* in siatHtn s from 
Stinford I nivermis m f97^ 
l ifKni IWiK lo *97.' he Mrrvrd m 
the Israel Delciot I v.rirs ais an 
clciiomK engineer Frotn Wh to 
19h7 hi' WMs III Systems ( omn») Icthmdogv. Pah* AUo. «s 
Manager ol the AdsiifKcd Technohigx diviMiHi wheir 
was feispoiisible tot rcM^arch and deselopineni ptfOects in 
signal pnHcssmg and cimirol [)utirig this |kihh.I he Wiiis also 
<i leciurci <jii SiAfiford rniveistiv 

I rom NmcmfHi I9H^ lo ,lulv 19KH tie wio >s»th Saxpv 
Compute r (v>r|>f*raiii>n Suniivv.de the Dnecioi i»( 

AdvaiKcd I echrndi *gv lesjstnstbli loi (he resi aich ami 
devciopincni iuiivOus id ihr oompanv ( urtentlv hr iv with 
Signal Pimessing Irihravlogv in Paht Sliu 

Dr Friedlujuii t has over Mb publu aiions in signal 
processing and esiimaiii*n Me was an asimKi.iu cdifoi of the 
Ih.tJ 7nmun fumy on AuUtmant ( fMir»id m 19M, a memiH'i 
of the Ailmiinsitalive C iimmillee «d f)u Ah*uvIhs, SfHeeh, 
and Signal PtfHesMng lASSPj vKieiy .i nu rnb* ' of the 
lechniial ( binirnrue on SjHiinim Tstirnaiion ol ifu ASSP, 
and IS the Vici ( hainiuiri ol tin Imv aiea (hii{>fer of the 
Signal Proscssing stxieiv Di I ru illaiidei was ifie lecipieni ol 
the I9K^ ASSP Seniol A want, ihe l^SN Award leu Ihi Bcm 
P aper ol the Vt-.it Imm the I uttipean Assonaiion loi Signal 
I'fiKcssing (I I KAMI’) and llu li-ihoKal Athicveiticnt 
Award ol the Signal Poxessing Sixieh H< is a lell«»w n| lire 
MM and a nuinlH i of Signia \i 

It's turrcni inicusis imluck ailvaneed inhinqucs liu 
arruv priKissing and qHHiral analysis adaptive filuimg. 
sonai. ladar and lomrniirtn aiion piiKcssjng. deit elton 
tracking and Iih. itli/a(ii*n ol muliiple largcis irimgc 
poHCssirig, and parallel ponesMng ai«. hiln luirs jf*r higli 
spt'ctl signal piou ssing 


Prlrr J. t[»«w||irttfi was l>iirn m 
Srast.alc, ( umlnrlamT I FC in 
III obtained his MA ami 
1> Pini ilegrrev troin ihe I drivers 
iiv id Usliutl m )97:t and 1977 
o:s|Ktiivelv He ihrn spent w»m« 
vear> as a Post Din ioral KcM‘arvh 
AssrMarii with ihe Drpailmcni of 
I ngineenrig Vicmi at Ihe I'm 
vcrsiiv >d Oxfonf, (his was 
folJowt'il f*v a fvernKl as W W 
SfKKMH r Research fellow at New 
C ollege Oxford In I9H1. he imrvrd to the t nivriMly of 
Sutisex as a lactuTcr. and biiei Hemlcr, in ( r>nir<*l 
F.nginecring In 19^7. Prolessor Ciawihrop look uf* the Wyhr 
chair of Mechanical I ngineeiing at (ilasgow I 'niversiiy 
where he conlinurs Ui teach and rrM^arth in the aura of 
(.ontro) Systems dehrred m ils broadesi sc^niM: 

Ffis main research iniercvH hr in (he theory and 
application of scH tuning CAonlud. system idenfifkation and 
syrsicm mfKkIling The mam application areas of »his 
research arc prmoss cngmrering, robotics chips, miinufae 
luring vysiems and cconomu systems 

F^c IS the auifvor (*f « two volume boiok entiUed < ommu/iro 
7tmr .Sfl/ Tufiinfi ( ofi/m/ IKcseimh Studies Press) He ts an 
AssfKiatc F:diiof of Automanett arsd is on itye f Milonal Hoard 
of a number of other control systems piurnah 
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(}pttmfiatufn and iMfiranxt' MuUipher Mefhtds, (Academic 
Press, I9>i2); Dynamic Pro^rammtnf( [}eirrmmiUu and 
St(H'ha\U( Mftdf^Ls (Prcnhcc ilall. I nglcwiKHj NJ, 

P/K7), and co aulh<»r id Siochaxtir Optimal C ontrol: The 
Dmretf-ltrnc vasf (Academic Prevs, l‘/7K), lUua Networks 
(PrcmicC'Mall. 1^87), and Parallel and Dturibuird 
( ompuiaiion Numencal Methods (PrcriliccHall, PWi) 


of ordinary difTercntial cqualiuns and ihcir applications to 
control, circuit theory, and mechanics. 

Dr C'ampbcll is a member of the Society for Industrial and 
Applied Mathematics and us Control and Linear Algebra 
Activity Cirou^rs 



I /MUMAJi r Chriiiloplicr I. Byraeii was born in 

^ Vork, on 2K June 1949. tic 
received the H.S degree from 
Miinhailaii ( (illege. Hronx, NY. 
in 1971 and the M S and Ph D 
degrees from the University of 
Miissachiisctls. Amherst, in 1973 
and 197S. resfii'ctively 

lie served us an Instructor in 
the Department ol Mathematics 
at the University of Utah, Salt 
Lake Cily, from 197S to I97K. 
when he was ap^xnnied Assistant ProfesMO m the 
Department of Mathernulics and in the Division of Applied 
Sciences at Harvard University, ( amhndge, MA Lrnni 19H2 
to 1985 he was Associate l*rolesMir of Applied Mathematics 
on the Uordori McKay f julowrncnl at Harvard University 
In 1984. he joined Arizona Stale University. Ternpe, as a 
Hescarch Professor of I'ngineenng and Mathematics He is 
cuiTeiitly Chairman and Prnlessor in the Department of 
Systems Science and Mathematics at Washington University. 
St Louis, MO, and Ailjuncl Professor o( Mathematical 
System Lheory al the Koval InMiiiite of Icchnology (KTH), 
StiK'khoIrn, Sweden Dr Byrnes has also held visiting 
positions at Bremen, (ironingeti Harvard, IIASA, Kansas, 
KTH, Osaka, PansDauphinc, Rome La Sapien/a, Stan 
foni and Lokyo Universities lUliloi ol eleven research 
volumes ami author of over HXI technical articles, his 
research interests incliule adaptive control, algebraic system 
theory, disirihiiicd parameter systems, linear multivariable 
control, iionliiieiir control, and the applications o( nonlinear 
dynumics in conirol and esiimation A member of A A AS. 
AMS. If'LI and SIAM. Dr Bvrnes was nanuni a Case 
('eriteniiial Scholar by ( use Western Reserve University m 
198t), a f elhiw ol the Japan Socieiy (or the l*romolion of 
Seierue in l9Hb and the (iradiiaie School 17istmguished 
Research ISolcssor at Arizona State University m |9K8 In 
1989 he was elected Lellow of the II l^f 
Di Byrnes has served as an Associate Ldiltu of six 
journals and is currently Ldiloi of the two new luiok senes, 
.Vv.rferru and ((ntlroi houndatiofis an<i Appluatiom and 
Progress m Systems and (Onfrtd published by Birkhauser, 
Boston. MA 



Ye-Hwi Chen was born in 
I aiwan He received his B.S 
degree in chemical engineering 
from the National laiwan Uni¬ 
versity in 1979, and the M S and 
Ph D degrees in mechanical 
^' engineering from the University 

” 1 of California. Berkeley, m 198.3 

and I98.S 

From 198/^ to 1988 he sersed us 
a facult> member in the Depart 
meni of Mechanical and Acri»- 
space Lngmecnng of Syracuse University He then became a 
faculty member of the Schinil of Mechanical Lngineering of 
Ciccirgia Institute of Icchnology His research has been on 
advanced conirol methods for manufaciiiring svsicms. 
adaptive robust control ol uncertain systems, large-svalc 
syslcm.s and discrete events Dr ( hen has established and 
served a.s the chairman li>r the ( omplex Syslems lechnical 
Panel of ASML since 1987 He is a member ol Sigma Xi 


(^mnianuel (L I'nllins, Jr was 

born in Mi>nrovia, Liberia, in 
1959 He received the Inicrdis 
ciplmarv B S ilcgree from More 
house ( fillcge, Atlanta, (iA. in 
1981, the B M I' degree in 
mechanical engineering from the 
(ieoigia Insiiiuie of Icchnologv, 
Atlanta, m 1981. ihc M S degree 
in mcchaniCLd engineering from 
Purdue Univcisilv, West l.afay 
cite. IN. Ill 1982, and Ihc Ph I) 
degree from the Sehruil of Aeronautics, Purdue Universiiv. 
West l,afaveiic, IN, in 1987 

In June 1987 he joined the Structural C'ontrol ( rroup al (he 
(fovcrnmcrit Aerospace Systems Division. Hams t orix)ra 
lion. Melbourne. L'L His current research interests include 
robust analysis and control and the use id homoiopic 
continuation methods for reducetl-<irdei control law synihesis 
with an emphasis on application to large flexible space 
slruclurcs 




Stephen L. CnmplicU rceeived the 
H A degree in mathematics from 
Dartmouth College, Hanover, 
New Hampshire, U S A in 1967, 
and the M S and Ph D. degrees 
in mathematics from Northwes¬ 
tern University. Lvansion, IL. 
USA. in 1968 and 1972, respec¬ 
tively In 1972 he joined the 
Department of Mathematics, 
North Carolina State University. 
Raleigh, NC, ILS.A as an 
Assistant Professor, becoming an AsscKialc Professor in 
1976, and a Professor in I98L. His current rc.scarch fcx'Usses 
on Ihc numerical and analyticid solution of implicit .systems 
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Mohammed Dahleh was born m 
Jordan m I^>61 H e received the 
B.S. degree in clcclrical en 
gincermg from Lexus A & M 
University in 1983. and the M A 
and Ph D degrees from Pnn 
ccion I'nivcrMiy. m 1986 and 
1987 rcspcelivcly 
Since 1987 he has been with 
Department of Llectncal Engi¬ 
neering al I cxas A & M Univers¬ 
ity. His general area of interest is 
and amtrol theory; his current areas of interest 
robust conirol, adaptive conirol and disinhulcc 


parameter systems 
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4 He rtceivnl rtie BS 

degree in tlmricjil cnginccnrtB 

It!!*? A & M Umvcf\ttv in 
m3^ and his Ph D degree m 
ciccinca! engineering (rtwn Riee 
tJmvcrwty, m 1^*87 He is cur 
rcnily an Assisiani Prolrsiu^r t»f 
Electhoi) Engineering ai the 
Massiichusens Imtituic nf Tech 
He has held consulting 
po&iiiuns with NASA and ( S 
Draper Laboratory since \m. His current mieresls include 
robust cxjntnd. identification of una-riain syMems and 
adaptation, control of limc varying and infinirc-dimensional 
systems 

Dr Dahleh received the George Axelby Outstanding Paper 
Award with J B Pearson in IMKV 


HiMryia Demlrdogia was born in 



Ankara, Turkey in l%i He 
received his B Sc degree in 
electronic engineeiing Ironi 
Haceitctx- UniverMiy, Ankara in 
1%3 From to IMKS, he 

worked as a research and design 
engineer for ASIiI,SAN (Military 
Llccironic Industry). Ankara He 
has recently obtained his FMi I) 


degree from Cilasgow Universitv, 
His current research inter 
ests include adaptive and scll-tuning contn'I. system 
idcnlilicaiion. optimal and predictive conirtil 



Jean-Mklicl Diem was iHirn in l a 
Ironche, France, in He 

gradualcd in maihcrnain's in 
1^172 He receiveii the Ihese dc 
3eme cycle' mid “ I hese d'F lal ' 
degrees Kith from the Insiiiui 
National I’olytcchnnpic eJe (iren 
ohk: m 1^77 utul l‘^K3 resjxc 
lively Since he has Ixen a 

researchor at ihc ( cnire National 
dc la Recherche Scienlifique 
where he is prcsenlly Diiccitur 
Vice Head ol the I aboii.toire 
d’Auiomalique de Grenoble Me is author or co-author i»f 
over Hf) journal or conference pa|K.*rs His current research 
interests are in linear systems and adaptive control 


dc Recherche and 


Luc Dugard was fnirn vime years 
ago in ViiryTc-hranvois, rioi far 
from the famous Champagne 
vineyard.s, France He received 
the Engineer degree in F^lecTron* 
ICS in 197*i from Ihc Inshtui 
National Polytcchnique dc (iren* 
obic He got his Th^se dc 
Docteurlng^nieur" degree in 
|98f) and his ‘ TTitsc dc Docteur 
d'Eiai Us Sciences ' degree in 
19H4. both from the Inslitut 
National Polytechnique de Grenoble. 

Since 1977, he has been with the l.aboraloirc 
d Auiomatique dc Grenoble. E N S EE (» , where he holds 
H researcher position al the C.N R S (the French National 
Center for Scicniifk Research). His mam scientific inicrcikls 
in the field of adaptive control theoretical and 
methiKlologicaJ aspects, and applications to robotics and 



tticmaJ Hr udm hiiu inieits#is Mid 

expertise. aifHitig others »n 


ttseived 

iiK B V ami Ihc M.Si" ikgrces 
m flectosul rngimreitng from the 
IrchiiKm Kiml Insutule of 
Ieehm4ogy m mfs-H jiikI 
trs 4 sccuvclv mid iKc l*h sk 

gte-e in ciesirical eitgmeenng iiiH.1 
the M Ss degiec m suhs||V^ town 
St4 dofsl I. riiverMiv m 197e 

F loin Ivtbh to )9T2 bt st ried in 
the Iviiirl IktrnM t ones as 
clci iiom*. rngtnen ftoin I97n to 
!9 h> he was at .Systemv t ontiol Icchriologv. PaKi Aluy as 
Manage! o( die \d>4UKcd levhnologv iliviMon whirr H< 
was rrs|>>nvibk foi rrmniich amt tkveiopmcni [ uqt-cn in 
Mgiul prmevMiig iuul lonirol Dining Ihih p*on*i1 hr also 
a kciuicr ai Siiinlord I juvirMlv 
Irorii NovcrtiNi l‘tN> to lulv I9HK lu WiO wnh *v4xpv 
( ompuler ( oi|H»iaiion. Suiinvv.tk . ihr Duct lor ol 
Advanced Icchnologv rrs(>i>nsibk loi ihc icvraich and 
devriopmcni iii tiviiu v ol ihr umipanv ( uricntly t»«' is wiih 
Nignai Pioressing lcihno|u|»v in I'.ilo VIio 

f)r FrieiUamkr luiv ovci 240 puldualiiHis ni signal 
priHcssing and cviimalion Me an iismk rale ciktiU of the 
11 ti TrtifL\iHium\ (tn Amtfmn/h < in O'rM a ruemlHi 

of (he Adinimsiiaiivc t ommiiiec ol ib< Aiousius Sjvetih, 
and Signal I'roiessing (ASSP) mhicIv, a mcmlMi ( the 
Icihrucal ( ornmitU'c on SfHaOiirn I vlimaiion o! ihr ASSP 
and IV the Vilc ( haiiman of ilu bav area ihajiici ol ihr 
Signal PriHcvsmg v<K.iriv Di 1 ni dlander was the irnpicnl ol 
Ihc 19H^ ASSP ScnuM Aw aril, llir Award for ibc Hcsi 

l^l|)>er of Ihc >eai (loin ihc I uri>pcan .AssoH.iaiu»n ku Signal 
FViKesMiig (f LRASiri and (hi Irilniit itl Achievcincnl 
Awiifd of (he Signal PiiHrsving Sosirtv Hr is .i Icllow ol (he 
IF I F and a mcmlH i ol Sigma \i 

Ht iiirrcni in(crevlv iru knk ailvamcd tci hniques lor 
arriiv priKcssing and sfKilisil amilvMv adaptive (dn ring, 
sonai, radar and < ornmunn aiioii poHCssinj! ilcirDion 
(racking and Iih ali/alion ol imiiiipli laigi ts imagi 
processing and purallcl processing an hiicijurr s lot high 
sjH'cd signal processing 


Prier J. f»awlhrop wav lN>in in 
Scas( ah f umlscrland. t K in 
19* 2 lit oluaim d his MA and 
I) Phil degnt* (join ihc I invcrs 
ilv ol !>slord in I97t and 1977 
rcvjKctivriv He then sjncni some 
years as ,t I'ovi Doiioial Fie sc an h 
AsvisianI wiih ihc Depattmeni of 
I nginccnng Scnnic at the Dm 
verMly of Otlord, this wav 
(olh»wcd bv a period as W W 
Sfxiorirr Ri scart h F cilow at New 
C ollege. Oxford In 19H1. he moved to the Lnivtrsdv of 
Siivscx av a leciursM, and later Rcadei. in ( onlrol 
Engineering Iri I9K7. Professor fiawihroji look up (he Wylie 
chair of Mechanic al F ngineenng u( (»Usgow I nivcrsilv 
where he continues to (each and research in iFie area of 
Omfrol Systems defined m ib broadest nnsc 
His mam rcscarc-h inreresis lie in iFie theory and 
application of self tuning control, system Kknliftcation and 
system modelling Ific main application areas of this 
research arc priKcsv enginccnrig. rol>otics, sh»f»s, rnanutiM. 
turing systems, and economic vysierm 

IFc is the autFvir ol a two volume Isorik enlided i o/i/iwmomi 
Sflf Tufim/f ( rmvro/ (Research Studies F*irss) FFe is an 
Associate F;,diir»r cd Auift^mafua and is on lht‘ F ditonal Fkmrd 
of a number of oiher tonirol systems pHirriids 
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Foiiad (j^ rcccivtui hin degrte in 
ckcirictil engineering m 1%2. the 
OiKlorai d'Etut m AutamiKiC 
(Vmtrol in IMHH from the 

F'xolc MohHmmiidia d'lng^nicurii 
in Hiibal, Mortxxo), and the 
Ufx'torat in Automatic CVinlrol 
and Signal ProcesHing in 1988 
from the ln?4tilui National Poly- 
tcchniquc in (ircnoblc (France). 
From I9K2 to I9H6, be was an 
aiiMHtant Professor in the Ecolc 
Mohammadia d'Ingdnieurs From 19Kb to 1988 he was a 
researcher in the L^aboratoirc d'Aulomatique dc (irenobic 
Since 19H8 he has l>ccn a Ixcturcr of Automatic (Vmtrol at 
the Fkolc Mohammadia d'lngtinieurs flis research inicrcsts 
arc in adaptive and robust control 




DavM C. received the 

B.S., M S and Sc.D. degreos in 
aeronautioi from the Mas- 
sachuNctts Institute of TechnoF 
ogy, (.'ambridge. MA. in 1%9, 
1971 and 1973, respectively. After 
serving as a vibration spcaalisi m 
a Camhndge-based acoustics urn- 
suiting firm, in 1974 he joined the 
staff at Lincoln Laboratory, Mas¬ 
sachusetts Institute of Technol¬ 
ogy His work there included 


reentry vehicle dynamics, muhihody spacecraft dynamics 
simulation and spacecraft attitude control. In 19H3 he joined 
the Government Aerospace Systems Division, Harris 


Corporation, Melbourne, FT., where he presently leads the 


Structural Control Group His current research intercKi.s 


include robustness analysis for crmtroFsysicm design with 
application lo vibration suppression in large flexible space 


structures. 


Ketih Glover was from in Brom¬ 
ley. Kent, U K in 194b He 
received the B Sc.(Lng) degree 
(rom Impt'nal College, larndon, 
in IWi7. and the S M , li.l: and 
PhD degrees from the Mas¬ 
sachusetts Institute of Icchnol- 
ogy, Cambridge, MA, in 1971. 
1971 and 1973. respectively, all in 
electrical engineering 

From 19fi7 to |9b^i he was a 
dcvclopmcnl engineer with the 
Marconi Company From 1973 to 197b he was on the laeuity 
of the University of S<nithern California. Los Angeles Since 
197b he has been with the Department of Lngmccnng. 
University of (ambrulgc, UK, where his presenl position is 
Profes.sor of Fnginecring He was a Kennedy Fellow at MU 
from I9b9 1971 and a Visiting Fellow at the Australian 
National University, Canberra, in I9H3 I9H4 

His current research iniercsis include linear sysiem.s, 
model approximation, robust conirrd and ideiuilicatioii 



Aha| iflar wa.s horn in Istanbul, 
Turkey on 2K June 1964) He 
received his B.S. degree in 
electrical engineering from 
Boga/igi Univcrsilcsi. Istanhul, 
Turkey, in 1982 and M S. and 
Ph D degrees in electrical en¬ 
gineering from The Ohio State 
University. Columbus, Ohio, 
U S A . in 1984 and 19KK re.spcc 
lively He held teaching assistant- 
ship positions at Boj^a/iyi 
ijnivcrsitesi from 1980 to 1982 and graduate leaching and 
research a,ssociatcship positions at the Ohio Slate University 
from 1983 to I9HH. He has been a research as.MKiate with the 
Department of Edcctrical Fnginecring at University of 
foronlo. Canada since September 19KH His research 
interests include large scale systems, deccntrali/ed control, 
robu.st control, optimi/alion and optimal control. 




Keqiii Gn was born in L.anxi, 
/hciiang, C hina, in 1937 He 
received his H S. degree m 1982 
and M.S. degree in 198.3, both in 
mechanical engineering from 
Zhejiang University, ('hina. He 
received his Ph.D. degree in 
mechanical engineering from the 
(ieorgia Institute of Icchnologv. 
Atlanta, USA, in 1988 
From May to August 1983, he 
served as a member of the 
Faculty of Mechanical Engineering. Zhejiang University. 
From September 1983 to I>ecembcr 1988, he worked as a 
Research ASsSisUiU at the Cicorgia Institute of Technology. 
From January 1989 to August 1^1 he worked as a Research 
A.vwKiatc in the (enter of Robotics and Advanced 
Automation. SchcHil of Engineering and C omputer Science. 
Oakland University. Michigan. U S A He is currently an 
Assistant Pnifcssor in the Department of Mechanical 
Engineering. Southern Illinois University at Edwardsville, 11. 
U S A. His rescari'h interests are rolHitii's, adaptive and 
robust control, nonlinear systems theory and chaotic 
behaviors 


Alberto IxMoii was b<irn in 
Rupallo, Italy, in 1942 He 
graduated in clcclncal engineer¬ 
ing from the University of Rome 
in I9b3 Since 1973, he has l>ecn 
Professor of Automatic C ontrol 
at this University He has held 
visiting positions al the University 
of Florida. Gainesville (1974). 
Washington Universiiv. St L.ouis 
(1980, 1983). the University of 
California, Davis (1983). Arizona 
Stale University (l9Hb, 19K9), the University of Illinois 
(1987) and the University of California. Berkeley (1988) 
Since 1989 he is also affiliated with Washington University. 
St l.ouis Professor Isidori received in 1981, with coauthors, 
the IEEE Control Systems Society’s Guisianding Paper 
Award, He h the author of the biKik Nonlinear Control 
Sysierfu (1983, 1989) Professor Isidori is an A.ssixiale Editor 
of Auiomatica, Maihemasics of Control Signals and ,Vv.rrcm.v 
and Applied SitKhastu Modrb and Data Analysis, and 
AsMKiatC Editor al large of the I EEC Transactions on 
Auiomatic C(?ntrol He is Vice Chairman of IFAC's 
Technical Committee on Mathematics of Control and in 1989 
he was the IPC Chairman of the first IFAC Symposium on 
Nonlinear Control Sy.stcms Design. His research intcrc.sts 
include .systems and control theory, with emphasis on 
nonlinear feedback systems, geometric control theory and 
stabilization. 
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u , bcprn m 

HamtHirf, Gcmiiny, \m 22 Dec 
ember ISMM) He leotivcd ific 
dcRiee m ekrctiical 
engincenng md ihe Dr Ing (k 
gm in guidaiKc ami ainirikl (nnii 
ibc Technical lJnivcr%i(y of fki- 
lin, F R G . m l%7 amf 1971 
rc«pectivcly In 1980. he habOi 
laicd as pnvtti dojceni (Dr HaNI f 
for teaching in ihe field of 
man-machine KvsicmK of aenv 
naulics and aKtronaulics at the lechnical Univerwiy. Aachen, 
F R G. From 1%7 to 1971, he was a research asaiKiani at the 
Imfiluie of Aircraft Guidance, Technical University of 
Berlin From 1971 to 1982, he was head of the Human 
Operator BraiKh, Research Inslituie for Human Enamcennfl 
(FGAN/FAT). Wachtbcrg-Wcrthhuvcn. F R.G., as well as 
Icdurer of manual vehicle control. Technical Univcrsiiv. 
Aachen, from 1974 to 19K2 Dunng 1977-1^78. fur was a 
viiiting faculty member in the Dcpartmcni of Mechanical 
and Industnal Engineering and the CiKirdinaicd Science 
Uboratory. University of Illinois ai Urban a Champaign. 
USA. where he held an appiiintmcni as adjunct assoctaie 
profcsMir from 1978 to 1981 Currently, he is professor of 
Systems Engincenng and head of the l^ihoralory for 
Man-Machine Systems, Department of Mechanical Engi 
neenng, Univereity of Katcsel, Ciermany His research 
interests arc in human control and problem sidvmg in 
man-machine systems, vehicle and process coniiol, 
computer-aided systems design, graphical design, human 
machine dialogue systems, human-manipulator mteruciion, 
and knowledge-based systems Dr Johannsen is a mcmtiei ol 
several German profcs>sional siKielies (Dfil K. VT)|/VDlv 
CiMA. VDE-ITG, Gl, GfA). a senior member of the 
Inslilulc of EIccincal and Electronics Engineers Ilf-El 
SMC, C omputer, CS. Robtitics and Automation) a member 
ol the Human Factors Society, and chairman of the 
( ommitlcc on Systems Engineering ol IFAC in which he was 
chairman of the working group on man- machine systems 


Yeo<Crhfiw (Joe) Juh received 
the B.S degree in power mecha 
nical engineering from ihe Na¬ 
tional Tsing Hua Univcrsnv. 
Taiwan. ROC . in 19K(1. M S 
degree in engineering mechanics 
from the Dnivcrsiiy of Alabama, 
‘Tu.M:altK>Mi. in 19H4. and Ph 17 
degree in aerospace engineering 
from the University of Michigan 
Ann Arbor, in 1988 

From 19Wi to 1989 he worked 
fur the Automated Analysis C orporation as a senior research 
engineer He is presently a research engineer m the 
Engineering Technology Service of Ford Motor C ompans. 
Dcarbi^rn, Michigan. His research mcms arc aciivc/adaptive 
control, acoustic and vibration control Dr Juan is a member 
of the American Institute of Aeronautics and Astronautics 


Piem T. lUbanilM was born in 
Lubumbashi. Z<anc. He received 
the Diplomc ci lng^nicur Civil cn 
Math^maliquc Appliqudcs (ft>m 
the University of Uiuvain. Bel¬ 
gium, in 1977. and the Ph D 
degree in mechanical engincenng 
from Columbia University. NY. 
in 1981 

He held research and teaching 
posilKins at the University of 
Ijouvain from 1977 to 1979 and 
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fwwti IS^l tij fjiiliinibia Uiwvemty fisHn 1979 to 

1981 $moc be bAs been with ibc Dcfuiniiirm ci4 

Arrsyiipiiice Fjifimenug ibe I nivetiaiy of Micbsipkii. wbcft 
he n curiTutlv Pfofeisww H*s ifdrrmis imiittk 

dy namics reduced border ixi«nnil. nHKkf rwhiction laige 

space struct uies , gutdaiwe and imstgation 


EMMbMWf was Kun m 
IjuKlsIiut, ftermany, in PM4 Me 
tctxived tbf MS degm m 
matbcfiuiic's (torn the 1ecFifiiL4il 
I'nivcnaty of Munich, in 19711. 
and the Dr Ic'chn degree ffiun 
the lahnwal Umvrrwty of <irti 
111 SiiKc 1971 be worked m 
» research M.irntiM m the ixmrro<l 
group of the IriKtiiiiie for Flight 
Sysierro DynamHik at the German 
Aerospace Reseanh I sUbliih 
meni (DEHj ui Oberpunrnluden Hi» irMcaich mirresth air 
m robustness analyst* and (onmd sVMvms design 


Rickard O. l^Makv WAS born m 
I I PaM>, Icsiis on 19 ( Molser 
19Sh Hr reieived the H S 
degree m elevincal cngiiiccnng 
and tconomux in 19K1 from 
( iirnegie Mellon Univerwly, 
PiMsburgh. PA and the M S und 
Hi 1) ilegtecs in eletirivat ci> 
gineering (loin ihe Miissathuiieiis 
Instilule td lechnoh»gy In 1987 
ami 19K7, rcsfHxtively At Mil, 
he corulucU’d 1 cm* arch in the 
areas id adaptive and digital coniiot theory utui rsliinaiMm 
I rurn I9M7 uniil he was employed as u McmlH*! of Ihe 
Icchnical Staff iil AIIMlArVf H. Burlmgion. MA. wheic 
he worked in the arras of umimunKatums and rslimalioii In 
1989. he joiiu'd the High Bandwidth Sysiems l aUiiaiory i>f 
the IBM I J Watson Krsenrth ( cruel, Vorkiown Heights. 
NY. as a Research Staff McmfHri l)i I aMaiir s current 
inlcrcsis arc in ihc areas ol coininunaalum ar>d ii»m|>utri 
performante analysis, queue mg theory, flow cimtrol in 
crrmmunitaliori s.orms ami an hilci.lutes for high speed 
Cl »rnmuniv a 110 n svsi e m s 


IFasfcd J. N. tiirbrw was born 
in Johannesburg, V»ufh Africa, in 
I 9 S 2 He rect'ivcd Ihe B Sc 
rJegrer in clcitncal Engincerring 
Irom the Umversriv of the Wii 
wairrsfAmJ in 1974 , and the 
M S< and Ph D degrees in 1977 
and I 9 W). respectively, from the 
UnivefTuiy of Natal in South 
A 1 rK» 

He was A Research Assistant at 
tlu" I'nivcruty of Cambridge. 
U K bciwcen P/Hti and 19H1 in 1987 he moved to Ibe 
Department of Ekitrtcal Engineering. ImpeNal C ollege. 
Gmdon, as a lecturer In 1989 he was promolcd to Reader m 
C imtiol Engineering His research wiicre^ts imlude multi' 
variable systems theory, computer aided umirol sysicift 
design, pirwcf system siHlnliiy arwl the crmliol of toknmaks 
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Nm K. recctvcd hi% B.Sc 
degree in electrical engineering 
from Ihi* Naimnal laiwun Uni¬ 
versity. Taiwan, in 1%1, and the 
M,Sc and Ph D. degreen in 
cicctricisi cngincenng frnm the 
Univervily of Watcrl<K», Canada, 
in 1W4 and IWl, respectively 
Or l.oh taught a( the University 
of Iowa from to I97H. and 
joined iht* St'hiMil of Engineering 
and ( oniputcr Science at Oak¬ 
land University m I^TH, Dr Loh is the J<ihn F Dodge 
(Endowed Chair) Professor of Engineering at Oakland 
University He is Ihc Director of the C eiilcr for Rohiilics and 
Advanced Aulomation at Oakland liruversity, a center of 
research excellence in Michigan which he co-founded in 
l‘/Kl Dr Eoh has served as a department chairman and the 
Associate Dean for Ciraduaie Studies and Rescrarch, and is 
now the Associate Dean (or Research and Development in 
the School of Engineering and ( ornpuier Science, Oakland 
University- 

Dr laih has served as an engineering consultant for 
numerous national and international organi/aiions and 
corporations Ills consulting activities include industrial 
development, engineering design, high technology research 
and development, and governmeni cahincM level jxilicy and 
goal development in science and technology Di Loh is a 
member of the fxuird of directors of several professional 
organi/utions He also serves on the editorial txiaids of 
several technical journals. 

His areas of research interest include control systems, 
computer vision, robotics, digital signal processing, estima¬ 
tion theory and lime senes analysis He has authored and 
co-authored over 170 technical papers and reports. 



C. C. H. Ml received the HSAc 
degree in 1082 ami the Ph D 
degree in I OHO, both in electrical 
engineering from the University 
of VVaterhH), C anada He has 
worked brielly as a consultant, 
and as II staff scientist with the 
InsiiUitc (or C omputer Applied 
lions in Science and Engineering 
(K'ASf ) at NASA I.angley Kc 
search C enter. Virginia from 1086 
to 1087 He IS now an assistant 
professor at the University of British C olumbia, C anada His 
current research interests are adaptive control, robotics, 
neural networks and sensor tcehnology and their industrial 
iipplicalions. 


Joliii MlaeCircgor was born in 
Canada in 1043 He obtained 
V a B.Eng degree in chemical 

Sw f engineering from McMaster 

KB ^ University in 1063. and M.Sc 

degrees in both chemical engi- 
i neering and sialisiics from the 

fln/ University of Wisconsin in I%7. 

After working in the Process 
Fcchnology Section of Monsanto 
Eoinpuny in Texas between 1067 
and i%9, he returned to the 
University of Wisconsin to obtain his Ph D in siutistics m 
1072 He IS currenily a professor und chairman of the 
Department of Chemical Engineering at McMaster Univer¬ 
sity m C anada. His research interests include statistical 
process control, prot'css idcntiticaiion nonlinear and robust 
control, and the modelling and control of polymerization 



reactors He is actively involved with industries both os a 
consultant, and through the cooperative research efforts of 
the McMaster Advanced Control Consortium and the 
McMaster Institute for Polymer Production Technology 


Jokm B. Moore was bom in China 
m Wl. He received his Bachelor 
and Masters degrees in electneal 
engineering m 1%3 and 19(>4 
respectively, and hi.s doctorate in 
electrical engineering from the 
University of Santa Clara, Cali¬ 
fornia, in 1%7. He was appointed 
Senior la^cturcr at the University 
of Newcastle m 1%7, and prri- 
moicd to Associate Professor in 
1%8 and full Professtir (personal 
chair) in 1973. Since 1982, he has t>cen a Professorial Fellow 
in the Departmcnl of Systems Engineering, Research SchcKil 
of Physical Sciences, Australian National University He has 
held visiting academic appointments at the University of 
Santa Clara (19(>8), the University of Maryland (1970). 
Colorado Stale University and Imperial C'ollege (1974); the 
University of California, Davis (1977); the University of 
Washington, Seattle (1981); Oambridge University and the 
National University of Singapore (1981); and the University 
of California, Berkeley (1987, 1989). He has spent periods m 
industry as a design engineer and us a consultant. 

Di McKire s current research is in control and communica¬ 
tion systems. He is co-author with Brian Anderson of three 
b<H»ks; Linear Optimal Control (Prentice-Hall, 1971); 
Optimal Filtering (Prentice-Hall. 1979); and Optimal 
Control- Linear Quadratic MeihoiLs (PrenticeHall, I9H9). 
He IS a l ellow ol the Australian Academy of Technological 
.Sciences, a I cilow of the IEI:E and a Fellow of the IE 
Australia 


Mohammed M*Saad was born in 
Angads-Oujda, Morocco, in 
1933 He gradual ed from the 
Ecole Mnhammadia d’Ingiinicurs, 
Rabat, Morocco, in 1978 as an 
electrical engineer. He obtained 
the degree of Docieur dc 3tme 
cycle from the FacuJie^ dcs Sci 
enecs, Rabat, MoriKco, and 
Docteur d'Elat from the Insiilut 
National Polylcchnique de Gren¬ 
oble, France, m 19H2 and 1987. 
respectively. He was Mailrc-Assisiani and Mai Ire de 
Conference at the Ecolc Mohammadia dTngenieurs and 
researcher at the Lab<iratoirc d'Elccironique cl d'Etude dcs 
Systi^mes Aulomatiques He is currently researcher at the 
C entre National dc la Recherche .Scicnlihque (C" N.R.S.). 
France. His research interest is adaptive control 




Rudolf Muench was born m 
Coburg, Germany, in 1938. He 
studied electrical engineering at 
the Technical University in Mun¬ 
ich. For his thesis he worked at 
the Institute for Flight Systems 
Dynamics at the German Aer¬ 
ospace Re.scarch Establishment 
(DLR) in (3berpfaffcnhofen and 
received the Dipl-Ing. degree in 
1986 He is now concerned with 
the development of cxmirol sysi 
cnis lor paper machines at Sulzer Escher Wyss GmbH. 
Depanmcnt for Research and Development, in Ravensburg 
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Mmtefi was bom 

IjDndoD in 1%^ Ij, 
received the HA Oegrte m 
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A Petri Net Model for Evaluation cf Expert 
Systems in Organizations* 

DIDIER M PERDLH jmd All XANDHR \{ LI VISi 

Predicate rramiiion Set models of the haste lo^u operators are used to 
construct dynamic modeLs of expert systems, the latter are used to evaluate 
the effect of decision aids on orftanizattonal performance. 

Key War*™ Pcin ntis, cjijKri svMcms. (.ktisuMi mds, lu/-/v ioitu 


Abstract ™ A new Pcin Nei nuKlel o( svtiUHilit aimpuiiUion 
with fuzzy logic is presented to desciibe the dyn^nmes of 
consultant expert systems IV-n u quaniiiaiive nuihothdogv 
IS presented for asscvsing to what cnicnt the measures nl 
performance of an orguni/ation are modified when an expert 
system is intnxluced An example prohlem involving ;» 
hierarchical two decision maker oigani/ahon. wheic the 
expert system i.s used as an aid m the fusion of incoiiMstmi 
information, is described A slraiegs for uMiig the cxptrri 
system is compared to two other fv>ssiblc strategics that mav 
be used by a decision makci resj>onsibh' for ihis task 
Measures of fx-rformance (workload, timeliness and 
accuracy) are evaluated lor each of these strategics Ihe 
results show that the strategy involving the use of the evtK*H 
system improves significantly the aceuracs of the inganua 
lion, but requires more lime and increases ihi workload of 
the decision maker 

INlRODl t'! I( )N 

Onp ()i the problems in modern decision making 
organizations is the increase in cognitive 
workload of individual decision makers This 
increase i.s attributed lo higher rate of mforma- 
lion processing that has resulted from two 
factors: the increase in the availabiliiy and 
accessihilily of data and the increase in the 
tempo of operations. As a resulL lo mainlam nr 
improve performance, decision aids have been 
introduced or are being proposed that atm at; 
(a) reducing a decision maker's w()rkhK^d by 
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carrying dui mundane, buf time conMiniiOg tasks 
such as Miuaiion assessment i>r cMilualioii of 
alternatives. (b) augmenting the decision 
maker s seopi* by inlftHhicmg additional options; 
and tc) reducing human error bs providing 
guidance Ihrougli a (smart) checklist 

In all cases, the intioduction of decision aids 
has complicated the orgam/ation design problem 
considerably The problem has expandetl from 
distribulmg Ihe infoimalion amt decision making 
funebons among ihc orgam/alion mcmtx'rs. as is 
Ihe case in traditional organi/aiion design, or 
between a single decision makcf (HM) and a 
machine, as is the ease in iradilional man 
maehme work, lo alliK'ating funehons lo a team 
of humans supfxirlcd by a decision aiding 
system 

The second atm t»f a decision aid introduces 
more flexibihiy in selecting a resfvonsc Unfortu 
natcly, this flexibility comes at a price the 
increase m the cognitive workload <»f the 
individual DM due w the increase in uneerlainiy 
and to Ihe introdueiion (d a higher level 
cognitive task the management of flexibifity 
This phenomenon, which has apfx-ared again 
and again in the analysis o( disiributed decision 
making orgam/airons, has two consequences 
One IS psychological and can be desenhed by the 
term meta dec iMcm maktrm, while the other is 
organizational and can lx‘ addressed with the use 
of intelligent decision aids that can assist in 
managing the fkxibilily ITie effect of meta- 
decisions or, as Linhorn and Hogarth (U>K1) 
describe it ‘deciding how lo cIkkisc * has also 
been addressed by Weingaertner and ljc\i% 
(IMK*^) This paper will Okus on the analysis and 
evaluation of one class of inielligeni decision 
aids, those based on expert systems. ITie lad! 
assumption for these decision aids is that they 
can decrea.se the human's workload while 
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improving performance Jhc rationale is ob¬ 
vious the needed functionality can be distrib¬ 
uted between humans and intelligent machines. 

In the next section, a mathematical framework 
IS presented lor modeling decision makers in 
organizations and decisions aids of various types 
for a variety of specific contexts U is based on 
High Ixvel Petri Nets, in particular, Predicate 
Transition Nets, three measures of performance 
arc used for the evaluation of the effect decision 
aids have: accuracy, which is a measure of the 
quality of the response; timeliness of the 
response; and cognitive workload of the 
individual decision maker, In the third section, 
an expert system model using predicate transi¬ 
tion nets will be described. A particular example 
that illustrates the approach is presented in the 
fourth section, with the results and their 
interpretation appearing in the fifth. 

MODI l.INCj t KAMl WORK 

A restricted class of organizations will be 
considered. It is assumed first that the 
organization consists of at least two human 
decision makers and that it is a team. A team is 
defined as an organization in which the members 
have a common goal, have the same interests 
and same values, and have activities that must be 
coordinated so as to achieve a higher 
cflectivencss (Circvci, 19K7). It is further 
assumed that they arc well trained for the tasks 
that they have to perform and that they do not 
learn during the execution of a particular task. 

It should be possible to draw a boundary that 
defines what is included in the organization and 
what is excluded, i.e. what resides in the 
external environment. Tasks that the organiza¬ 
tion must perform are generated in the 
environment by one or more sources which may 
or may not be synchronized. I'he organization 
ads upon these inputs and produces a response, 
including the null response, that is directed to 
the environment. Thus, the interface between 
the system and the environment is composed of 
the sensors and the effectors. 

The elements of the organization consist of the 
human decision makers, data bases, processors 
and communication systems. A decision aid is 
defined as any technique or procedure that 
restructures the methods by which problems are 
analyzed, alternatives developed, and dcci.sions 
taken. Decision support systems, a specihe form 
of decision aids, do not automate a specific 
dccison making process, but must facilitate it 
(Keene and Scolt-Morton, 1978). Decision 
support systems arc considered here as higher 
level components that may consist of processors, 
data bases and communication systems. 



Relationships are the links that tie these 
elements together. These relationships can be 
considered at three levels; they may describe the 
physical arrangement of the componenl.s—such 
as the geographical location of the organization 
members; or the functional relationship between 
components—such as the sharing of information 
between two members; or the rules and 
protocols that govern the interactions—such as 
the conditions under which two members may 
share information. While this demarcation 
between relationships and components is often 
hard to justify, it is assumed that it can be done. 

The Pctri Net formalism (I\*lerson, 1981; 
Rcisig, 1985) has been found very convenient for 
describing the concurrent and asynchronous 
characteristics of the various interactions. Petri 
Nets are bipartite directed multigraphs. I he two 
types of nodes are the places, which represent 
signals or conditions, and the transitions, which 
represent processes or events. Places arc 
denoted by circles and transitions by bars, A 
marking of a Petri Net assigns a non-negative 
integer number of tokens to each place. A 
transition is enabled, if and only if each of its 
input places ii)nlains at least one token. The 
places act like buffers, hosting the tokens until 
all the input places of a transition are 
non-empty. Enabled transitions can (ire When 
they fire, a token is removed from each input 
place, and a token is deposited in each output 
place. In the Petri Net representation of the DM 
model, the transitions stand for the algorithms, 
the connectors for the precedence relations 
between these algorithms, and the tokens for 
their input and output. 

The Orf^anization Member model 

The Petri Net model of the four stage decision 
maker without memory who interacts with the 
other organization members and any decision 
aids present is shown in Fig. 1. The DM receives 
input signals x from a variety of sources: from 
the environment, from a decision support system 
(DSS), or from the rest of the organization. He 
can receive one input at a lime at the Situation 
Assessment (SA) stage. He processes this input, 
with or without use of information stored in a 
data base (memory) to obtain an estimate of a , 
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the assessed situation r, which he may share 
with other DMs. He may also receive at this 
point other information, from the rest o| ihc 
organization. He combines this information with 
his own assessment in the Information Tusion 
(IF) stage, which contains a data fusion 
algorithm, to obtain the final assessment of the 
situation, labeled r'. The next step is the 
consideration of commands v' from other DMs 
which could result m a resiriction of his set of 
alternatives for generating the resfxmse In the 
given input. This is the Command Interpretation 
stage, or C\ The outcome of the Cl stage is a 
signal V which contains the data and the rule 
ji' used in the Response Selection (RS) stage to 
select the procedure or algorithm for generating 
the output V. rhis is the response of the decision 
maker, it may be sent to the evlcrnal eflcclors or 
to other DMs within the organi/alion 

The tokens used in Petn Net theory lo study 
the dynamics of the nets, in the simplesi version 
of the model, are indislinguishable A token in a 
place means simply that an item of inlormulion 
IS available to the output transuion(s) o( ihai 
place It is also possible to associate attributes 
with the tokens. In this case, the source can be 
represented by a finite number of distinct tokens 
X. each one occurring with some probabiiily 
However, if the protocols ruling Ihcir 
processing do not vary from one set of ailributes 
to the other, they can be considered as 
indistinguishable tokens. 

The intelligence in this model is embodied in 
the algorithms embedded in the transitions; 
however, even if the algorithms are stochastic, 
Ihc model is rather mechanistic and does not 
capture human decision making well. To model 
the choice inherent in decision making, a DM is 
assumed lo have, at any stage of his prtxcssing, 
a set of options; different algorithms processing 
in different ways the same input to produce the 
same type of output. Thus, the SA and RS 
stages of the decision maker of Fig 1 are 
modeled so as lo include a set of (7 and V 
algorithms, respectively. The SA and RS stages 
i^re represented by Petri Nets with switches (Fig. 
2 ). 

Switches are transitions which resolve conflict 


saiuatmns; a is a trunsiixin with multiple 

output places am1 a itiic auxirding to which one 
and only one ot the output places is chosen to 
receive a token after the imnsiiton has hred In 
the SA stage iho chtnet* is denoted by Ihc* 
vanahle w, taking its values in (T2, . , . V} 
The ruk (or determining the value of the 
decision vanabie is called the ticcision slrafegy of 
the decision maker for the (V4irliculai stage If the 
rule IS churacten/ed bv a probabiltiy diitiibulion 
p(ii) and if one branch of the switch ts always 
chosen, i c if there is an r m jl, , such 
that p{u i) V 1, fhen the strategy is called pure 
Otherwise, it is mixed Die strategy that a 
decision maker uws at the RS stage usually 
dcptmds <»M the input to that stage In that case, 
the probabilities are conditional probabilities 
piv- f ,:, v\ logeiher. the strategics for the 
two stages o>nsli!uie the infemal decision 
strategy ol the DM While this is a way of 
describing ifu set of strategics that a well trained 
decision rnakei may use. if his fxHinded 
ralionaliiv threshold is not exceeded, there are 
no rules to s(H'ci1v how and when any of theve 
strategies will be selected bv a specific ilccision 
maker ai any given lime Ihese rules are 
assumed lo de[H*ntl on the level of expertise of 
tlu: DM and on tin esc* mental skills that “we 
admire hut don’i vet urulcrsland,’ i e on the 
DM s inielligence (Minskv, PWr) 

I he workload i>f each decision maker reflects 
the mental etlori ret|uired !<> carry out the 
mformahon processing aiul the decision making 
A matheinaiical model id workload has been 
dt‘vclo[K‘d (Hocitcher iind lanis P>HT) that is 
based on n dimensional mformahon theory Its 
key assumption is ihat Ihc higher Ihc uruertiiinty 
in the input, the more [Hoccssing has lo be done 
lo reduce irnccrfainlv i(» the fnani that a deciMon 
can be made Ihc value of the workload (i is 
obtained bv ci»mpuling the cniiopv of all the 
internal variables of the DM model ITie 
cognitive hmitahons i)t human DMs can be 
niiKlcled in terms ol the iMUindcd rationality 
const raint f his is based on the premise that the 
rale with which decision makers pnnxvss 
information is bounded, if the rate is exceeded, 
then rapid dcgradaiiim of [H‘ffi>rmancc cKCiif^ 
Fivrmally, 

( $ I J f 

where is the maximum rate and t is the 
mean mterarnval time A rcccrit experiment at 
Mi r (Ixmvei rr al , )VH8) has shown Ihat (or 
well defined cognilivr tasks. exists, is stable, 
and is normally distributed acftwis decision 
makers 

With this miKlel of the organization member. 
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it k now pon^^ihlc to describe distributed decision 
making organi/atiom chat tncludc decision aids. 
Expert Systems with their deductive capability 
and their ability to handle symbolic concepts 
have the potential to be very useful The specific 
aim of this paper is to show to what extent the 
use of an expert system modifies the measures of 
performance of a decision making organization. 
To allow the use of the analytical framework for 
the study of these organizations, an expert 
system mtHlel using Predicate I ransition Nets is 
first defined Expert Systems are then studied to 
assess their usefulness in aiding the fusion of 
possibly inconsistent information coming from 
different sources. 

AN riXrn kT SYSf l M MODI l USIN(» 

PRI UK Ail I kANSinON Nl IS 

Knowledge Based Expert Systems show 
properties of synchronicily and concurrency 
which can l>e modeled by (he Predicate I ransilion 
Net formalism. The rules of a knowledge basc‘ 
have lo be checked in a specific order depending 
on the strategy used to solve the problem and on 
(he current facts dcducred so far by I he system in 
the execution of previous rules. A model of an 
expert system using production rules to repre¬ 
sent knowledge is presented. Some previous 
work ((iiordona and Saitta, IMH.S) has addressed 
the modeling of production rules of a knowledge 
base using Predicate I ransition Nets 1 he model 
presented here differs in that it incorporates 
explicitly the control done by the inference 
engine f u/,/y logic (Z^uleh, l%!>, 1983; Whalen 
and Scholl, 1983) is uscil to deal with 
uncertainty and Predicate Iransition Nets arc 
used to represent the basic fuz/y logical 
ojKrators AND, OR and NOl that appear m 
the rules. An extension of the standard inlerencc 
net formalism is obtained by the combination of 
these opcialors so that the dynamical behavior 
of an expert system can be represented As a 
result, the rules scanned by the system lo 
produce an answer to a specific problem can \>c 
identified and the resfxmse time, which depends 
on the number of rules .sianned and on the 
number of interactions with the user, can be 
computed. 

Predicate Transition Nets have been intro¬ 
duced by Gcnnch and I.auienbach (1981) as an 
extension of the ordinary FVtri Nets to allow the 
handling of different classes of tokens. The 
Predicate Transition Nets used in the model 
have the following characteristics. 

Each token traveling through the net has an 
identity and is considered to be an tndivulual of 
a given class called variable. Each variable can 
receive different names. For this model, two 


classes of tokens are diffcrentiaied. The first 
class, denoted by P, is the set of the real 
numbers between 0 and 1, representing the 
degrees of truth of the facts or items of evidence. 
The names of the individual tokens of these 
classes will be p, pi, p2. The second class is 
denoted by S. The individuals of this class can 
only lake one value. Only one token of this class 
will travel through the net and will represent the 
action of the inference engine in triggering the 
different rulc.s. 

Plates arc nodes which can contain tokens. 
Three kinds of places are differentiated; 
(a) Those representing a fact or the result of a 
rule and containing either tokens of class P or 
no token at all; (b) lliose used by the .system as 
triggers of operators and containing the tokens 
of class S These places and the connectors 
connected to these places are represented in 
Ixild style in the figures and constitute the system 
net: and (c) Those allowed to contain both kinds 
of tokens {P and ,S) and which arc input places 
to transitions The marking of a place is a formal 
.sum of the individual tokens contained in the 
place. For example, a place A containing one 
token of class P, pi and the token of class S has 
(he marking M{A ): 

M{A)^p\ f 

Each amneaor has a label associated with it 
which indicates the kinds of tokens it can carry. 
A special grammar is used on the labels to define 
in what way tokens can be earned. I'he labels of 
connectors linking places to transitions contain 
conditions that must be fulfilled for them lo 
carry the tokens The labels of connectors 
linking transitions to places indicate what kind of 
token will appear in the places after the firing of 
the transition. 

The following notation m labels is used; When 
token names arc joined by symbol then the 
tokens defined by these names have to be carried 
at the same time For example, the label ‘p > S " 
indicates that one token of the class P and one 
token of the class .V have to he carried together 
at the same lime by the connector. When token 
names are joined by the symbol ' then the 
tokens defined by these names can be carried at 
different limes but not together. For example, 
the label *p, S" indicates that either a token of 
class P or a token of clavSs S can be carried. 
Mixing of notation is possible. The label “p S, 
5" indicates that the connector can carry either a 
token of class P together with a token of class S 
or only one token of cla.ss S. A connector 
without a label has no constraint on the kind of 
tokens it can carry 

In some cases, the connector has lo carry the 
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token of class 5 when there »% no token of class P 
involved in the finng of a transition The 
statement 'absence of token of the class P" is 
denoted by the symbol ♦ Thn symbol is used in 
the labels as if it were a class of tokens, but 
always in conjunction with the names of the 
other classes. The label *5 4 ^ 4> means ihat the 
connector can carry a token of class .S\ if there is 
no token of class P The label (5 4 ^). 
(5 + 4>) ’ means that the connector can carry 
cither a token of class S and a token of class P or 
a token of class S if there is no token of class P 

Transitions have attached to them a predicate 
which is a logical formula (or an algorithm) built 
from the operations and relations on variables 
and tokens in the labels of the input connectors 
The value (true of false) taken by the predicate 
of a transition depends on the tokens contained 
in the input places of the transition When the 
predicate has the value “truethe transition is 
enabled. In the model of the ctmsullant expert 
system, predicates are conditions on tokens of 
class P. 

A transition without predicates is enabled as 
soon as all the input places contain the tokens 
specified by the labels of the connectors. 
Transitions with predicates arc represented 
graphically with rectangles that contain the 
predicates. Iransitions without predicates are 
represented with bars as m ordinary Petri Nets 

llic cimditions of enabling of a transition are: 
(1) the input places contain the combination of 
tokens sjiccified by the labels of the connectors, 
and (2) the predicate of the transition is true If 
these two conditions are fulfilled, the transition 


am hre In the tiring pnn.'eiisi. lokem ispecilHtd by 
ihe input amnectoni art removed fmm the 
CAintsponding mpul places umd tokens spcx'ihed 
by the output ainneciors art generated in the 
output places 

In order to constiuct the mode! of the eipert 
syiitem using Preditate IfansHion Neu. it tit 
necessary to cortsiruil hrsi models of the logical 
operators AND. OR. and NOT ITie results arc 
shown in Figs y-S Ixt us deiwrribe ni»w what 
happens in ihe (t|x*rttior AND (the operators 
OR and NOT behave in a similar way), llie 
operator dtawn in Fig S realises the o|>cratit>n 

AND « :i>( 

llie operator AND can be rcpicscnicd as a 
black lx)x, having three inputs A, B and A* (the 
trigger) and six i>uiputs ( (on the result). A. B 
(memori/ing of the input value) and three 
system places .V,, .V„ and Only one of those 
system places (represented in lH»kl style in the 
figures) can have a system token at the output 
A,«,», will contain a system token. i( the result of 
the oficraiion is known. 1 e if C cimtains u token 
of the class P Ihis shows that the next 
operation can be |^H*rforrned If the icsult is 
unknown, 1 e the two inputs are not sulhcicnl to 
yield a result, the system token is assigned to 
or Sf^ in order to obtain the viiUics of these 
unknown inpuls A system token will be 
assigned to A, if (1) ( is unknown and (li) A is 
unknown oi if A and H arc Ixilh unknown Ibc 
system token will lx* assigned to A^, if ( is 
unknown and only H is unknown 

The execution of the operation will start only 
il there is a system token in A< We denote by -VV 


AND 



r K. ^ Model of fhc Avperaiof AN!) 






D, M, PtKOu and A. H. Li=vis 


230 


cm 



f u, 4 MtHlcI i»f ihc ofK'rahir OK 


the trigger place of the operator computing C. 
As WK)n as there is a token in \ , the two input 
transitions arc triggered by the alkicatum of a 
system tiikcn (A) at the input places of these 
transitions. The values of A and // are therefore 
reproduced in A and H and in the output place 
of each of Ihc transitions I'hesc places contain 
alMi a system token, which will ensure the en¬ 
abling of the following transition (i.e that the 
two inputs are present). I hese two places are the 
input places of seven different transitions which 
have disjoint conditions of enabling. Only one of 
these transitions can be enabled and can fire At 
the firing, the result, il any, is given in the result 
place and then in ( , while the svstem token is 
assigned either to or to or to 
These operators can be com(K)unded in 
super-transitions I he model can be generali/.ed 
to ofKrators with more than two inputs by 
combining these basic operators. 

The res|H)nse lime of an expert system is 
related to ifie number of rules in the rule base 
scanned by the system to give an answer to a 
s|x:ci(ic problem or goal, and to the number of 
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interactions with the user The type of model we 
have defined allows a quick identification ol the 
parts of the rule base which have been scanned, 
given a certain set of inputs, to reach a specilic 
goal, since each place contains the token 
symbolizing the value ol the rule or tael it 
represents. 

Let us consider an expert system being used to 
produce an answer in some environment We 
represent the input A', to the system as a n-iuplei 
where n is the total number of questions which 
can be asked by the system The answer to the 
questions are contained in this n-iupiel at the 
location corresponding the question asked 
(this may not be listed in order ol appearance in 
time) The locations (or the unasked questions 
arc left empty. We denote hv n, the number ol 
questions asked by the system. 1 he number of 
might be very large hut it is bounded (iiven 
a certain environment, we can dehne a 
distribution lor the ixcurrence ol the 

input X, 

Lor a spccihe input A',, we can identity S,, the 
numiH'r of places scanned by the system i(t reach 
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its goal, since they all contain the degrees of 
truth of the subgoals they represent. If r is the 
average time to check a rule and / is the average 
time taken by a user to answer a question asked 
by the system, then the time r, u> get an answer 
given an input X, will be; 

f, = iV,T + n,f. 

ITterefore, the average time of use T of the 
expert system for the set of inputs X. will be 
given by: 

= .Vp^n,, 

which leads to; 

7 -£|;y|T 4 /-.'(njf 

where /:1.V) denotes the expected value of the 
variable X. 

ITic lime I obtained is the average lime 
needed to get an answer from the expert system 
I his model of a consultant expert system will be 
used to evaluate the effect that incinisisteni 
information can have on the command »ind 
control priicess. 

AN I \IM Kl SVSTKM lOK H SION OI 
INIONSISI] N I IMORMA I ION 

An important problem faced by a decision 
making oigani/ation is the inconsistency o? 
informatnu’i which can degrade subsianlially lt^ 
performance fhis 'nconsistcncy can Ik' attrib¬ 
uted to different causes; inaccuracy in measured 
data, lack of sciim)! coverage, presence of noise, 
bad interpretation of data Inconsistency c)f 
information can also be explained by the attempt 
by a competitor or adversary to mislead about 
his actions through the dissemination of false 
information. Ihrec strategies to fuse mconststent 
mlormaiion arc considered: (1) ignore informa¬ 
tion sharing; (2) weighted choice among con¬ 
tradictory sets of data; and (3) use of an exj^crl 
system which has additional knowledge on the 
problem to be solved 

Ihe first strategy (Kcurs when the decision 
maker f>erforming the information fusion uses 
only his own assessment and ignores the 
assessment of the other decision maker This 
strategy is related to the way a human being 
assigns value io information which is transmitted 
to him, while executing a specific task 'Ilie study 
of BushncII e( aL (IMHK) develops a normative 
desenptive approach to quantify the prenress 
of weighting and combining information 
from distributed sources under uncertainly. 
Their experimentation has shown that one of 
the human cognitive biases, which appears in the 
excculion of a task, is the undervaluing of the 


Bl 

oommunicaiKms from 4>!tien, which tnocurs 
mikpenttenily of the qualtiy of the informaiion 
received The decision maicr is, ibcrtfarc, 
expected to have the lemJcncy fo ovciesiimate 
his own asscssmcni und to iissugn a k>wer value 
to the others' assrssm^.nts. 

The seamd strategy is to perform a weighted 
choice among the 'tmiiadctiiry assessments 
which arc transmiticd to him and conipaied lo 
his own This wcightuig strategy involves the 
confidence which can l>e given to the miormtttion 
and which depends on the mannei this 
mformatiori has lx*en obtained, oi on its 
ceriamiy In mans models of orgam/ations 
facing this problem of incoiisistcnt information 
and using the weighted choice strategy, measures 
of certainty aic the basis for weighting of 
different items of cvKlcnce Among the methods 
used, the Buvesian combmatitin has given 
valuable results 

The third strategy involves the use of an 
cx|XTt system f“ Xpert systems can consider 
additional knowledge and facts which winild f»e 
iiK^ costly in terms of time, eth»rt and inemoiy 
storage i<» be handled efficiently bv the decision 
maker on his own t‘or each inslance of 
contratliclory data, it can check if their values 
arc consisteni with ihe krmwledgc il has and give 
an indication of their lorreciness With this 
additional .inrit>uk:, the deiisii>n maker can 
|X’»form a nmre precise mtormaiion fusion 

In order to ilhisiratc how these strategics 
modify the measures of fH*rlorniancc of an 
orgiini/iJiion and lo emphasi/c the role of an 
cxjxri system m the fusion of mconsisteni 
information, an illusiraiive application will be 
uwd 

Ihe iliusiraiivc application involves an or- 
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guni/alion assigned to defend a si*t of facilities 
against air attacks I'his set of facilities consists 
of three cities, two military hascs and two 
production facilities IcKatcd in a sc|iiare, 3f) miles 
on each side, as shown on Fig 6, lo protect 
Itself against the mciiming threats, the organi/a- 
tion can usi! either one of two systems Ihe 
choice of system depends on the amount of time 
available, which in turn depends on the lime the 
threat was detected and on its sfK'cd hath 
system employs a different targeting solution 
rhe performance of the organi/aiion is meas¬ 
ured by Its ability to provide the appropriate 
resjKMise at the right place for each incoming 
threat 

Ihc f\lri Net reprevenlation of the hierarchi¬ 
cal two decision maker organi/ation is shown in 
Hg 7 I he two decision makers. DM I and 
l)M2, perform their own siliiaiion assessment 
producing the results /I and /2 DM2 sends 
/2l, which IS equal lo /2, to DM I who 
performs information fusion with one of the 
three strategies available Using the revised 
situation assessment /'I. the resptmse >1 is 
selected and transmitted to DM2 wlu». in turn, 
lakes into account his new mlormation in lus 
information lusion stage \\2 and reali/es the 
final resj^onse selection of the organization, > 

l:ach decision maker receives as input two 
points tin the tra|Cctorv vit the threat Ihc first 
one IS Its [Hisilion ai time r. which is the same for 
the two decision makers to make sure they arc 
assessing the same threat Ihc second |X)int is 
determined by the tracking center of each 
decision maker I'hc use of decoys and the 
presence of noise result m the piisiiion estimates 
not being the same for each of the decision 
makers When this is the case we assume that 
one of the two is the actual position. In addition 
to these different ccH^rdinales, the input contains 
also the confidence factiKs asstKialcd with each 
fH)Sition These confidence factors have been 
generated by a preprocessor (say. a tracking 


algorithm) and measure the quality that can be 
attributed to each set of data. 

After receiving these inputs, the two decision 
makers. DM) and DM2, perform the same 
situation assessment DM1 (resp DM2) com¬ 
putes the veliKity of the threat and evaluates its 
impact point, according to the set of coordinates 
he has received, and produces the result Z1 
(resp. /2). DM2 sends Z21, which is equal to 
Z2, to DM1 who is in charge of jxrrforming the 
information fusion In his information fusion 
stage, DM1 makes first the comparison f>ciwecn 
Z1 and Z21 If they are equal, Z'1--Z1 is 
produced. If they arc different, DMl has to 
choose from the three different strategies 
described in ihe previous section. 

The first one is to ignore mlormation sharing. 
In this case, DMl produces ZT “Z1 without 
considering the situation assessment. Z21, 
transmitted to him by DM2 

Ihe second strategy is Ihe weighting of the 
information according to the confidence factors 
associated with each set of data DMl considers 
the confidence levels ( onfl and ('onf2 as¬ 
sociated with the input 11 C'onfl is greater than 
or equal to ( onr2, DMl produces /'I -/I In 
Ihc opi^^isiic case. DMl proiluces ZT " Z2l 

Ihc last strategy involves the use of an expert 
system. Ihe simple knowledge base system 
which has been developed lor this application 
evaluates ihe degree of ihreat as a function of 
Ihe distance luMwcen the location of the different 
lacililies and the impaci [>oirU of the incoming 
Ihreat as estimated by the user A more 
sophisiicated sysIlmh could make the assessment 
of the ihreat hv taking inio accouni the iy|>e, Ihe 
geographical aspect of the area, the wind 
direction, etc The ihrcal ^issessmenl is done for 
the lw't» fH)ssihle trajectories, one after another. 
If the first threat assessment shows with enough 
eertamiv that the t«iTgcl is one of Ihe facilities, 
the computer slops its search If not. the 
computer evaluates the threat if it followed the 
second iraiectorv Ihe answer of Ihe expert 
system consists of two numbers iKlween 0 and 1 
representing the seventy of the threat (according 
to each assessrneni) When the answer is given. 
DMl does not use a strategy in which the result 
IS compared with that from an internal 
algorithm, as described by Weingaertner and 
Levis (IMSM) I'his IS due to the fact that the 
decision maker diK's not have enough data on his 
own to be able lo double check the response of 
the decision aid If the degree of threat 
according to the assessment of DMl is greater 
than or equal to the one according to the 
assessment of DM2, the result is ZT- Zl In 
the opjH>si!e case, the result is Z1 ~ Z2L 
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Having chosen the trajectory whah seems to 
be the most likely, DMl, in his response 
selection stage, determines the type of threat by 
computing the time before impact and sends it to 
DM2 with the fused information DM2, in his 
information fusion stage, scitxts the system to 
use and performs the targeting solution in his 
response selection stage. 

The measures of performance considered in 
this paper are workload (Boettcher and Levis, 
1983), timeliness (Coihier and Levis, 19Hb) and 
accuracy (Andreadakis and Levis, 1VH7) They 
have been defined for the two possible types of 
interaction between the computer and the user 

(a) The user initiafed mode when the decision 
maker enters all the data he has m a 
specified order and the machine priKluccs a 
result. Not all entered data ma> be needed 
by the machine in its search pr<xe,ss 

(b) The computer minated mode when the user 
enters specific data only in resfvonsc- to 
requests from the computer 

Thirty-three equiprobabic inputs to the or¬ 
ganization have been considered Iwenly-fom 
inputs contain inconsistent irilormalinn We 
assume that for half of these inconsistent inputs, 
the tracking center of DM! is correct (the 
tracking center of DM2 is correct (or the other 
half because we assume that for each input, one 
of the two contradictory [Positions is correct) 
Workl<>ad I he evaluation of the workload for 
each decision maker uses an information 
theoretical framework (Boettcher and Levis. 
1983) The activity of each DM is evaluaied by 
relating, in a quantitative manner, the uncer 
lainly in the tasks to be performed with the 
amount of information that must be processed to 
obtain certain results Ihe information theoretic 
surrogate for the cognitive workload of a 
decision maker is computed by adding all the 
entropies of all the variables used to model the 
priK'edurcs he uses to perform his task I'he 
distributions of all the variables are generated by 
executing the algorithms for all Ihe inputs 
However, to lake into account the effect of the 
different strategies, the workload of Ihe decision 
makers has to be computed lor all the mixed 
strategies. A mixed strategy is a convex 
combination of the three pure strategies 

Timeliness, llic measure of timeliness con 
sidered in this application is related to Ihe 
response lime of the organization A determiniS' 
tic processing lime has been asMxiaicd with 
every algonthm. Again, each prixessmg lime 
can be described by a probability density 
function and the probability density function of 
the response lime can be computed (sec 


Andreadakis and Levis, I9K7). ITie use of a 
sicxhastic nKxkl does not add to the presema* 
iKm of the example, but would be the moskl to 
use for an cxpenmenial mst^sligaiKUi For the 
strategy involving the use of the expen system, 
the lime to give an answer has been cximpuied 
using the expert sy'siem iiuKlei tlescribcd in the 
previous section ILe respimse imu of the 
expert system is a funclton of the number of rules 
scanned by the system for each infml to the 
organization and of the number o{ interaiiiom 
with the user Iliis time is likely to vary with the 
mtKlc of interactions used 

We assume that DM I an<l DM2 |serform thcii 
situation assessment concurrently and synchro¬ 
nously, and that the wirnc amount of time is 
needed by Ihe two to prinluce an answer 
Therefore, only one of the two prcKessing times 
IS considered 7^^,. (resp 7 km. AA^ ^ii;» 

/ks:) denotes the time needed u» execute DMLs 
situation assessment algorithm (resp DMLs 
response selection, DM2‘s situation assessment, 
information fusion and response selection) 
7,,,ti) IS the time needed to ixrform Ihe 
information fusion using a pure ^^rategy 
1 1/ ' 1,2. 3) /in(3) IS a function of Ihe average 
rcs[>on.sc time of the expc^rl system computed 
from Its response lime for all the inputs. Lhe 
resptinse lime for the sirategv t, 7(i) is 
ihcreftue: 

MO "' ^ /in(0 ^ 1 WM ^ ^ lu\j 

I’hc rcsjKinsc time for each mixed strategy 
(^ 1 * Pvl IS given by a convex weighting of the 
response lime lor each pure sirafegy If 7(p,, 
p^.pi) denotes Ihe response time of the 
organization when the strategy (fhfP.’fU) is 
used, we have 

T{r,.r: P \)' 

Accuracy The accuracy of the organization 
has fKcn evaluated by comparing Ihe actual 
response tif the organization with the desired or 
optimal rcs(Kmse expected for each input. Miis 
desired resf>onsc.‘ is known to the designer A 
cost of one ha.s been ailribulcd when the 
incorrect type of wcajxm is usti'd or when the 
target point is not accurate For each input X, 
having a probability p(A',), the use of the pure 
strategy / generates the rcsp^inse which is 

compared to the desired response 'Die cost 

has the following 

.. '<) ,f Y.r-Y,, 

The accuracy J(ij obtained for the pure strategy 


function CO',,, Y^,) 
charactcriMics; 


C ty... K.l - 
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i is; 

JU)- yn{X,)C(y.,. Yj,}. 

The accuracy for ihc mixed strategy (p,, p d- 
Mp\ - Pi‘ P\)- obtained by computing the convex 
combination of the accuracy for each pure 
strategy: 

J(p,.P:.Pi)^ YjPrf(‘) 

( onsequenily, J represents the probability 
that an incorrect response will be pcneraled The 
lower the value of 7, the better the pcrlormance 
is. llie next section provides an analysis of the 
results obtained by using these measures of 
performance 

klSDLIS AND INtl KCHt lAIION 

Using the method described above, measures 
of |Krformance have been evaluated for the 
three strategies, f or the strategy involving the 
use of an expert system, we have considered two 
different options for dealing with uncertainty in 
the firing of rules, I u//y logic or Boolean logic; 
and two modes of inlciaction between the user 
and the decision aid: user inituiied mode or 
computer initialed mode The results are 
summari/cd in 1 able I. 

The three first columns of Table I display the 
measures ol perlorrnaiuc (MOfN) of the 
organi/ation for each pure strategy These 
results show rhal taking into account of more 
knowledge, either ahmt the way data are 
vibtamed, m (he case of the weighted choice 
strategy, or about the meaning of (he inlorma- 
lion, when the expert system is used, yields 
greater accuracy Accuracy is an important 
measure tor this kind of mission. However, the 
handling of more data is iet|uiied Therefore, 
more lime is needed and nmre effort, expressed 
m terms workload, is required This increase 
in wiirkload is caused more by the extra 
decisions which must be made, when the 


knowledge is taken into account, than by 
operations or manipulaiiun done with the 
additional knowledge. These manipulations are 
done by the decision aids, out of control of 
DM I 

When DM I ignores the situation assessment 
of I^M2, very few operations are performed, 
'The response time is the smallest of the three. If 
the measure of timeliness is the ability of the 
organization to give a re|x)nse as fast as possible, 
this strategy leads to a more timely response than 
the two others The simplicity of the algorithm 
results m low workload for DM I in comparison 
with the other strategies. Ihis strategy hits low 
accuracy in comparison with the other strategics, 
because the choice made on the information to 
be fused is arbitrary and has no rational 
justification Thus, a clear assessment of the cost 
and value of CAMirdinalion can be made 

Tor the weighted choice strsitegv, no operation 
on variables received is performed. DMJ makes 
only a comparison between the weights of the 
intormation We have assumed that the weight¬ 
ing process was earned out outside the 
organization by a preprocessor and. conse¬ 
quently, DM I pcrloi ms only lew operations 
more than in the lirsi strategy. Therefore, 
workload and response lime arc slightly larger 
than for the liisi strategy because of the extra 
inlormalion obtained by eonqiaring (he eon- 
lidencc levels. An increase ol 3 9'^i m response 
lime and ol in the wcukload of DMi is 

found The use ol the confidence levels, brings a 
large gain in accuraev improvement m 

camipansoii to the hrst strategy Ihese results 
show, as expected, that taking into account the 
quality of mformalion plays an important role in 
the accuracy ol ihc response, without degrading 
suhslanliallv the other measLiies of perloimance. 

When the expert system is used, the increase 
in workload ol DMI is abour S V? from the 
level of slrategs 2, and 111.8^ r from the level ol 
Ihe first strategy. Ihis can he explained by the 
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tumdiing by DM1 of ihc Assessments given by 
the expert system These assessments are 
variables which have greater entropies and which 
require more processing The increase in 
resptmsc time (of 10.8% from the level of 
strategy 2 and of 15 2% from the level of 
strategy 1) is mainly caused by the time taken by 
DM1 to interact with the system and the time 
needed to get the answer This res|X)nse time of 
the expert system can get larger as the size of (he 
knowledge base and of the problem increase In 
the example, the simplicity of the expert sy&tcm 
hides the real effect on timeliness which can be 
expected with the use of such interacting system. 
The gain in accuracy is very significant about 
22%. when compared to the accuracy reached 
with the second strategy and 4! ln»m the 
level reached when the situation assessment of 
the other DM is ignored 1 his shows the extent 
to which the accuracy is improved when 
additional knowledge is used to verify ihe 
correctness of information By using the expert 
system to evalualc the threat and lo esrimale its 
seventy for each possible Irajcctc^ry, DMl has a 
broader assessment which allows him lo fH*rform 
more accurale information fusion 

Finally, we note that the workload of I>M2 
remains almost constant for all the strategies A 
variation of 15% can be observed He uses 
always the same algorithms, and only the 
different distributions of the variables of the 
algorithms ohlamcd. when different strategies 
are used by DMl, explain this small vanaiion in 
his workload. 

Ihe performance measures (accuracy, timeli' 
nc.ss, and workload of DMl) reached by the 
organization, when mixed strategics are used by 
DMl in his inlormalion fusion stage, have hern 



Fif. 8 IXKUS of the mtJisiifo of perfOTTname smamed Hy 
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obtained using (’AFISAR (Computer Aided 
Evaluation of System ARchiicclures). Measures 
of performante have been evaluated for all 
mixed sirategics and have led to a surface m the 
space (J T ("il) represented on Fig H 

llic projections o( this surface on the 
Accuracy Workload (J Gl), and Timeliness 
Workload (T CiU planes arc drawn on Fig M 
Measures of [Kiformancc reached for each pure 
strategy are ItKaled at the three cusps of the 
figures Fhc ci>nvex comhinatiim of any two pure 
strategies gives a U sha[>cd curve (Bocllchci and 
Levis. 1W3) which can f>c explained by thr fact 
ihai when a mixed sinitcgy is used, there is 
additional activity due to the switching from one 
algorithm ti» arnuhei 

Ihe projection of the surlace of the Measures 
of IVrft>rniiifue on the Accuracy I imehness 
plane (J I) is given in Fig 10; it shows the 
fH'rb rmance ailamed by the organization TTic 
corners of this triangle mdicalc the level reached 
in accuracy and res|x»nse lime foi each pure 
strategy For all binary vanaiions between pure 
strategies or (or all sucessivc binary combina¬ 
tions o1 mixed strategics. J and T arc linear 
combinations of each other Figure 10 shows 
clearly llie tradeoffs lu-lween response lime and 
accuracy and how the requirements of the mission 
will justify a strategy Tbus. if the requirements 
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much lime will be needed to perform the 
information fusion. 

Effect r;/ the mode of interaction 
'fhe effect of the mcxle of inicraciion on the 
measures of performance is shown on the last 
four columns of [ able 1. Iherc is no change in 
accuracy or workload; however, a slight change 
in timelines,s is observed. ITiis is caused by the 
fact that, in the user initiated mode of 
interaction, all the data which have a chance to 
be processed by the expert system are entered at 
the beginning of the session. In the example, the 
position of the impact points according to the 
different situation a.s.scssmcnts arc entered, even 
if the (irst set is sufficient to assess the threat. 
Therefore, more time is needed than in the 
computer initiated mode, where data are entered 
at the request of the system during the search. 

It is important to note that in the air defense 
example, no workload has been assigned to the 
process of entering the information in the expert 
system The pnx:css consists only of replication 
of the information the decision maker already 
has. If the inputs asked by the cxfKrt system do 
not correspond to the data the decision maker 
has. he would have to perform some operations 
to deduce these inputs from the information he 
has. IxM us consider an example where the 
decision maker has computed or received from 
another member of the organi/.alion the value of 
the s|x'cd of an object being analyzed If the 
expert system asks the decision maker the 
question: "speed of the object (possible answer: 
low, moderate. high|/’ the decision maker will 
have to deduce from the actual value of the 
speed the attribute asked by ihc system. A small 
algorithm will have to be executed, increasing 
his workload It can be expected therefore that, 
in this case, a change m workload similar to the 
change in resfXinse time would be observed. M\\s 
issue raises the problem of the adequate design 
of the expert system, or more generally, of the 
decision aid in which the mode of interaction has 
to be thought very carefully to avoid an 
unnecessary increase in the workload of the 
decision maker and in the response time 

Euz:\ /ogir i'a Hoolt un lof;ic 
For this illustrative application, the levels of 
performance reached, when different exjxrt 
.systems are used, have fx-cn studied The 
performance achieved with an expert system 
using fuz/y logic as the means of inference has 
been compared to the performance obtained by 
using an expert system which dixs not deal with 
uncertainty and uses Btxilean logic. Tliis version 
of the expert system has Ix^en obtained by 


changing the mapping functions (only values 0 
and 1 could be prexessed instead of the real 
numbers between 0 and 1). It has been assumed 
that a statement having a degree of truth greater 
(resp. smaller) than 0.6 was true (resp. false). 
ITiercforc, the assefcsment of the threat for each 
trajectory has only the values true or false. The 
different measures of performance obtained for 
the two systems are summarized in the last four 
column.H of Tabic 1. 

The organization has a response time slightly 
lower with an expert system using Boolean logic 
than with the expert system using fuzzy logic 
(2-3%). This is due to the fact that by assigning 
the value true or false to the severity of threat, 
the system can reach a conclusion (which is not 
always the best one) by examining fewer 
possibilities. It can prune a larger part of the 
knowledge ba.se than the fuzzy logic .system 
when it reaches the conclu.sion that a specihe 
facility is threatened When this conclusion i.s 
reached for the the first possible trajectory, the 
other trajectory is not examined. l*his results in 
a shorter lime to produce the answer and in 
fewer interactions with the user and therefore in 
a shorter response time. 

.Since the expert system with Bcndean logic 
assesses the threat only with the value true or 
false, the answer of the exjxrt system has a 
lower entropy The workload of the decision 
maker is therefore lower (aboul b when he 
uses the expert system with Bcnilean logic than 
when he uses the expert system with fuz/y logic. 

By priming a larger part of the knowledge 
base when il reaches a conclusion, the system 
has more chance to make the wriing assessment 
of the threat f'he results show that, indeed, the 
system with Boolean logic exhibits lower 
accuracy than the system with the fuzzy logic. 
The level of accuracy is. nevertheless, better 
than for the two other strategics expected to be 
used m the information fusion stage and is 
explained by the fact that more knowledge is 
taken into account in the information fusion 
priKc.ss. 


( ONC I.USION 

A melhiKlology for the modeling and evalua' 
tion of decision aids in an organizational context 
has been presented. Petri Nets models of human 
decision makers and decision aids arc described 
that can be interconnected to represent or¬ 
ganizations. A prtKcdure has been presented for 
assessing to what extent the measures of 
performance of an organization arc modified 
when a decision aid is introduced. First, a model 
of symbolic computation with fuzzy logic, using 
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Predicate Transition Nets, is prescnied to 
describe the most common kmd of expert 
system: the cxmsullant expert system An 
illustrative example has been used to evaluate 
alternative strategies for handling inconsistent 
information, The results show that the strategy 
involving the use of the expert system improves 
significantly the accuracy of the orgam/iition. but 
requires more time and increases the workload 
of the decision maker using it. 
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A New Technique for Fault Detection Using 

Petri Nets* 

J FROCK’ 

Modelling a sy.sicrn as u Petrt nei, uhnormal .systems' behavior or sensor 
errors with stow time Cffrisfa/ils cun he tJetecfei/ rnom/ijnn^^ njciishrcnicnf 
sii^nuls which are re/ufnJ fo 4 r>fi.srn»rtn(>n i/uunft/ic.s 

Key Wfonfei I iiiluTc ilclccljon, leak drlc<h<»ii niKkiii on liDt i‘(H“rrthoi>. Titn ncH 

(ailarcN. sijjimil proccHsinit? 


Abstraci—A newk mcllnul ot (mill Lieucuon Uviiamn 

measurcmcnl signalN which is suii.ililc ior ssshm^ i% 

prcsenicci Bv miHkilin^ ihc svsurn as a I’ciri rvei 1 .iiUirrv 
with verv slow Iutic conslanls Mi ilcicifal^ic 1111:* im {lv>»l is 
limilcd to ihc ak ritilKaliofi o( sensor or puKi s'- errors wtneh 
arc manrlcslctl in signals rclalciJ lo phvsaal sonscisaiion 
quiiniitics Alter a lault iv Jelccicd a (irocni'sis nl ihe luiure 
syslcm s lH*havior can K- provklml 1 he incihiH! o applied Ui 
a nuclear fxawer (ilant seeorulars nM>hnc' loop Iht 
iniv,linages and draw hacks are discussed in derail 

1 IM RODl ( MON 

Uuiilt R ni MANDs upon process salciv icquin 
an incTcasecI clirrri with rcspcci to process 
control, which includes the carlv detection ol 
faults and abnormal process behavior I urltier 
more, decreasing hardware costs support the 
development of new, (oinpulcr-hased (ailure 
detection and identification methods winch 
process measurement signals and work in the 
lime range. I'p to the present, huilts have been 
detected often by applving the leehnuiues o( 
iinaiytieal redumianev |revieweil m Hasseville 
and Henveniste Ihese techniques arc 

appropriate to ‘partial processes A partial 
process is dehnetl hereafter as a structural 
component, which transports or iranslorrns a 
physical conservation quanlils This definition 
comes from a p<mer plant ol \icw 

The methods of analytical redundanev arc also 
useful m the domain of nuclear power plants 
(PnKk, that is, for the online real time 

identification of last changes m sensor signals 
during steady stale or transient plant o(X‘raiing 
conditions. But the mam drawback of these 
methods is that they cannot detect faults with 
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slow time constants beeausc of their hiniled time 
rneimuv This means that tlie iKeutteiuc ot a 
fault will be hngotten bv the aigonihm alter a 
certain |H‘noi1 ul time t aiilis with a low tune 
constant will change the rneasuiemenl signals 
during this lime periotl onlv to a riimimal extent 
and will be thereftue iindeieeiable flic limited 
mernors span is a eonsequeiue ol the pnneiple 
ol these methotls I'hev need stale space mukIcIs 
i>f the partial process undet consider at lon^ eg 
IToek (IdKS), wfmh are driven fn input signals 
this form ol desenptinn as a bouiularv value 
problem will nevei be appiopnale lot iletecling 
slow varving failures uiuJet real lime conditions, 
as shown l>elow Ifieiefoie additional methods 
for earlv fault deleelMm :ire required, as the 
oeciurerue of slow varying failures has a nonzero 
probabilitv I xarnples of such failures are smalt 
leaks in vessels or lemperature tlriflv in sensors 
For the ease of loial processes which are 
coni(UJsiieil bv several partial (iroeesscs like 
bigger systems m a powe r plant or in a chemieal 
facli>rv. a new leehnupu of online f;iull 

delect ion in real time is presented m n preuess 
mdc[X’ndeivl lormulation using place Transition 
nets (Section M F’laee Transition nets arc a 
sulxlass of Pein nets I-or readers who are 
unfamiliar with the Petn nel theory, some ol the 
Icchmeal terms required to deiive ilie method 
are presented m .Section 2 In Section 4 this new 
fault deled ion methoiJ is applied to ,i seeondarv 
ctvoling l(H>p of a pressurized water reaelor and 
tested with the help of original seOMir data 
Discussion and further pros)xets follow m 
Secium 5 and the paper concludes with u brief 
review in Sect urn b 


2 BASK GIfIMtKrNS 

At the beginning some basic dehnilKms of 
placc/iransilion nets (hereafter called pi nets) 
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muHi he given. For a more detailed study of the 
theoretical aspects of Petri nets, sec Rci.sig 
(19K2); a description from a more practical point 
of view can be found in Abel (1987). 

A pt net is a b-luple N * (.S', 7, F, K, W, 
A/(0)) where 

(i) .V is a finite set of places S = 

(.V|,.v,,.. .r-s,); 

(ii) 7 is a fmilc scl i)f transitions 7 - 

(^ 11 h.> • • ■ . 

(lii) F is a binary relation F q (A x T) U (7 x S) 
which is represented by directed arcs between 
the places and transitions; 
fiv) /C IS a mapping, {a}\ which 

describes the capacity cif each place K(s), 

(v) W is a mapping, W / which 

attaches a weight to each arc; and 

(vi) M{i)) is a mapping, A7(0);.S—• f- which 
gives the initial marking of the places, taking the 
capacity A'(.v) of each place into account. 

A pt net is a bipartite graph consisting of 2 
types of elements, a finite number /S/ of places 
|dcfinition (i)| and a number /77 of transitions 
(li) Definition (iii) states that these places and 
transitions are coupled altcrnatingly by arcs, 
which are directed from a place to a transition or 
vice nersa Pt nets are introduced to describe the 
transixirt of a quantity, such as mass, informa¬ 
tion or a sort of goods. 1o remain in a system 
indc[K*ndent formulation, this transport quantity 
will be called a token Places, the passive 



elements of the net, store a certain number 
(finite or infinite) of tokens according to their 
capacity K (definition (iv)). Under special 
conditions a transition transports a number of 
tokens from the previous to the next placc(s), 
the transition fires. Ilie number of tokens 
transferred depends on the transport capacity 
[the weight W, definition (v)j of the connecting 
arcs. The iranspijrt process starts at lime 0 with 
an initial distribution A/(0) of the tokens per 
plate (vi). Figure I is an example of the 
graphical representation of a pi net; the places 
are identified by circles, and the transitions by 
boxes. 

The static structure of the pi net, defined in 
(i), (li), (iii) and (v) can also be described in an 
algebraic manner by the so-called /.S7-row 
/ / /-column incidence matrix N. llie element N„ 
of this matrix indicates if place is reached by a 
weighted arc coming from transition ( f sign) 
or is left by an arc which is directed to transition 
). Assuming that no arc simultaneously starts 
and ends at the same place (the noloop 
condition (v, t) t F -> (/, a ) 4 F) is defined: 



' + W'(t„A,). 

it (r,, .5, e 

7) 

' »/ 

lV(v,, 0, 

it (V,. 1 , e 

/•I (1) 


. 0 

Otherwise. 

Ihc dynamic behavior 

of the 

pt net IS 


represented by the firing rule. A transition I, will 
be able lo tire, it the following relation holds, 
where M(k) is a marking vector, k \s a discrete 



Fiu l MinkUmg of » PWR »cix>nilary dx^lini^ Ich^P a nxAss lokcn place/ifiinsition 
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tune pomt {M{k) : S \ ) 

9^^ Mik -- 1) ^ I - K (2) 

This means that tiring will he only fHissibIc if the 
token content per place after tiring di>e:s not 
surpass its capacity. K is the capacity vector of 
dimension /S/ and the Uansiiton t, is the /ih 
column vector of the incidence matrix N After 
firing the sultscqueru marking M{k \ arises 

M(k) ^ IVIfA: 1) 4 (t) 

With the help of equation (3), and K'gmnmg at 
lime k - 0. it follows; 

mk) - M((l) » Nv (4) 

where vector v dcscrihcs the hring Ircqucncics ol 
each transition which lead from (he imital 
marking to the actual slate ()1 particulai 
importance arc special sets ot places of the pi net 
called \-invariants ihcN arc inlcgei solutions of 
the linear equation 

iiS 0. (S) 

With the help ol ihcsf V iruarianis a new 
principle for faull deicciinn in lomplcx svsicfTis 
can be formulated. 

t l»I tRt Nl IS lOK t '\l 1 I Of ri(“II(JN IN 
I AlOil K SSMl MS 

Petri nets arc a powertui (onl Km sysleiii 
description Ncvcriheless ij[i m the |>rescnt ihcv 
have mainly been uscci lor simulation |njr|Hvsi-s 
only, rhe problem nl process moniionne m a 
jxiwcr plant can be slated as tollnws Ihe 
measurement signals come horn ihe system with 
a constant scanning rate When processing these 
data, a eompulcr-based svsterii slumUl decide 
online m real time il an crior has t>ccurred or 
not lo perform this, the computer prt»grani 
needs some knowledge aboui ihe system (or the 
"tolar' process, as described in Section I \ under 
consideration. 

Supposing It IS possible lo map Ihe slructurc of 
the total process as a pt ncl, ifi!; iransport ol the 
physical conservation quanliiv is re|)rcsenied hy 
the firing of tokens If Ihc conservation quantity 
lakes only a few discrete values and the signals 
measuring the number of tokens are not noisy, 
the priKcss monitoring is easy I'smg equation 
(4) It can be tested at each scanning time t>omi if 
Ihe actual marking vector M(A ) beginning from 
the initial marking M(0) is reachable If MfA) is 
not reachable it can be conciiided that an error 
has occurred The algonlhmical evaluation of 
this failure detection criterion is simple Keeping 
in mind that the marking vector is integer 
valued, equation (4) is therefore a linear 
diophantic equation svstem It is sufficient to lest 


the eiisieiKe amshtiofi of (4) a( each lime Mcp 
More drimls ol the theory ot dHvphuntK: 
cquaiiom can lie found in Pamdctli { 
Examples (<vr systems gtrvtriicd by such well 
defined unmnsy fyhvsiial quaniitics are indusrnal 
priHluction systems or automatic shunting yards 
But in the case id piaitt nHmHuiing. (he 
measurement signals are noisy and thru domain 
ol ikdinuum is much huger than m the fornKr 
case Because ol this the simple evaluation of 
equation (4) must tail 

Mulupivmg equation (4) with the tninsfxrse of 
the .S invariant and taking (!S) mio wccounl the 
fidhming cqiiatum luilds 

i'Mijk) i'Mdl) 

For the applic.iinui in t>owci plants it is correct 
to assume that the ncl token llow across ihc 
enveltq>e surface of ihc total pouess under 
consideralion vanishes or is /eri» in the mean 
( >!herwiM‘ CO itmuous phmi o|H*ration is not 
jvosMble MiHcover ii is assumcvl lhal Ihe 
iransiiions lire without changing the numiKi of 
liikens in olher words, ihe sum id arc weights m 
front arul alter a transilHUt should lx* equal 

V M (A, O V W .») (7) 

With *r:'• {s c V (\, r) f / |. r* (.i r ,S (r, \) c 
/ I Fquation (7| is a conservation law lor the 
linng td tokens Under both these conditions it is 
clear that an .S mvariarii exists which ihx's not 
contain an\ iilher elements than 1 because each 
column sum vanishes Such an \-invariani is 
called herealier a covering .S invariani Iherc- 
fi)re equaiuin (6) can be rearranged as 

y MJk) V (H) 

The seertand sum in equation (8) must tx: 
talculalcd only once at the initial time k ^ 0 
Faking the ruusy nature <d the measurement 
values into consideration, a new lauh criterion 
lor ciuiimiums total processes can \k (ormulaied 

V |M,(i) - I (y) 

Equation (d) is well sailed for online prixcss 
monitoring flic actual number oi tokens per 
place if (A) IS compared with Ihe initial token 
content of the total process This is possible 
because the continuous ti>lal prixcss is naturally 
an initial boundary problem in c<mtrast to the 
partial prixesves of the analytical redundancy 
methods. TTiercforc each slow varying fault can 
be detected as sixm as tl surpasses the threshold 
1 Tbe height of t depends on the scnwir nciiive 
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and can cattily be determined m an initial 
learning period. 

If equation (9) does not hold one of the 
following rcBMias are at cause: 

(i) A sensor fault has occurred, and one of the 
measured token numbers is erroneous; 

(ii) Inside the total system a source or sink of 
tokens has arisen, which means the structure of 
the pt net has changed; or 

(iii) Ilic net token flow across the envelope 
surface of the total process is no longer zero 
mean, and the operation of the plant has become 
discontinuous. 

Which exactly of these different faults has 
occurred cannot be recognized by using equation 
(9), that is. a diagnosis is not piissihle f or this 
to be done more knowledge about the total 
prtKess under consideration in the form of 
quantitative or qualitative physical models is 
needed, but the discussion of this domain is not 
the scope of this paper 

At the end of this section it should Ik* noted 
that the process description m terms of pt nets is 
analogous to the state space formulation 

IV1(*) AIVI(it 1) i Hn(k 1). (10) 

With the assumption that the stale IVI is totally 
mcasureable and that i( only represents physical 
quantities of the same kind (i.e only masses or 
only temperatures) the Mate transition matrix A 
is equal to the identity matrix. IJiminating all 
previous lime |>ouUs k \, k 2. , \ in 

equation (10) one gets 

M(A) = IVI(()) 4 B V (11, 

This cofulilion of observability (II) will be 
equivalent to the condition of reachability (4) if 
the sum of the control vector m (11) is set to a 
vector V and the input matrix R is named by 
incidence matrix IN The analogy demonstrates 
that It is suitable to use the IVtri net description 
to problems of process monitoring. 

4 AI»PI K Al lON K) A PVS K St CONDAKY I OOP 

In Fig 1 the mass tiansp<irt in a secondary 
CiHilmg kH)p of a pressuri/ed water reactor 
(PWR) is nuxlellcd by a pi net fhe plant 
concerned is the Biblis-B nuclear power plant, 
Germany. To guarantee clarity, the net nuxlel 
is sunplihed with respect to the transitions. ITic 
neglecting of transitions is |X>ssiblc Iwcause the 
failure detection criterion (9) needs only the 
defmition of places. The formulation of the 
incidenc'e matrix which contains all transitions is 
not necessary. Transitions arc represented by 


boxes (containing the letter / with subscript) and 
places by circles (inside containing an abbrevia¬ 
tion of the physical meaning, outside an s with 
subscript). A guideline for the distribution of the 
plant components (the partial processes) into 
places and transitions is given below. It should 
be noted that the structure of the net and the 
physical structure of the pipe system must differ. 
The net considers only the mass transport; the 
pipe system is designed for the simultaneous 
transport of mass, energy and momentum. 

It i.s not the concern of this paper to discuss 
the modelling pr^Kcss and the physics of a 
secondary loop in detail. However it should be 
mentioned that Fig. 1 does not contain all 
secondary Imrp systems Some processes which 
arc to be modelled as transitions, like the 
extraction steam lines of the turbines or the 
recirculation units of condensate in the low and 
high pressure preheaters are not considered 
Additionally, the auxiliary systems like the 
steam generator blowdown device and the 
system for the dcrninerali/.alion of water have 
also not been taken into accoimi. The secondary 
loop IS a two phase system. It Ciniiains steam 
l(K'alizecl to the range between the steam 
generators and the turbines, and water localized 
to the remaining comfronenls Because of the 
fact that the specific density of steam is much 
lower than the density of water, all steam 
transporting components have been modelled as 
transitions 

For the evaluation of the token numbers per 
place, level measurcmeni values must be u.sed 
With the help of the geometry of the 
components considered and the (temperature 
dependent) mass density, the total water mass 
per place can be calculated In the case of the 4 
steam generators the enthalpy rise values are 
also needed to estimate the internal, un 
measurable riser level Fable 1 lists the 22 places 
of the pi net of Fig 1 and specihes the 
measurement signals. The code of the signals 
refers to the measuring instruments of the power 
plant as standardized by the identification system 
AKZ of the German Kraflwerk llmon 

Knowing the token numlXT per place the 
token sum ZlA ) is calculated at each scanning 
time point k (in the case of Biblis-B the scanning 
rate of analogous signals is Is) For the 
interpretation of equation (9) a low-pass filter 

-~ 1 )^ ( 12 ) 

is needed, where the amplification factor a 
should be chosen in the order of some 10 . The 
use of such a filler is appropriate bccau.se of the 
noisy nature of S. This noise is a consequence of 
the measurement signal noise, the simplifications 
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TABU: 1 THIv KI I V'SK AI » OF IFH ri ,A« 'J.S FW \ 

SfcXtJMJf HAilt' TMANiSTTV>N M l ANI> 


nil (t>Dt 

or mt SI Nsim saiNAis 

ran rminatios 

NMt nil nms 

Place 

Name iA ihc 
partial process 

SeiiM^n sagrul 

1 AK/.-smit) 


steam generator 1 

2ti YB 01 1.9M 

a 2 

sieam generator 2 

21) \ A 01 m\ 

20 YB 02 l *)51 

iv 

sicam generator } 

20 YA 02 Wi 

20 YB 

,s 

sicam generaior 4 

20 \A {\y W\ 

20 YB IM 1 ‘^1 


steam separalor 1 

20 \A 04 

20 RN 10 LlXn 


Nicam separator 2 

2t) KN 20 UMil 

J 7 

condensalc vessel 

20 KN 10 Hl»2 

■Vh 

sic am separator 1. 2 

2o RN 20 1.002 


London safe vessel 

:i\ RP M 1.001 


reKealcr 1,2 

20 RP 21 tool 

'll 

L'ondcnsaic col 

20 .SI) 11 KOI 


Iccunjz Lontaiixr 

20 sn 12 1 nil 

'n 

condenser 1,2,1 

20 SK i:^ 1 oil 

.V,4 

low pressure 

2(1 RM 2^ i niM 


preheater 

20 HH 1 0U4 

■'if. 

1.2..^ 

20 RH 4 1 HUM 

' I ’ 

low pressure 

20 KM 24 KKIl 

' IW 

prcheatei A4 

2(» KH 34 1 (KH 


1,2, ^ 

20 KM 44 1 00) 


lecdwiilci liink 

2<l kf Ml 1,0112 


high pressure 

20 HI M 1 001 


pTc healer 1.2 

20 Kl tC 1 001 


ol the nuKJclling prciecss and (he lisiuimii 
behavior of the iransieni For (he (inline lauh 
deleelion (he mean of (he lo>A>pass innovalion is 
evaluaied, the length k of the moving averaging 
window was fixed to KK) time sleps When 
choosing h one must come (o a compromise 
because the lowering (^1 w leads to a faster 
detection, whereas a higher value of h increases 
the scnsiiivily of the detection. Alarm will l>e 
given if the failure sensitive signal (also called 
residual) surpasses a threshold 

V [!(;) V (, - i)|: \^) 

An example for such a residual is given m Fig 1 
On lop it shows the residual in the nofail case 
and the definition of the alarm threshold derived 
from its nofail fvehavior. For real applications 
the principle of self-adapting, learning thres¬ 
holds (PrcK-k. 19H%), should be used In the 
lower part of Fig. 2. a vcr\ small leak in the 
feedwater tank was simulated beginning at time 
5(KX).S- The residual indicates this fault, and 
reaches the threshold after .W time steps At 
time 5394 the alarm can be given During the 
time range between the beginning ol the fault 
and its deleelion, the water level in the 



r / • > * 1 Li ' 

Ik. 2 Ih trOion (*1 IcwL in Hh i Innk 

of ihc MmuliHCil Irtull ;ii imir soiMk mih tnnwv Ims 
s whKh IN cqtiivaU'tU lo n Icvrl chaiifit o( (fiUfim n 

Iccdwiilcr lank decreases In 2 4 cm which is 
equivalent to a total mass \os\ ol 4(M)(lkg I his 
loss IS verv vmall compared t<» ihe wliole mass 
eonlcni ol the scnoiularv lo4»(> which shows the 
sensilivilv of (he laull detection mell^^F At 
prcscnl the leedwalei tank level has l(» decrease, 
m the w<usi cast*, In 55 cm iKdore a warning is 
given to the conliol nM>m operator It should be 
mentioned that the measurernenl signals come 
from an operational liansieni where the 
generator [>owei diops (lom about UV f to afHrut 
h'v It the sensor data come liom a plant in a 
slalionarv stale (and (his is the normal o(Knalion 
ol a nuclear pimer plani) n will be less dynamic 
and the faull will lx“ tlcieclcd earlier Ilian m the 
example above 

Iheie luc olher possible faults m the PWR 
secondarv loop which are detectable with the 
alarm cnlenon (9) or (13) respective ly loday 
the deleelion ol small leaks m Ihe live steam 
pipes IS dihicult because the warning signal, 
which mdicaUs the pressure gradienr. operates 
only lor leaks w ith a dianielei larger (han Ml cm 
A leak or break of one steam generator U tube 
IS ideruified in existing plants by measuring the 
activity I 'Sing a secondary loojv Fein net rnoileF 
redundanr information can lx* provided to 
validate this activity signal Ihe same holds in 
the case* ol leaks or breaks of the e<»ndciis€r 
pipes which should tx: detected by mcasurmg the 
cIcci ncaI conduei ivit y 

It can be surnman/ed that the method 
presented is not able to locali/c the point ol fault 
and IS not suitable for the deleelion of large 
faults, like big leaks or the total break of pipes 
with a large ertrss section area In these* cases the 
calculation ol the residual mean takes tmi much 
time However, this is not a real drawback 
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because fa»( transients as a con^sequencc ot 
serious faults are well managed by the automatic 
plant safety systems Ihc advantage with respect 
to the secondary PWR Uwp of the method 
presented is the early detection ot faults with a 
low or a very low time constant. I'his early 
detection (before an automatic safety system 
starts to operate) can assist in lowering the 
consequences of the fault. 


S DISCUSSION 

There is additional mlormation needed 
amongst the measurement values lor the 
computer based detection of faults or abnormal 
system operation. Ihe methods of analytical 
redundancy need this system describing knowl¬ 
edge in the form of slate space models Fhesc 
are prcKesscd inside the validation algorithms 
Our new derived fault detection criterion based 
on Petri nets is simple in contrast to the 
validation algorithms and much less computing 
time is needed lor Us online calculation. 
However there is a catch; much more knowledge 
is needed for the modelling of the total sysiem as 
a pt net In corilrasf to the evaluation of the slate 
space models of the analytical redundancy, in 
this CHsv more in deplh knowledge about the 
behavior of the total sysiem is necessary And 
so, the advantages in computer processing have 
to be paid at the expense of the modelling work. 

rhe description of a (complex) total system 
with the help of a Petri net is not unique, 
rherefore only some hints can be given lor the 
modelling work: Since the fault criterion 
equation (^>) is a cimservaiion principle only the 
transport of conservation quantities cun he 
described by the token game l:!xamplcs are the 
muss (in nondiscreie form like water or m well 
defincti units like goods), energy or information 
Places should be used for svstem components 
which are able to siore or lo iranslorm the 
tokens f or |>eople who arc concerned wiih 
modelling and simulation, it can be said that 
places are the parts of the system where it is 
necessary to s|X‘cify difterential equations for the 
temporal changing of the token quantity. 
Examples arc vessels and tanks for mass tokens; 
heat exchangers or evaiKiralors in the case of 
energy tokens; and waiting queues in informa¬ 
tion nets. Iransitions arc. in the ideal case, 
components like pipes or wires which only 
transfXKi the tokens without changing their 
amount. In addition the Hux relation (iii) of the 
net definition (Section 2) must be considered 
during the modelling process 

rherefore a lot of knowledge in the area of 
prtKCss engineering and some experience for the 


modelling phase is needed. However the 
expense is advantageous: Equation (9) offers the 
detection of faults with very low time constants 
for all operational conditions of the systems. 
Moreover, a prognosis of the system's future 
t)ehavior will be possible if a fault is detected, 
because of its property of being an initial value 
problem. Such features arc not provided by 
other fault detection methods 

'Hie pt net description allows a different 
perspective lo initial and boundary problems: If 
equation (7) is true, a covering .S-mvarianl will 
exist. Remember, this is a .S-invariant which 
does not contain any other elements than 1. 
ITom this it ^ollov^s that a system will be 
describabic as an initial value problem if a 
covering .V-invariant exists If no such invariant 
can be evaluated the problem under considera¬ 
tion IS a boundary value problem. 

The example given in Section 4 is a typical 
case. In many industrial plants cooling l(H)ps are 
needed A two phase cooling loop shows a 
^xxssiblc extension lor the Petri net sysiem 
description As previously mentioned in our 
example, all steam containing components have 
Ixen modelled as transitions which do not 
influence the fault criterion (9) I'hc conse¬ 
quence ot this simplification is some additional 
noise in the residual of I ig 2 More suited to the 
problem could he the choice of a higher class of 
Petri nets, the coloured nets. A difference to pt 
nets is iheir propcitv of token individuality 
More than one type of token can exist and one 
token type can be changed into another In the 
ciHiling loop example there could he 2 tyjx's, (he 
water arul the steam tokens fhcir transforma¬ 
tion lakes place in the steam generators and the 
ctindensers Hut at the moment it is not possible 
to slate if the coloured net description will be 
appropriate m practice in the area of online fault 
delcciion. I’his is because ihcrc does not exi.si a 
rich theory ol this class of Petri nets and further 
research is required. 


h ( ()N( lA SIONS 

The description ot technical systems in terms 
of the Petri net iheeiry enables the formulation 
of a new online fault detection criterion. If the 
.V-invananl of the sysiem, which is evaluated in 
its initial stale, does not hold at a subsequent 
lime point, alarm will he given This criterion 
will be applicable if the net token flux across the 
envelope of the system is zero mean and no 
tokens are lost Ix’causc of firing. Under these 
assumptions the A'-mvananl describes the token 
conservation, therefore the method presented is 
applicable onlv to physical conservation quan- 
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lilies. As a ccinsequcncc of ihe assuiiiplK>ii& 
named above there exists a covering S invartani 
or. in other words, the system is an initial value 
problem. Thus the detection of abnormal 
process behavior or measurement faults wiih 
very low lime constants becomes possible and a 
prognosis of the future system behavior can 
given in the error case But due to the simplictiy 
of the fault detection ciilerion no diagnosis of 
the failure localization can he provided Tlie 
method presented is predestinated for the 
surveillance of complex technical systems like 
production lines or transport circuits, as ii is 
demonstrated by an example. Because of the 
lack of the diagnosis feature this meihiki should 
be considered as the online part ol a pr<Kc%s 
information system which is able lo ingger a 
(possible offline) diagnosis and interpretation 
unit. 
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An Extended Direct Scheme for Robust 
Adaptive Nonlinear Control* 

I. KANELLAKOPOlU.()S.t§ P V KOK(VI()Vl('t anil R MARINOt 

A ntrw direct adaptive control scheme u developed for notihnear systems 
satisfying an extended matching condition, and shovn to he robust with 
respect to unmodeled dynamics 

ICrj Hordi-' Aditpiivc conVrviL rnuUmciii sy^ums, c^tejuVctl muuhii\|ill. , UTin>‘**di*U'd 

dynjimiiii 


AMnKi- TV profH»%cd acliipiuf sLhcrtu acfuivcs rcjjuh* 
Hon tor B class of nonliniai sysicms with unknown lonstani 
paramrrers ami unmcHlcIctJ dvnumio fV vihcnu' vUk-\ noi 
employ ovcrpiiriimctriziilion ami iUk s imi icstrKi ihc class of 
nonlmcaritics by im> growth comtihoii'. InsiiMj. the 
ilcpcndem.'c on ihc unknown parafiuicr\ is icMntuil In an 
cxtemJetl matching comlilion. which, however o satishcil in 
many systems of practical imt^vrlaruc, sueh as most ivfH's ol 
clcctnc motors 

I IN IKODl ( HON 

Tm DiKi ('I adaptive regulation scheme ol T ayloi 
<7 ai ( 1989 ) is, whenever applicable, a simpler 
allernativ: »o more clahorale schemes (Nam ami 
Araposlhathis, 1988 ; F\miet and rraU. 19 H 9 ii; 
Saslry and Isidore I 989 | In addition to its 
simplicity, the direct scheme has also a 
rohustness profKTtv with respeci to unmodeled 
dynamics which are present in most engineering 
applications. An overview hv Saslry and 
Kokolovie ( 1988 ) shows that similar robustness 
properties are yet to lx* est4thlishcd lor other 
nonlinear adaptive schemes. Another mapu 
advantage of the simple direct scheme is us 
applicability to systems with nonhneanlies which 
are not globally lapse hit/, like i or a,*; In this 
regard, other schemes arc more restrictive 
because they assume lhal the nonlmearities arc 
globally Lipschit/ or satisfy some * linear 
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growih ’ coiuliiion lo stress the practuai 
importance of noiilineanliCN which are iH>l 
ghibally I ipschil/ let us icmiiul the reader tlval 
they art common in mecliiinical systems with 
ccnlnfug.il forces, in elccTncai systems with 
fluX'Curreni oi fhn speed products, in clicmiciil 
kinetics, etc The most reccni works <»( 
and Pralv (19K9h), Hasiin and ( ampion (1989) 
and ( ampion and fiasiin ( IV8XT) have made 
Mgrnlicani progress loward removing the global 
! ipschil/ C4>ruiiru>ns (or sysierns wjihoul iinmod 
t leil dynamics 

I nfortunatelv. the apphcabililv of Ihc simple 
direcf scheme, unlimiletl bv ihe ly|X‘ o( 
nonlmcaniv. is limiled m Us dependence on the 
unknown conslani parameters While, as in most 
other schemes this de^x ndcncc is assumed to fx* 
linear, a fuiTher rcslnetion is th.ii ihe uiikmiwn 
parameters apjxar only in system equations with 
conirol variables Only a narrow class o( 
nonlinear svAiems satisfies this \(nrt madfun^ 
itmiUtufn exiufly lo broaden fhis class, laylor 
r7 ul (19K9) use malched reduced order me hie Is 
and ireal the iinrnatched terms as unmifdelcd 
dynamics Eor example, a matched reduced 
order model ol an electric motor with uncertain 
load IS only its mechanical equation, while all the 
electrical phenomena arc lo lx ticated as 
unmixicled dynamics 

This paper introduces an rxicnded mauhmj^ 
amdiuon which further broadens the ap* 
plicabilMy of the simple direct Hhcmc witliout 
sacrificing any one of Us advantages Hie 
unknown constant parameters are now allowed 
to appear also m equations separated from the 
arnirol variables by one inicgration As an 
illustration, an clcclrical equation can now fx 
added to the abovc mcntioncd rmnlcl of an 
elecfnc motor This makes the eflccis of 
unmrKlcIcd dynamics less significant. 
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'flic extended direct scheme presented in this 
paper is a nonlinear version of a direct scheme 
proposed for linear systems of relative degree 
two; sec, c.g. the recent bcKik by Narcndra and 
Annaswamy (1989). However, there is a major 
difference between the linear and nonlinear 
versions. In the linear case, the relative-degree- 
Iwo scheme is a step toward a more general 
scheme. In the nonlinear case no general scheme 
is yet available which can handle as broad a class 
of nonlincarities as the extended direct scheme. 

llie organization and style of this paper stress 
simplicity and applicability, rather than theoreti¬ 
cal novelty, of the proposed extended direct 
scheme. Although the same scheme can be 
developed for multi-input systems (Kancllako- 
poulos el a/., I9K9, 1990), the pre.scntation is 
fcKuscd on the single-input case. As a further 
simplification, the scheme is developed for 
systems in a special form in which the meaning 
of the extended matching condition is obvious. 
A more general class of nonlinear systems, 
transformable Into this special form, is defined in 
the Appendix. The stability proofs in this paper 
make use of l.yapunov functions which, since an 
early paper by Parks (1906), have been a 
standard adaptive control t(X)l. The tutorial 
character of the paper is enhanced by a position 
control example which illustrates analytical 
derivations and gives a hint of potential 
applications. 


2 ntt; l•x■r^•;NI)l:r> otHi-CT s( iti mi: 

Tlic nonlinear plant with an unknown constant 
parameter vector n |a|, . . . , is a.ssumcd to 
be ill the form 


i ^ ai/(i) + g(.(^)«. (2.1) 

I *- t 

where fu, f\, «rc sminilh vector fields 

on and ^n(^) is hounded away from /ero on 
fl,. a subset of R'*. 

Proposition 1 in the Appendix gives necessary 
and sufficient conditions for the existence of a 
change of emudinates and a state 

feedback control u ^ a(j) 4 where v is a 

new control variable, which transform (2.1) into 
the special form 

i, K 1 <. 1 s rt ’ 2 

I-" I 

t. * f ^ * V ^ fl^Ks(A), 

(•I 

where the expressions for k'i(ji) and H:(a) are 
given by (A. 12) and (A. 13) in the Appendix. 


Note that w,(x) and w^fx) arc smooth vector 
fields on fl, = 

The meaning of the extended matching 
condition (A.3), formulated in the Appendix, is 
clearly displayed in (2.2). The original system 
(2-1) has been transformed into a chain of n ~ 2 
integrators and two nonlinear equations with 
unknown parameters. The control variable i; 
enters only the last equation and, hence, the 
.sYnct matching condition of Taylor et al. (1989) is 
not satisfied unless the vector field w,(x) is 
identically zero. In the case of extended 
matching w,(x) is not required to vanish and, 
hence, unknown parameters are allowed to 
appear in the last two equations of (2.2). Note 
also that none of the functions appearing in (2.1) 
and (2.2) are required to be globally Lipschitx or 
to satisfy some other linear growth or sector 
conditions. 

Instead of the true parameter values a ~ 
(cij. . . . , a^X, which arc unknown, a controller 
will Ik‘ designed using parameter estimates 
ri ~ (d,, . . . . The first step in this direction 
IS to introduce a new stale i„, instead of x„, 
using the expression 

■K ~ »M + X + <j'H',(x). (2.3) 


Before we employ (2 3), we need to know that 
the mapping x„ "-*1% is one-to-one, onto and 
continuous. Hence, we assume that there exist 
c: and a constant fS >0 such that 



Then, the last two 
rewritten as 


Vi c W,. Vu 6 /i, 
equations of (2.2) 


(2.4) 


are 


r, I + [a - u)'m|(.» ) (2.5) 


L 



3n’,(x) 


+ " 1 r •»,. I + 

\ I 


5H;,(jr) 
1 





- (i' + a ^H.(x))/)( «, fi) + <j ) 

+ (j^w4(a )<j f fl'H|(A). (2.6) 


Note that li(x.d) and the elements of wifAt), 
H’jfx) defined bv (2.6) arc .smooth functions on 
B. X fl. 

We now proceed to find a control which 
renders equations (2.5)-(2.6) linear in the 
parameter error a - d and makes them otherwise 
independent of the unknown parameter vector a. 
On cK>scr in.spcction of (2.6), wc sec that these 
tasks will be accomplished by a control of the 
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form 


V 


+ +«'•»-,(X)) 


+ *. 


IJt- 


+ fl'^H'4(x)a + fl^H,(x)J, (2.7) 


which, in addition to nonlinearity cancellation 
terms, contains a linear state feedback pan with 

constant gains A,-A,. These gains arc 

chosen to place at some desired stable liKations 
the roots of the characteristic polynomial 


j" + A^r""'+ • ■ • + A,.t + A,-(I (2 K1 


To verify that the control law (2.7) is 
implcmentablc on B, x first observe that 
(/3(x, d)|>A by assumption (2 4) Second, and 
this is a characteristic of the extended direct 
scheme, note the presence of the time derivative 
d of the parameter estimate d. It may appear 
that the implementation of (2 7) would require 
differentiators. Fortunately, this is not so As we 
shall see, the parameter update law foi d will 
furnish d as a known c.\plicit function of 
available signals. To design this update law. we 
substitute the control (2.7) into (2.fi) and obtain 


x„ = (^(x, d)K'f(x) + d'wdi ))(u - d) 

. -U. 

Then we introduce the following compact 
notation: 


parameter update bw 

d d)/»i« PR’ (X, d)/*v(x. d). (2.1,1) 

where r IS a positive definite malru (“adaptation 
gain") and P>() o chosen to satisfy the 
Lyapunov equation 

/. (214) 

To conhrm that the update law (2 1.1) leads to a 
diflerentialor-frev implementalHUi of the feed¬ 
back control (2 7). let us rewrite (2.7) as an 
explicit lunclion of the available signals x and d: 


X (A,X, 4 + A,(X, 4 d'w,(x)) 

4 d'w,(x ) 4 d'a'd l ld 

4H'(x)rW''(»,d)PV'(X.d)l (2 1.1) 

Our ncxi lask is lo prove stability and a 
convergence pto|HMty of the adaptive scheme 
consisting of the state equation (2 12) and the 
parameter u|)daie law (2 13) 

/.emmu I The equilibrium i ^ d » a, of the 
scheme (2 12) (2 13) is stabic (or every ae 
Moreover, there exists a set ft c R""'* such that 
from all (iOM, d(l)))c ft the state i(f) converges 
to zero 


lim i (0 ' 0 (2 16 ) 




-Ti 



1 


1 



- - 


A - 


0 

-/C) 


/ 

A„ 


( 2 . 10 ) 


W(x. d)== lV(V'(.i, d), d) W(x. d) 

0 • • 0 

0 ■ ■ 0 

w,'(x) 

L/)(x, d)K f(x) 4 d^Kd-l) J 


(2 11) 


In this notation, the system with feedback 
control (2.7) is rewritten a.s 

x=Ai-t-W(i.d)(a-d). (2.12) 

This “error form" shows that asymptotic stability 
i.s achieved when the estimate d is correct. 

bccau.se (2.8) is the characteristic 
polynomial of A. We now prove that, even when 
d^fl. stability will be achieved with the 


/Vfirt/ Differentiating the Lyapunov function 
l'(t.d)-i'Pf 4 (« d)'l '(a d) (2 17) 
ailing the solutions of (2.12) (2.1.^). wc obtain 
V * f '{A'r 4 PA )f 4 2i 'PlV(.f, d)(« d) 

2d'r '(« d) 

- |l,*‘ir 4 2\x'Pf^iS. d)V d'lf '(n -d) 

= -||f|!''.0 (2 18) 

This proves the stability of the equilibrium i » 0, 
d ■= a The convergence result (2.U>) now follows 
from Iji,Sallcs invariance theorem, by which 
(f(f), d(f))~» Af as f—where M is the largcwt 
invariant scM of (2 12) (2.1.1) contained in the net 
{(i,d):f = 0} where V = 0. Finally, in view of 
(2 18). the function Lfifi), d(f)) is nonincreas¬ 
ing and. hence, a subset of ^ is the set 

= ((f. d);F'(i,d)^.r), (2.19) 

where c is the largest constant such that 

Qv- = {(X, d): V'(ic(x, d), d) sc) c B. x B. 

( 2 . 2 ( 1 ) 

□ 
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Our (ifial task ih to prove the same stability 
and convergence properties for the actual 
adaptive system 

x,~ X,, 1, 1 i I r n . 2 

I = + u'wM 

x„ >= (a d)'wj{x) ~ , 
ftU. a) 

(2 21) 

X |/c,x, •»-+ k„x„ + M H',(x) 

+ d V,(jt) -t d'w^ix )d 
+ w-'(x)riV'(x, d)r\i){x. d)j 
d^rw'(jc. d)/Xx.d), 

This system differs from the scheme (2.12)- 
(2.1.1) only in the last stale, which in the scheme 
i.s jf„. while here it is x„. To determine the 
equilibrium x^ d^a of the system (2.21) 
which corresp<inds to the equilibrium x ~ 0. 
d » a of the scheme (2.12) (2.1.1), we note that 
at X| - X; * ■ • ■ x„ I 0 the equation 

I - x„ t a'K'|(x) ^ 0 (2.22) 

has, because of (2 4), a unique solution x' for 
each a c h„. A direct substitution proves that 

J '.,:(()... 0 t;)'. d-a (2.21) 

is the equilibrium of (2 21) corresponding to 
X - 0, (i ” (X 

Thvarvm 1. The equilibrium x x' . a - a of the 
adaptive sysfein (2.21) is stable for every (J t 
and the set defined in (2 20) is a subset of its 
region of attraction Moreover, lor all 

(x(()). d(0))( iii . the suite x(f) eonverges to its 
equilibrium value i', that is. 

Iim x(t) “ x‘ (2.24) 

Proof Ixmma 1 proves the stability of x - 0, 
d u. On the other hand, the mapping 
(x. <i) ♦ (x. u) IS one lo-one. onto and con¬ 
tinuous and It maps the point (x", fv) to the {lomt 
(0,«). This proves the slubilily of x x' , a - a. 
and. furthermore, implies that the solution (x(t), 
d(r)) of (2.21) for any (x(0). d(0)) e iij is 
uniformly bounded and remains in /f. x for 
all r 0 l>iftercntiiition of x„ i - x„ ^ x) in 
(2.2) and the use of (2.(S) gives 

,x„ , ^ [v 4 ^l) 

4 d ^ H'd V) 4 rt ^ Hx{x )ij (2.25) 

Recall that all the functions appearing in (2 25) 
are smcKilh on x including, because of 
(2 4). the contrtd v as expressed by (2 15). 
Therefore. ,(f) it mIs 4> uniformly bounded and 
x^ ,(r) is uniformly exmlinuous. From (2.1b) wc 


have 

liinx,. ,(f) = x, ,(0)^-Um [ i„_,(r)dT = 0. 

(2.26) 

By Barbalal’ii lemma (see, e.g. Sa,stry and 
Bcxlson (1989, p. 19)], the uniform continuity 
and integrahility of x„ .,(f) imply 

limx„ .|(r) = Iim (xji) + a^Wt(xU))) = 0. 

t t ^ X 

(2.27) 

Combining (2.16), (2.22) and (2.27) with the fact 
that W|(x) is a smcKith vector held, we conclude 
that 

limx„(/)=x; (2.28) 

t X 

□ 

1 ROBUSTNEISS K) UNMOOFLtU) DYNAMIC S 
Ilie Stability results in ihe preceding section 
assume that, up to a set of unknown constant 
parameters, an exact model of the plant is 
available. A crucial question to be addressed m 
this section is whether, and to what extent, these 
stability properties are preserved in the presence 
of unmodeled dynamics. As m some earlier 
works on adaptive control, such as loannou and 
Kokotovic (19H3) and Taylor cr al. (19S^), the 
unmodcled dynamics are assumed to be fast and 
arc treated k\s sinf^ular pvrfurhatums, that is, the 
change of model order is purameteri/.ed by a 
sc:alar p When p >0, the unmodeled dynamics 
are included and the model order is higher than 
assumed in the adaptive scheme design When 
^ “ I), the unmodcled dynamics vanish and the 
model reduces to the assumed design model. In 
applications, the parameter ^ is used to 
represent small inertias, inductances, time 
constants etc , as illustrated by many physical 
examples in Kokotovic et al (T9Sb) 

.Starting with the design mmlel in the special 
form (2 2), we perturb it in the following way 

.X, == X, ,, , 1 i i. n - 2 

X., ,-x„+a'H',(.t) 

,r„==^<i'Ks(r)+ r'(.t)c+^'i(x)u 
M; = 4 g.( x)w, 

where is the state of the unmodeled 

dynamic's, and the entries of r(i), Q{x), gi(x) 
and g:(x) arc smtxith functions on fl,. Within 
the framework of singular perturbations, the 
simple form of unmixlelcd dynamics included in 
(3,1) is sufficiently general, because, as shown by 
Kanellakoptiulos (T9K9), other perturbed ver- 
.sions of the general mixlcl (2.1) can be 
transformed into (3.1). The relationship of (3.1) 
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with the unperturbed design nuKlel (2.21 will 
become clear after the change of variables 

^ = A(jt. li) 4 r). (3,2) 

which exhibits the function 

h(x.u)= -Q-\x)g.{x)u (3.3) 

as the quasi-steady-state of «. and q as its fast 
transient. The unmcxleled dynamics arc assumed 
to be a.symptoticaUy stable for all hxed i € fl,. 
that IS, there exists o, >0 such that 

Re AfCXx)} - a,. Vr e /f, (3 4) 

Tliis. in turn, assures the existence of fj ‘(x) in 
(3.3). Along with the change of state variables 
(3.2). we introduce the following change of the 
control variable 

1' = U-|(.t) r'(x)C^ '(.»),C:(.v)lu -g(»)u (3.5) 

and assume iha! there exists o, > (I such that 

Vx e fl, (3.h) 

rhese changes ol variables transform the 
perturbed model (3.1) into 


where (?(i. d) (>( >) ^(i- r(x 1)^ 

and A(i. (i. I). a) s A(i. d. I), (i) To verify that 
i =» 0. d - a. rj « 0 is an equilibrium of (3.V). we 
return to (3 3) and (3 8). Then, with the help of 
(2.15). we define 


>i(i'. d) = /i(». * ) 


' Kf*) i<») 

A‘(f, d, 1), a) 4.(f. d)jf 4 fi,i(x. dfd 


and see that A 11 at .r » 0. d tt. On the other 
hand, for r;(I the first two equations of (3.9) 
represent the unpcriurhcd scheme (2 12)-(2 13). 
which has an equilibrium at i (I, d For 
simphcily, we now make the additional asxuiiip' 
lion that K,(tM ■ h,( 0) ^ (1. Under this assump 
lion i (I implies x (I, that is. the equilibria of 
the adaptive scheme (3.9) and ol the adaptive 
system are the same, and. tunhermivre. 
Vi ((), d) ^ 0 tor all d e H„ 

As in Tayloi rt al. (1989). the stability of the 
equilibrium i - 0. a a, fj - (I of (3 9) will be 
investigated using the compiiMie I ywpunov 
function 


i, “ .V,, 1 . 1 ' i - n 2 

A, i x„ ^ a\){x} 

.1,. ^ V a w-ix ) ^ r (t )r/ 

^iff - Q(x)fj uh{x, a, rj, a ), 
where Ihe lime derivative 

^ ^1, fin > r 4 hj^ (VH) 

y. y 

IS expressed as a function o\ a, d, r/ and u Ihe 
expression lor a as a function of x, a, r/ and v is 
given by (3 7). while the expressions for v and o 
as funelions of A,d. r/ and o can be obtained 
from (21.^) and (2,13). 

It IS now obvious that for rf - (t. the [XTturbed 
model (3 7) reduces to tfie assumed design 
model (2 2) However, when p '0. wc cannot 
expect that r/(r) - 0 even if r/(f)) - 0. fHrcausc. in 
general. h(x\d. rj,a) is not /.ero As wc shall 
see, the stability properties established by 
Theorem 1 will be preserved if the term 
p/i(A . d. r/. a) is sufficiently small The analysis 
leading to such a result retraces the derivations 
of Section 2 for the p<.*riurbcd model (3 7) 

The adaptive scheme for the pcriurfKd model 
(3 7) employs the same control (2 13), the same 
ufxJatc law (2,13) and the same notation (2,lb). 
(2 11) as in Section 2. Tlic resulting adaptive 
scheme with unmodcled dynamics is 

X “ Ax H'(i, d){a - d) ^ /?(i, d)r] 
fl-nV'(f. a)r.f 
fit] - (}(x, fl)rj| - ixh(x, d. Tf. a), 


f'.li, li. 1/) 4 ili'/*r I (II rtl'r V u)| 

4 < ,r)'/\(i, djrj. (3 11) 

where <1 and c., are )>oMiivc constants and 
/*(», «) IS the jHisitivc definite solution ol 

fl)C)(», d) 4 (}'(i. <i)/* (1. d) I (3 12) 

Die time derivative ot V' along the solutions of 
(3 •J) IS 

V' - . ,1 I'r 4 liTRii. d)if| 

4 ( q'ri 4 r/'/*,(i. d. tj. ajr/ 

d)h(i. d. rj. u) (3 13) 

Ihc function /i, as defined in (3 10), satisfies 
A(0. d, 0, a) - () (or all a. d x H„ Mcnee. it is 
bounded by 

||A'(i, d. t], n)||Hill 4 ||r;|| (3.14) 

where the constants />,, fi . arc such that for all 
X € W,, d ( //„, a ( li„ the following inequalities 
hold: 

l|A((i, d)Vi'(i, d)(a d)|| ' ^i„|li|| (3.1.5) 
llA,(i. d)A 4 kiii. d)r)V'(i. d)/'!| 4 ^,,,5 

(3,16) 

!l/i((i. d)/((jf,d)||4:pj, (3.17) 


(3,9) 


Furthermore, wc chfHisc con.slants c,, r, and r, 
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which satisfy 

2||/^,(i,d)||p,sr, (3,18) 

2||/^^(i,i3)||*c, (3.19) 

2 \\/^,a. d)|| f), + \\P,(i, a, rj, a)|| sc, (3.20) 

for all X e (fl e i) e a € 

A stronger effect of the fast variable r; 
manifests itself as an increase in the values of Ci. 
C 2 and r,. 'ITiis is particularly clear for 
because C) bounds the matrix k through which tf 
enters into the adaptive scheme (3.^). Cimstants 
C] and show the effects of r/ through the 
properties of the I-yapunov matrix kf. Using the 
bounds (3.14)-(3.20), wc obtain from (3,13): 

^s-(||i|| \\r,\\] 


Tills bound leads to (he following robustness 
result: 


Throrem 2. Tlie equilibrium x - 0, d - a, r; - 0 
of the perturbed adaptive system (3.7) with the 
feedback (2.15) and the u|Hlate law (2.13) is 
stable for every a € and for every satisfying 

{)< ^ .-i- (3 22) 

(‘,r> f r ^ 

with CipC;, i'\ as defined by (3. lH)-(3,2()). A 
subset of its region of attraction is the set 

11, ® ({x, d, r/): K(V'(^, d). d, r;)--< ). (3 23) 

where r is the largest constant such that 
11, c ft, X X ft^. Moreover, for all (.i:(t)). 
d(0), r/(0)) e 11., and f ((), ^i*). the state 

(jr(r), r/(r)) converges to its equilibrium value, 
that is 


limjr(r)-0. limr|(r)^ 0. (3 24) 


Proof. If (3.22) is satished, the matrix m (3,21) 
is positive definite and thus K is negative 
semidefinite, This proves the stability of the 
equilibrium i 0, iS « a, r/ ^ (1 of the perturbed 
adaptive scheme (3.9). Hence, the equilibrium 
x«(), r; ^ 0 of the j>crturbed adaptive 

system is stable and an estimate of its region of 
attraction is the set 11, in (3,23) Furthermore, 
the largest invariant set of (3.9), contained in the 
set where F, « 0, is the set {(i. d, r/):i - 0, r/ = 
0). TTic convergence result (3.24) then follows 
from LaSalle's invariance theorem and the fact 
that lim f(f) = 0 implies lim Jt(0 (V 

f—» -m *■ [3) 


It may appear that Theorem 2 requires a 
detailed knowledge of the unmodeled dynamics. 
In fact, even when nothing else is known about 
the unmodeled dynamics other than that they 
arc fasi and stable in the sense of (3.4), Theorem 
2 still provides conceptual robustness bounds. 
Whatever the unmodeled dynamics, some 
strictly positive constants C). and, hence, 

fi* exist so that the stability of the closed-loop 
system and the regulation property (3.24) arc 
preserved for all q s 

In applications, a more detailed description of 
the unmodelcd dynamics may be available. For 
example, the dynamics of some known parts of 
the system (e.g. actuators and sensors) may have 
to be neglected in order to make the system 
appear in the .special form (2.2). (In the next 
section, a motor position control system is 
brought to the special form (2.2) by neglecting 
the fK)wer amplifier dynamics.) 

For a specific application, the time constant 
is known and the bounds (3.14)- (3.22) can be 
used to first determine a region ft^ x fl„ x ft^, 
and then evaluate the set 11, in which the 
proposed adaptive design is applicable On the 
other hand, if 12, is a design specification, then 
the above bounds can t>e used to determine 
the required time con.slanl fi It is pointed 
out, however, that these bounds are conserva¬ 
tive. Following the outlined procedure, tighter 
bounds can he obtained by taking into 
account details of the problem al hand 


4 Dl.SC ILSSION AND I XAMPIJ S 
In this section we stress the practicality of the 
results in the preceding two sections by applying 
them to a common control problem. Wc then 
di.scu.s.s a further extension of these results. 


Example 1. Po.sidon comrol of a DC-motor with 
uncertain load torque and unmodcled dynamics. 
In normali/cd units, the position control system 
is described by 


dft 

dr 


U) 


d(u A 


d/ 

dr 




'(-CO - /4^) 


di 


(4.1) 


where ft, (ji, i and c are the motor position, 
speed, and armature current and voltage, 
respectively, while the control variable is the 
input u into the amplifier with constant gain g. 
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The uncertain load torque is represented hv a 
weighted sum of some known nonlinear 
functions to) with unknown constant 

weights ti,, / = 1 . p. For illusiiative purposes 

we lake p = l and w,,(6l, to)»w*. The ratio 
T,/T„ of the motor electrical and mechanical 
time constants was neglected in Taylor et at. 
(1989) in order to satisfy the strict matching 
condition. Here this quantity is retained in the 
model, and the singular perturbation parameter 
is the amplihcr time constant p. 

The control objective is to regulate the motor 
position and speed to the desired constant values 
^ and to = 0. Denoting ji , = « - 

X 2 = to, = t, we rewrite (4.1) in the form of the 

perturbed mtxlcl (3.1): 


The perrurbed adaptive scheme (3.9) is 

.», »■ jt. 

i}»i, + (41, ~ <l,)j:i 

ix » -ti*, ■ tj-tj ~ kx£\ + (d, ~ d,) 

7 14,7) 

X IS.Jj + TJ 

=» rvi'').?, d,)Pc 

fit} ^ - rj ku. 

Tht largeM inv»nun( %e\ of the j^ihcnir (4 7)* 
comained in the set where V] « 0 (^ce (3 21)), it 
the MTi ((i, Wj, f}) X 0, r; « 0}. Thus, our 
?M:hcfnc achieves regulation of the Mate 
iiU). rj(r)) 


i, = X2 

T 

Xx =• yi-x. - X, + ?) 
f*> = - RU. 


(4.2) 


The change of variables (3 2) is now £ ~ gu + rj, 
.St) that h - Ru, h = gii, and the perturbed model 
(4 2), rewritten in the form (3 7), becomes 


i, - X: 

ij = » , + 0|J; 


X 1 ” - ( 

T/ 


x,^ f'u 4 r;) = r 4 j rj 


(4 3) 


fAii= -rj - 


As our design model (2.2) we use the first three 
equations with ?; ^0. 7he meaning of this design 
model IS that the amplifier is replaced hy its 
constant gam g and the voltage gu is applied to 
the motor armature. The design now prtKccds as 
in Section 2, Using 


i, ^- xi 4 dixi (4 4) 

and noting that assumption (2.4) is irivially 
satisfied* we design the control (2 7); 

i' = 4- k^Xi /cii, 4 2dlX2X^ 4 a^xl] 

(4.5) 


This results in the update law (2.13) with 


Remark 1 Vhe adaptive scheme presented in 
this paper can l>e further extended ii» include the 
case where unknown parameters enter the 
control vector field (In the above example, this 
w<3uld rnreur if the ratio were also 

unknown ) A detailed analysis of this was 
presented in Kanellakopoulos et al. (1989), I'hc 
main difference from the casi^ treated in this 
paper is that the update law (2 13) deiKiids on 
the control variable v. I’hercfore. i* and A arc 
defined impitatly, and can fx‘ cxpresSiHl as 
explicit functions of f and cl only in a region S 
around the equilibrium f ^ (I, d a The 
boundaries ol this solvalnliiy region are the 
manifolds on which the Jacobian of the implicit 
function defining r is singular As an illustration, 
consider the following example 


Example 2 I he system 


X| - (10 4 0)4 .. 

4_, ■“ <5 4 (10 + fl)l) 

(4 K) 

IS controllable for a / 10 following the 

development of Sectnm 2. we use 

ij ~ (10 4 dU: 

(4 9) 

1' , 1' X| (1(1 4 d)x^ 

(1(U43)-' 


■ OJ ; 4 ( 10 4 fl)l J) 

14.10) 

and reduce (4 8) to the error form (2.12) 


i, ^ d) 

jf j - - X, “ i; 4 (10 4 d )v(a d ), 

(4.11) 

which is exponentially stable for d » 
Lyapunov function 

a. The 

V{x, d) - 1 5jr; 4 4 -4 (u - df 

(4.12) 


0 

ITfi. W(x, fl,)- (4.6) 

L2^i-»3 J 


rc)iul(.s in the update law 

6 - 1.5x,Xj 4 0.5(10 4 d)x] 4 (10 4 43) 
X (0 .5x, 4 (10 4<3)Xj)u. 


(4.13) 
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E{quation<i (4.10) and (4.13) implictly define v 
and i us functions of x and d. Bliminuiing a, we 
get 

(10 + r3)((IO 4 d) f Jt (0 5jr, f (10 4 d)Jt,.))o 
- ii ” (10 *4 d)ji2" 1 -5jt jjrj 

40.5(10 4 dljrJ. (4.14) 

lo obtain v explicitly, the term multiplying it 
must l>c nonzero, which means that the adaptive 
scheme is defined only in a solvability region 
.V c X By inspection of (4.14), a subset of 
.V is, for example 

((jc,. .x;, d):|.r, <2, |5 4 d| < 3). (4.15) 

□ 

Remark 1 (ctml'd). In general, the solvability 
condition for systems mentioned in Remark 1 
requires that in the formulation ol all the results 
of this paper, siarting with the region of 
attraction estimate iiy in (2.20), the set H, x fl,, 
be replaced by the solvability region S c 
W, X An approach which avoids the implicit 
definition of i' and a was proposed by Pomet and 
Praly (IWJb). f or (4 K) this approach consists in 
treating the |>arameter a appearing in the term 
(10 4 n)n as a second unknown parameter h to 
be estimated separately as h. As a result of this 
overparametri/ation, the update law tor d no 
longer depends on n. which now appears in the 
definition of h on\y. 

Remark 2. Por simplicity, all the results in this 
paper are given lor the regulation problem 
However, with stanilard technical modilications, 
the extended direct scheme can be used for the 
tracking ol a given reference by the (uiipiil 

y« ii of the system (2 2) Moreover, zero 
dynamics can be added lo (2 2) under the same 
assumptions as in Sastry and Isidori (1080) Of 
course, the invananee theorem of LaSalle d(»cs 
not apply this nme varying problem, and the 
prtHils ol (he tracking analogs of Lemma I and 
Lheorem I employ the standard uniform 
coruinuity argument and Harbalat’s lemma 
Details and further extensions can be found in 
Kanellakopoulos (1080) lo achieve robustness 
of the tracking scheme lo unmodcicd dynamics 
and Ixiunded disiurbanees. one t>f the update 
law modiheiilions proposed in adaptive linear 
control, such as the d-modificaiion of loannou 
and Kokoiovie (1083). can be used If this simple 
rT-miHlifieation scheme is used, robustness 
properties analogous tv) those established for the 
linear ease in Fheorems 5 2 1 and h.5 I of 
loannou and Kokotovie (1083) can be shown to 
hold in the nonlinear ease. 


5 ( ONCLl SIONS 

Ilie goals of the adaptive scheme proposed in 
this paper—simplicity, applicability lo a wider 
class of nonlincarities and robustness to unmod- 
elcd dynamics—have been achieved under the 
extended matching condition. Although this 
condition restricts the dct>endcncc on the 
unknown parameters, it is satisfied by many 
systems appearing in engineering applications. In 
a manner similar to that illustrated by hxample 
I, the extended adaptive scheme is applicable to 
switched reluctance (Taylor, 1088) and per¬ 
manent magnet stepper (Bodson and Chiasson, 
1089) motors, and to other electromechanical or 
clcctrohydraulic systems with load and power 
input uncertainties. It would seem, therefore, 
that when the extended direct scheme is 
applicable, it should be given preference over 
more elabrirate schemes. Lor problems to which 
this scheme is not applicable, the choice, or the 
development, of an appropriate scheme is a 
topic of ongoing research (Sastry and Isidori. 
1080; Pvimel and Lraly, 1080a. b; Baslm and 
Campion, 1080. ( ampion and Hasim, L>00) 
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APPENDIX THE EXTENDED MAT( HIN<, 
roNDinoN 

Consider the sysicm 

7 =■- /„(7 ) ♦ ^ 0 , 1(7 ) r u(f i*), r c R ” (All 

i X I 

with /,,(0) “ U. )^(0) #0, smiHiih vcclor hcKK 

m ( , u neighhwuhtMx] i>f the i>rigin 

herdhavk Itnean^onon conduitm ITic disinbuHons 

A, . <id\j(„\, (J- t ' n ■ 1 (A 2) 

arc mvolutivr and ol conslant rank i 4 1 in L, 

Extended matching condition 

f,f A,, \- I’ p (A 3| 

Troposition 1 There cxisls a Male feedback control 
u - in l\. and a slate space change 

of ccHirdinatcs i - ^(r) in f 'e . with ^((1) 0, such that 
the system 

^ ;„(7 ) 4^ )(i(r ) 4 )/i( r )!' i ^ a,fjz ) (A 4) 

hccc>mcs in the i ccxirdinaies 

i, - Ji,. n ' ^ ^ 

X„ ™ V -4 ^ * 1 


if and only if the feedtsadk tincamaticm (A 2) ai*d the 
extended matdung ( A Vl cxMidliiion* air MAttahed 

Proof 

StfjpicIt IS proven m Su (1MH2I that condition (A 2) 
IS Mifhcient for the eusiencr ol a lumtion #,(?! f' • H with 
the proprrucft 

( 1 ) (dfi, adl .. 

a cTunge of coordinates in /t^och Ural the sysiem 

: « fj7 ) ^ ) I A b) 

lirtTimrs in the new csHudmnirs 

7, 

1. - I ;*.,(••» •* I ,J l 

Hv usinp the state Iredbm k (recall that I V ■ t 

f.'") 

^ I ^ I'l oUM 4 /l(r )v. (A HI 

Che system (A hi l>eomirs 


In the new csHudmatcs i i|»(;|. the distrit>iilion is 


\p 



(A m 


and ccmdilion (A 3) implies that 


/.(<»■ 1" '> •‘.,(•1 “...(Ol'. 1 

1 • /I , 1 A 1 1 1 

where 


‘(a)) 

(A 12) 

a;,fl ) 1 fj '(» U 

(A )\| 

In conclusion, the stale Icedback (A K). 

«p|ilic;<) 1)1 ihr 


system (A I). rrsulis m 


fnin 


I,..'I 


K,i< •• I 




a, f, f: ) 




I'- 


lA 14) 


When cxprrsMcd in the new coordinates i ' K the system 
(A 14) iHrtomes (AS) 

A>fr(.ii/v II there exist a niair feedback and a change of 
ecxirdinatcs transforming the system (A I) into the system 
(A 5). one can dirrtlly verify that rhr conditions (A 2) and 
(A 3) are vaiislied lor the sysiem (A 5) Since the omdilions 
(A.2) and (AT) arc invariani urwlcf siafr Iredbtick 
transformations and changes of cooidinates. they arc 
satisfied for the system (A 1 ) 11 
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A New Stable Compensator Design for Exact 
and Approximate Loop Transfer Recovery'^ 

B M CMEN t A SABKRlt and P SANNimt 

For minimum phase MIMO systems, a l/IR design is presented via a new 
compensator which kv stable and which allows much lower gam and thus 
lower controller hand-width than the conventumal observer based 
controller. 

Key Wofdi l.ixip fr^inslcr iraivcry. roKusi lonitol. Iiiic«if quiiiliaiit fiuuii^si4in Ihcurv 


1—In *hts puper. a new compcMisaior Mrviciurr k^r 
l(x>p transfer recovery (I.Tk) is pro|His<d l“hc pit>poM‘iJ 
compensator (u) is open knip stahlc. (h) Ruaraniccs 
ckwed-UH>p stahility anil above all (i) requires rnueh smaller 
values of gam than the conveniional oinerstr biiscd 
controller for the same degree of Uvop ir.insler lecovcrs Ihe 
fact that the new coinpensatot requires much smaller values 
of gain than the conventional controller results in scveial 
practical advantages, the most im|>ortani among them being 
the reduction in controller band width and Ircedorn Irom the 
woes of saturation Lhc iradc-ofl Ix'iwcen the Vidm ul grtin 
and the degree of liMip translcr recovery as well as the 
bounds on singular values of scnsjtoily anil complemeniais 
sensitivity functions is shown clearly Both lull and retiuced 
order compensators for I I R when the design sjxxilKaiions 
arc reflccteil cither at the input or iit (he output pitni ol the 
given plant arc coiisidcrcd Numerical cxanqdcs illusiialc the 
advanlages of the new compensator siructun 

T'hc new comj.xrnsalor struct lire is iiispiicd In a l, ireful and 
clear understanding of how liKip translcr lecmctv miurs 
when convcnimnal observer based corurolkrs ate usctl In 
motivate and deduce our new corn|X'nsatnr sirmiurc, a 
unified ircaimcm of observer thcorv for I I R is presented In 
the context of such a unification some ne\s results are also 
given 

1 INTROni'CTION AND PROHITM SfAITMlM 

In MUi n iNPi 1 and mulii-oiiipui (MIMO) feed 
hack control system design, performance sfKcih- 
cations such as command following, diMurhance 
rejection, closed-loop band-width, stability ro 
business with respect to unstructured dynamic 
uncertainties etc . are naturally posed in the 
frequency domain in terms of scnsitiviiy and 
complementary sensitivity functions Theve sen^ 

• Received 28 September revised 24 April I'^Mi, 

received in final lorm 14 May 199*1 Dk' original version o( 
this paper was not preivcnied at any IFAC' meeting llris 
paper was recommended for pubhuilion in revised form by 
Associate Exlilor V Ku6cra under the direction ul kditor If 
Kwakemaak 
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Washington State Lmvcrsitv, Pullman. WA 99|b4-27S2. 
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t Department of Electrical and ( ompuier I nginecring. P O 
Box 909. Rutgers lioiversiry, Pis£:ataiway. NJ UHHVS-TMW. 
USA Author to whiHn all ctmrevpondente should he 
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sitiviiy and cornplcmcntary scnsiliviiy functions 
arc related to the h>op iransfer matrices 
evaluated by breaking the control Untp at critical 
points, commonly either the input or (mtpul 
(>oii;t of the given plant Recent results have 
shiiwn that the formal mat hematic ill svnthesis 
procedures ban'd on linear quadratic (iaussian 
(I.O(i) with loop transfer recovery (i rR). the 
so called LUCi/I. I R techniques, provide a broad 
flexibility in achieving the necessary ItKrp 
iransfer matrices. IXJfi/l.lR technique is 
essentially a two-step approach and involves two 
scpdiatc designs ol a linear quadratic regulator 
and either an observer or a Kalman filler based 
controller (Athans, 19H6; Stem and Alhans, 
19H7) I'he exact design prtKcdurc depends on 
the fKiint, either the input or the output |K>int of 
the plant, where the Unrp is broken to evaluate 
the opcn-l(Kip transfer matrices. Wc will first 
concentrate our discussion on the case when the 
l(H)p IS broken at the input f>r>im of the plant. 
Dual discussion can tx" given for the case when 
the loop IS bioken at the output point Thus in 
the two step prcKcdure of LOCi/LlR, the first 
step <*f design involves l(H)p shaping by stale 
feedback design lo obtain an appropriate hnip 
transfer function, called lhc target Imrp Iransfer 
function. Such a loop shaping is an engineering 
art and often involves the use of linear quadratic 
regulator (l.OR) design in which the cost 
matnees are used as free design parameters to 
generate the target IcHip Iransfer function and 
thus the desired sensitivity and complementary 
sensitivity functions However, when such a 
feedback design is implemented via an observer 
(or Kalman biter) based controller that uses only 
the output feedback, the obtained Uxrp transfer 
function, in general, is not the same as the target 
l(K)p transfer function, unless proper care is 
taken in designing the observers. ITiis is when 
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the second step of ‘I R ilesign philosophy 

comes into picture In this step, the required 
observer is designed so as to recover either 
exactly or approximately the l(H>p transfer 
function of the full slate feedback controller. In 
this paper, we focus our attention on this second 
step of design, 

LIR has been the subject of many papers 
f'hc heart of the LIR problem can easily fn! 
underslom) by considering the closed-loop 
structure depicted m Kig 1 where C(,v) and l*{s) 
are respectively the transfer functions of a 
controller and the given plant (iiven P(s} and 
the target loop transfer lunclion /.(jm). the goal 
IS to design a (‘(s) such that is eilher 

exactly or approximately equal to when 

the performance specifications are reflected at 
the input point All the existing literature 
chooses cither a full or reduced order observer 
based structure for the contr4illei in which the 
slate feedback gain /’ and the observer gam K 
are incorporated and K is a tree design 
parameter In tins paper, we propose a new 
compensator siriiclurc lor the controller. This 
structure is inspired by a clear and careful 
understanding of the error or mismatch function 
(;,(v)/Mv) where is the 

transfer function ot an (observer based controller. 

We now briefly review the (»hscrver based 
MR theory to motivate the need for new 
controller structures other than observers. 
(Consider a given plant. 

\ A K ♦ Hu, \ ' ( \ (11) 

where x, u and v are respectively n , and /» 
dimensional state, input and output vectors 
Assume that H and ( are of maximal rank and 
thill (I I) is siahili/ahle and detectable l et / he 
a slahtli/ing full state feedback gain matrix such 
that (a) the closed-loop system is asymptotically 
stable and (b) the open-huip transfer function 
when the loop is broken at the input |ioinl of the 
plant meets the given frequency dependent 
s(K'cificali4ms The slate feedback control is 

fx (12) 

and the open hKip transfer lunetion when the 
loop is broken at the input |V)ini is 

/.(T) - (13) 

where (v/ A) V 


-^•^ 1 C(s) I *— 


Fk. I PCml conirallcr cioscU Uh>p »,oaliguriuion 



COH'NOi LIN 

t It* 2 Plani wuh tul) ortlcr% oinerver havetl cnnlrollcr 


Ihc inlcresl next is to design an observer 
which implements (12) using only the output y. 
and at the same lime reetwers the target loop 
transfer function T(0 I el us first consider a 
controller based on a full order observer, 

U “ Id - / x (1 ^ ) 

where 

X - (A K( )x f Hu + Ky (1.5) 

Here K is the observer gain matrix. I he block 
diagram ol Fig. 2 illustrates the controller 
implementation. It is important to note that the 
framework of observer Ihetiry requires that the 
control input to the plant be also an input to the 
observer so that the stability of the observer 
error dynamics is guaranteed I'hc transfer 
lunetion ol the observer based controller, i.e. 
the transfer function from the output v of the 
plant to u IS 

Cni.v) ” / [d* ' 4 KC 1 Hf‘\ 'A. (l.h) 

and the open-loop transfer function when the 
|(H>p is broken at the input point of the plant is 

/,,(.v) - CAs)Pis) (I 7) 

where P{s) ( ^VH. Unis the error or mismatch 
between the target itiop transfer functum /-(.s) 
and that realized by the observer implement¬ 
ation is 

T„(.v)-T(.s) T„(.s). (1.8) 

For square invertible systems, (icH>dman (1984) 
showed that T„(j4/0 ~ 0 ifT 

AI()n>)-() (1.9) 

for all (II where 

' + ) '/?. (1.10) 

(lornlman's result can easily be generalized to 
cover left invertible systems as well. Thus exact 
loop transfer recovery at the input point 
(ULTRI) is possible iff (1.''^) is satisfied while 
approximate I.TR at the input p<nnt (AL.TR1) is 
pi>ssible if the .si/c of M(jw) (in some norm 
sense) can be made arbitrarilv small for all w. 
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Equation (L^) can be given a phvmnl 
interpretation. Considering the observer based 
controller as a device with its output as a and 
inputs as u and y, it is easy lo sec that 

i(J) - (4) ' ^ AX:) 'flu(.V) f (4) ’ ^ X(’) ») 

and 

M(v) ^ -Fx(s) 

== ”M(^ )w(.v) - E(4> ’ 4 K( ) 'Kyi%) 

(1 in 

In view of the condition (19), equation (1 11) 
implies that the output u of the observer based 
controller does not entail the feedback from the 
control signal u. However, the translcr function 
from u lo i is in general non /eri^ even when 
M{s ) IS zero. 

In practice, the condition MUio) i\ cannot 
always be satisfied exactly 1 he only rectnirse is 
then to make the si/e of Af(jrtj) m some sense 
small for all Let the gain K be parametcri/ed 
m terms of a scalar or a vector parameter and 
be denoted by K(a). Ihus lor Al IRI. one 
needs to obtain a A'((J) such lhal, 

^ K{o)C\ 7r--*o 
point wise m a as o x (112) 

The condition (1 12) invokes the stale leedback 
gain !\ However, in order to have the slate 
feedback aiid observer designs lo he irulefx'nd 
cni of one another, one needs lo require that 

(9> ’ 4 point wise in v as o * >, 

(I 1.7 

which is a sutlicient condition lor (1 12) 
bs.senliailv there exists three methods of 
obtaining such a K(a) In then seminal work 
Dovie and Stem (1979) and others later on 
(Madiwale and Williams, I9KV. .Sogaard 
Andersen, 19S7b. Matson and May beck. 19K7) 
explored Kalman tiller formalism (or asymptotic 
LOfi theory) in which additional ficlicious 
process noise of intensity propiriional to n is 
injected into the system through the input into 
the plant and then the gain Kio) is calculated by 
solving the resulting liller Riccaii equations 
Sogaard-Andersen (19K7a) prop<'scd observer 
cigenslruclure assignment techniques More 
recently. Saberi and Sannuli (19HH) prof>oscd an 
asymptotic pole placement method which gener¬ 
alizes the earlier mcthcxls while simplifying the 
computational task in obtaining A((r). In all 
these Al.TRI design methods. i!A(rr)(i--^x as 
Si} that (1.13) can be satisfied asymptoti¬ 
cally Thus all these are high-gain schemes. Ibis 
implies that any ALTRI design scheme should 
include a trade-off between the required 
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robustness properties of the closed-loop symem 
and the mzc ot the feedback gam Ibe size of a 
feedback gam is very critical m marry cii- 
cumstances due !i» unavoidable controller band¬ 
width constraints Ibus a cursory exploration ol 
the literature mdicaies a definite need to develop 
dynamic compensators, which would preserve 
closed-loop stabihly and at the same lime 
achicse Al TKI without requiring large amounts 
of gam In this papt‘r. we proix>sc such a jw'hemc 
of developing dynamic compimsaiors ol order 
either n (full order) or n m (reduced order) 

(.)ur ccnirai observation is Ihi.s When one is 
rcsiricicd to ihc framework ol irbserver theory, 
the link Irom the control signal n to (he observer 
via (he control distribution matrix H is always 
present in the design configuration such as the 
one depicted m big 2 In these tibscrvers, when 
A((i) IS appropriately designed to achieve 
Al IRK the clfcci of the alxivc control link on 
the iniipul ol observer hascti controller (namely 
lif) Nanishes asymptotically as n ♦x However, 
the effect of above link on i m general is 
non/cr(» and hence the need for the above link in 
the conventional observers Based on this 
discussion, wc arc inspired lo remove the above 
mentioned link siructuraliy right from the 
beginning ol ihc design In other w^ords. to 
develop an apprtiprialc coinfK'nsaloi of order n, 
we consider (he configuration illuslruled in Fig 
3 Once the link from the control input lo the 
controller or what is now called a rornpensalor, 
IS removed we embark on a new design 
philosiiphv which is outside the realm ol 
observer ihetirv and hence ihe strpuralion pnn- 
cipic IS no longer valid Without the bucking r>f 
blessing of the separation principle, one hits lo 
prove that the design objectives of closecMtHip 
stability and recovering the target loop shape can 
Ixiih be simultaneously achieved. We intend to 
do exactly this 

Our design philosophy is deceptively very 
simple Except for structurally omitting the link 
mentioned earlier, our aimpcnsator is cxacily 
the same as Ihc conventional observer-based 
controller. Wc plan to obtain a A(o) such (hat 
(a) - K{o)C has all its eigenvalues in the left 

half V plane (i c Ihc compensator is opcn-Uxip 
stable) and that (b) the condition (112) is 
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satinfied asymplolicalty as for this 

purp<m\ wc can use any of the existing meihcxls 
of obtaining such a K{o). Titus our ajmpensator 
design parallels in all respects the conventional 
observer design except for omitting the link 
mentioned earlier. Although our compensator 
structurally differs from the observer in a very 
simple way, it has a profound effect on the gain 
required for closcd*'l(K)p stability and for 
ALTRI. We show theoretically that for the same 
gain, the difference between the target kmp 
transfer function and the one achieved by our 
compensator is always much smaller than that 
that can be achieved by the observer based 
controller, But since our design method is also 
an asymptotic methcHl, the above theoretical 
result docs not reveal the whole story, Ihc proof 
that our method works is evident from our 
examples. Wc have solved numerically many 
examples that appeared in the open literature, 
and noticed that the amount of gain required for 
the same degree of recovery by our compensator 
is orders of magnitude less than what is required 
by an observer-based controller. I'his obviously 
has a profound impact on the practical 
implementation of LOG/I I R schemes Some 
specific attributes of our compensator are as 
follows: 

1, Low values of gain obviously results in low 
compensator band-width, and hence much of the 
output noise that oceurs at relatively high 
frequencies is filtered out fTirlherniore, low 
values of gain relieves the design from ever 
present wiws of saturation fo emphasi/e this, 
wc refer to Sogaard-Andersen and Niemann 
(IW9) who recently studied the design iradc-offs 
between the level of loop Irarvster recovery and 
the necessary gain required by an observer based 
controller. A major conclusion of their study i.s 
that the target loop transfer recovery ilesign 
cannot always be achieved even when modest 
and practically meaningful constraints are 
imposed on Ihc si/e oi the observer gain 
Furthermore, contrary \o what has been 
discussed in the litcraiurc (e g Friedland, LIH6; 
Baumgartner rr a/., IMHb). their study indicates 
that a high-gam from conlri^ller input ii> 
controller output affects the entire control-hHip 
and in particular the control noise signal ratio 
and the control command signal ralio, 

2. Sincx* the given plant is of inmimum phase, 
it is always piissible to design an oixm-lwp 
stable compensator to guarantee the over all 
closcdTiXip stability (Vidyasiigar, P^S5b). Our 
dCsSign results in an open-kmp stable compen¬ 
sator. The advantages of having such a 
compensator cannot be over-emphasi/.ed As is 


known (Shaw, 1971), open-loop unstable com¬ 
pensators result in p<K)r overall sy.stem sensitivity 
to plant parameter variations. Furthermore, 
physical realizability of open-kx3p unstable 
compensators is rather difficult, 

Our discussion so far has been concerned with 
a full order observer-based controller and that 
tooonly with the case when the target open-kx^p 
transfer matrix is specified at the plant input 
point. Similar discussion pertains as well to other 
cases; (a) when a reduced order observer-based 
controller is considered and (b) when a target 
open-l(K)p transfer matrix is specified at the plant 
output point. Hven when a reduced order 
observer-based controller is used, wc observe 
that exact or approximate LTR is possible if and 
only if the transfer funciion from the* point 
where the input u of the plant is fed to the 
controller to the output point Q of the controller 
is either exactly or approximately zero. Thus 
again, our compensator structurally (i.c physi¬ 
cally) omits the link from the input point of the 
planl to the controller right from the beginning. 

The paper is organized as follows In Section 
2, wc consider convenliorial observers and while 
reviewing the existing theory, some clarifications 
and generalizations of it arc presented. This 
section motivates the work lhal follows. Sections 
.1 and 4 respectively develop the lull and reduced 
order compensators when the target open-loop 
transfer matrices arc specified at the planl input 
point, while Section 5 dualizes the results of 
Sections 3 and 4 for Ihe case when the target 
open-loop transfer matrices are spvccilied at the 
plant output point Section b deals with 
numerical results on some representative ex¬ 
amples from the lilcralure. I'hrcmghout this 
paper, /T denotes the transpose of A, / denotes 
an identity matrix while /* denotes the identity 
matrix of dimension k x k A(A) and Rc[A(/\)] 
respectively denote the set of eigenvalues and 
real parts of eigenvalues of A. Similarly. 
and respectively denote the maximum 

and minimum singular values of A. I he open left 
half plane is denoted by f 

: REVII W OF l IH VIA OHStRVl^RS 

The purpose of this section is to re-examine 
how LTR cKcurs when either full or reduced 
order ohserver-hased controllers arc used. This 
is done in order to obtain a better intuition and 
understanding of the theory of observer-based 
controllers for LTR so that our new compen¬ 
sator design, discussed in Sections 3 and 4, can 
easily be motivated and inspired. In this process 
of review, the condiiioms for achieving either 
exact or approximate LTR (ELTR or ALTR), 
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when either full or reduced order observer based 
controllers arc used, are brought to the same 
frame work, i.c, the observer-based controller 
theory is unified into a single frame work Such a 
review and unification leads to several ne>s 
results. For example, no method of determining 
gain for full order observer-based omtrollers 
exists in the literature for the case of achieving 
ELTR. Here an explicit method of determining 
such a gain is given. Also, both the cases when 
the loop is broken at cither the input or the 
output point of the plant are considered In 
short, this .section summarizes, generalizes, 
unifies and in some cases clarifies ihe existing 
results on LTR using conventional observer- 
based controllers. 

2.1. Full order ohsen>ers —FL TKI and A I. TRl 

We will first consider the full order observer- 
ba.sed controller when the targe! open-loop 
transfer matrix is evaluated when the loop is 
broken at the input point of the plant F.Js), the 
error between the target loop transfer funelion 
L{s) and that achievable by the observer based 
controller of Fig. 2 is given by (I K) In the 
observer design. K is the only fiee design 
parameter, forsl of all in order to guarantee the 
closed-loop stability. K must be such that 
A - KC IS an asymptotically stable matrix, i e. 

Rc(A(A AO)- () (2 1) 

The remaining freedom in choosing K can then 
he used to achieve I I R In an allempi lo find 
such a K, Doyle and .Stem (1974) first gave a 
sulficicnl condition. 

K{I i C<i>K) (2 2 ) 

under which fc,,(j<n)0 for all to. 1 o undersland 
the implications of (2.2). following Kriediand 
(19K6), wc rewrite it in an equivalent way. In 
view of the identity, 

«I)A(/,, + f <I>A:) d* (d> ' + A'( ) 

we have 

•DAf/p + C 4»A) 'C'd>» =- (<!> ' + AO 7f 

Thus, (2.2) implies that 

fO ’ ^ KC) -0 (2 3) 

However, due to the nonsingularily of ‘ + 
KC) \ (2.3) implies that But this is 

impossible in any real system. Thus the sufficient 
condition (2.2) cannot exactly be saiishcd at all 
However, (2.3) can asymptotically be satisfied 
for large gain without requiring B - U 

The above discussion reveals that the condi¬ 
tion (2.2) is p(K)rly suited lo study the liKip 
transfer recovery problem Realizing this. 


(jiHKlman (1W4) picKeeclcd to look at directly 
the error or mismatch function CnHKlmafi 

studied square mvertibk systems llie following 
two lemmas represent minor extensions of 
(kxHiman s results and ancr as well left 
invertible systems 

l^mnui 1. /;,,(>), the error between the target 
loop transfer function L(\) and that rcali/cd by 
the full order observer-biised cxmirollcr ol Fig 2 
rs given bv 

lUs) - > Mis)) 'iL s (2 4) 

where 

\f(.s)-Kd‘ '4 A( ) 'H, (2 5) 

Lrmma 2 

/ - n ill M(}U)) >• 0 (or all ii^ f U 

( 2 - 6 ) 

where V is ViC sci of all 0*lor which 
/.„(lfr)) and I are well defined (i e all 
required inverses exist) 

Thus equation (2 4) presenis a clear persfHHiivc 
to study the basic mechanism by which both 
exact and approximale I I R occurs It is clear 
that M IRI IS achievable if Af(jro) “O exactly 
and on the olhei hand Al I Rl is achieviihlc if 
fji)| can be made arbitralily small for all 
(If In order to investigate when ci,„„,|M(jfM)l can 
be made either zero or arbitrarily small, 
assuming A K( is nondelective. (iiH>dman 
[see also. Sogaard-Andersen, (l^)H7c)) expands 
M{ \) in a dyadic lorin. 

" W 

Af(»)-]l 0 7) 

. 1 ' A, 

where 

R, - FWy^/B 

Here superscript // indicates the complex 
conjugate transpose. Also, W'] and V, are 
resfX'ctivcIy the right and left eigenvectors 
associated with an eigenvalue A, of A K( and 
they arc scaled so that VVl^ where 

W - |U ,. IV , , 

and 

i ' |v '.. F,.v :,i 

In view of lA’mma 2. 1:1 IKI is po.ssible iff 
Af(j (/}) ■ 0 for all (o. rhis is the case iff (or each 
I - J to n, cither /Ai' 0 or V^^B ^ or l>olh- 
Since F is designed to satisfy the required loop 
transfer function. - i} is gcncncally not 
satisfied One can fry t<» satisfy V^^B i) for as 
many indexes i as possible However, ii is n(»t 
possible to design so that V^^B * 0 for all 
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indciics, i 1 to n l^i us tnvesiigate how many 
left eigenvectors of A - KC can satisfy = 0. 
Lxt and rif be respectively the number of 
invariant zeros and infinite zeros (Sannuti and 
Saberi, \W1) of the given plant In general 
n„ n " rif We have the following result. 

Lemma 3 For a left invertible plant, there exists 
a gain matrix K such that at most a total of 
n " ft/ left eigenvectors i/, / 1 to n - n^, of 
A - KC can satisfy the condition - 0. Also, 

of these n Hf eigenvalues are same as the 
invariant zeros of the plant while rtf, » n - rtf - 

eigenvalues can be assigned freely Further¬ 
more, those left eigenvectors of A - KC which 
arc associated with the invariant /eros arc same 
as the left zero directions of the plant 

/Voo/, See Shaked and Karcanias (IM76); Saberi 
and Sannuti (IMKK) 

Lemma 3 implies that the maximum number 
of indexes i that satisfy V*/B -() is equal to the 
difference between the dynamic order and the 
number of infinite zeros of the given plant i he 
minimum number of infinite zeros is m and this 
happens for left invertible systems when all the 
infinite zeros are of order one, i.e. when CH is of 
maximum rank (Sannuti and Saben, Then 

in view of Lemmas 2 and 3, LLTRI in general is 
impossible It is possible only under some special 
circumstances. (Joodman gives the following 
result 

Lemma 4, i.et A KC' be a noiidefectivc matrix 
with left eigenvectors L], i - \ to n, such that 
- 0 for / equal lo any n - m distinct indexes 
among I lo n. Then () for all nf e is 

equivalent to / B * (I. 

Ixmmas 3 and 4 culminate in the following 
theorem. 

Theorem 1. Consider the closed-UH)p system 
comprising of the plant and the full order 
observer-based controller as in Fig 2. Then both 
asymptotic stability of the closed-knip system 
and Ll/rRl can l>c achieved under the following 
conditions; 

1. TB^ il 

2. 'Fhc given plant has all its infinite zeros of 
order one (i.e. C'B is of maximal rank). 

3. ITte given plant is left invertible and has all 
its invariant zeros in the left half a plane (i.e. of 
minimum phase) 

Moreover, a constructive method of obtaining 
a gain K to achieve both clo.scd-liH)p stability and 


ELTRI can be given under the above three 
conditions. Such a gain K in general is 
nonunique and belongs to a class of gains 
denoted by J(^. 

Proof Under the conditions given in the 
theorem, a method of calculating the class of 
gaijns is given in Appendix A. 

Remark 1. There is no method whatsoever in 
the literature to obtain the observer gain K that 
achieves EITRL Although this paper is not 
intended in general to give methods of obtaining 
K, the constructive pr(H)f of Theorem I yields 
one such method. 

Remark 2. It is important lo realize the 
implications of the condition FB “ (J. 
Apparently, it restricts the class of loop transfer 
functions L{s) that are attainable by full slate 
feedback. In particular, under the condition 
FB - 0, 

FAB 

L(s) - F(l>B -; , 

.1 * 

implying that ||T(j^^0ll niusl have at least a 
roll-off of 40 dB per decade with respect lo It 
is well known that whenever the state feedback 
gain F is calculated by LOR theory, |iT(jm)|| has 
only a roll-off of 20 dB per decade with respect 
to 0 ). Thus the use of l.QR theory is then ruled 
out to generate the target loop transfer function. 

Since FW ™ 0 severely restricts the class of 
loop transfer (unctions that are achievable, most 
of the exi.sting literature focu.ses attention on 
AI/I’RI methods. In these Af.TRI methods, one 
tries to find a gain K such that (1.13) is satished. 
As we discussed earlier, the gain K in this case is 
parameterized in terms of a tuning parameter a 
Satisfying (1.13) is a sufficient condition to 
render o,naj^f(jn0| arbitrarily small for all (u. 
At lirst, Doyle and Stein (1070) gave a sufficient 
condition under which (1.13) is true. Their 
condition is as follow's: Let F'(tj) he chosen such 
that as K{o)/o~*BW for st^mc non- 

singular matrix W. I'hen, (1.13) is true and 
consequently ALTRJ is achieved as 
There were several attempts later on to weaken 
the Doyle™Siein condition (Madiwale and 
Williams, 1085; Matson and Maybcck, 1087; 
Saberi and Sannuti. 1088). It is well known that 
in order lo satisfy the Doylc-Siein condition, 
one requires only that the plant be left invertible 
and be of minimum phase. Thus in comparison 
with the sufficient conditions for ELTRI as 
stated in Theorem L one finds a drastic 
relaxation of the required conditions for ALTRL 
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As far as the design of K{a) is conceincd. 
presently there exists three different methods: 
(1) asymptotic LOG methtnls. {2) asympiotic 
pole placement methods and (3) eigcnstniciuic 
assignment methods. An exhaustive companstm 
of all these three methcxls is given in Sahtri and 
Sannuti (19K8). All these pnK'cdurcs aim at 
obtaining a gain K such that (a) some of the 
observer eigenvalues cither coincide or are close 
It) the zeros of the given plant and that the 
asstKialed left eigenvectors satisfy the condition 
cither exactly or approximately, and 
(b) the remaining observer eigenvalues are 
placed far m the left half \ plane so that the 
corresponding R,/(\ - A,) in ihe dyadic expan 
sion (2.7) are approximately zero In other 
words, all these melhixls lind a gain K such that 
ni)] is arbitrarily small for all ur Thus 
the term M(a) plavs a dominant role in I I R 
I'he following result summari/es this discussion 

Theorem 2. ( onsider the closed loop system 
comprising of the [ilani and the full order 
observer based controller as in Lig 2 Let Ihe 
given plant be lell invertthlc and be of minimum 
phase, rhen a gam K{n) can he designed such 
that both asymptotic siahility of the ci(»sed loop 
system and ALI'RI can be achieved Such a gam 
K{o) m general is noiumujue .mil ixhmgs lo a 
class of gams denoted by 

Proof. See Saberi and Sannuti ( 

Lei us nexl examine ihe eigenvalues o( the 
observer based controller Fhese eigenv alues are 
given by 

AI/I Ki Hi 


ever, in practice the value of o needed for (he 
desired degree of recovery might not yield an 
asymiptotically stable avntrollcr In facL this is 
(he case in most practical pmhlems 
As discussed alx>vt\ most often one opts (or 
ALTRI design as it requires levs viringciil 
conditions than 11 TRI design In Al IRI, the 
level of recovery dc|x*nds on W(pi»)l 

However in order to render small, 

one needs lo increase the tuning parameter a 
which Itself increases the gam A(o) Thus as 
discussed thoroughly bv Sogaard* Andersen and 
Niemann (there is a (uiidamcntiil trade off 
between the level t)! recovery and the size of 
gam. This iratle off can lx visualized m a natural 
way in terms ot the iradc-ofl biMwccn the 
singuiai values of scivsnivity and complementary 
sensiiiMtv functions and the singuiai values of 
V() li?) rhe reason for this is that the robust 
siabilitv and noinmal pc^rlormance id a system 
are directly rellceieil m the singular values of 
sensittviiy and cornplemenlarv sensitivity fune 
lions, whereas Ihe level of iccovery (i e the size 
of / IS directly dependent on Ihe snjgular 

values ol With tins |XMni m view, 

Sogaard“Andersen and Niemann (19Hd) derive 
some analytical ex(nessions lor the discrepancy 
between the desired and the achieved sensitivity 
and e4implemenlary sensitivity funelions Let 
\(.0 and fo(v) Ih‘ the achieved sensilivily and 
eom,-lemeniary sensiiiviiy tunciinns in the 
cunliguialion ol I ig 2 when the loop is broken 
at the input point ot the plant 

\.fA) |L. ^ C „ls)/M.vir 

and 

L IL. 4 C\,(s)Z'(s)| 


These eigenvalues arc not riecessaiih m ihe left 
half A plane for all K Id siudv the nature ol 
these eigenvalues, consider ihe following 

det |.v4, A f KC f Hh \ 

- det |v/, - A 4 KC\ 

X det {!„ f (a> ' ^ K( ) 7fA I 
~ del I v/„ A K( \ 

X del [/„, 4 ^(q> ^ t K( ) 'H\ 

- del i\A, - /I 4 AC I 

xdet[/^-4;M(s)| (2S) 

Thus whenever ELTRI is achieved, i e. when- 
ever the controller eigenvalues are 

given by A(/l AC ) Hence the observer-based 
controller is asymptotically stable On the other 
hand, m the case of AI TRI, the eigenvalues of 
the full order obserser-hased controller oh- 
viously approach A( A “ AC ) as o How- 


whetc (',,(v) IS as given in (1 ti) IaM (v) and 
/, is) be the sensitivity and etimplenientary 
sensiliviiv tunetinns eorrespniHlmg to the target 
loop-shape The lollowing lemma is a slight 
gcnerali/alion ot the results of Sogaard- 
Andersen and Niemann ( 


Temnui 5. ( onsider the corihguration of I ig 2 
We have the following bounds on all singular 
values r “ 1 lo m of A,(jr<d and /(,()ru) 


ia,|s;,()0<)) n,|\()«')li 




and 


■ cM (J<» 




Ihe expressions given above can lx* used lo 
analyze the inevitable trade-off between ginxl 
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Pin. 4 Plant with reduced order oNcrver huficd coritrollcr. 


rcaivcry as indicated by o,„,„[M(iu))] and 
robustness and performance as reflected in the 
sensitivity and complementary sensitivity func¬ 
tions. To do this, Sogaard-Andersen and 
Niemann (1989) developed s«»mc recovery 
diagrams. 

Before closing this section, let us note that 
M(s) plays a central role in every single result 
given in this section. 

2.2. Reduced order ob feniers — El. TRI and 
ALTRI 

Now let us consider a reduced order observer 
based controller as in Fig. 4. Without loss of 
generality, let us assume that 

C = |/,..0| 

and hence the plant (I I) i.s in the form, 

ii - AitXi 4 >4irX> 4 BtU 
II I 1. . I 

^ A 4 AyyX: 

(2.1(1) 

Also, let the state feedback gain matrix h which 
achieves the target loop transfer function 14 s) be 
partitioned in conformity with (2.^) as 

- (2.11) 

l..et “ /4||) * and ^ (.v/„ ,, - 

/Iv.) V It is then straightforward to derive the 
following relationships; 

P(s) ^ C4>fl « 4>n»i <P,,A,,/i;(.0. (2.12) 

L{s) - F^B - f,P(.v) + F.W^v), (2.13) 

where H^is) is the transfer function between u 
and Xi, i.c, //;(.T)M(.r). where 

(2.14) 

'Phe reduced order observer equations 
(O'Reilly, 1983; Madiwale and Williams, 1985) 
are given by 

(115) 


with 

Xi-y and Xy-Kry^Zj, (2.16) 

and with the reduced order observer based 
feedback control law as 

u ~ u - "FjXi - F-iij- (2.17) 

Here Kr is the reduced order observer gain and 
the matrices A^, H, and arc given by 

Ar “ A ^2 f^rA = Bl " KrBy , 

(i^ — A22- K^Ai2^r A 21 -- 

Now in order to bring the theory of full and 
reduced order observers to the same frame work 
and to understand the conditions lor either 
ELTRI or ALTRI clearly, we present the 
following results which are analogous to Ixrmma.s 
1 and 2. 

Lemma 6. fc,,^(.v), the error between the target 
l<K>p transfer function L{s) and that realized by 
the reduced order observer-based controller of 
Fig 4 is given by 

f:,„(.v)= M,(.n.)(/„, 4 MAs)) '{!„ 4 E<t>R). (2.19) 

where 

4 FVA,.) (2.20) 

Proof. See Appendix H 

Remark 3. The expression for /:„,(' ) identical 
to the corresponding one when full order 
observer-based controller is used; see (2.4), 
except that now M^v) takes the place of M(.s ). 

Lemma 7. 

F,„(j<'^) “ A'fr(j^**) " 0 ftll ^ 

(2.21) 

where is the set of all O'^ fu< '* for which 
and /.(j(/>) are well defined (i.e all 
required inverses exist) 

Proof. I'he proof is obvious in view of L-emma 

As m the ease of a full order observer, a 
physical inlerprelaliori can be given to the term 
Af^(.0 It is straightforward to show that 

-u(s) - Af4.y)M(,v) 4- [f, 4- F2(^22 ^ 

K^,2)^CL^KAs)]y{s). 

Thus we note that Af,(,v) is the transfer function 
from u to "li. Hence as in the ease of a full 
order observer, whenever the .size of M^(5) is 
small, the effect of the link from the input point 


^2 *= A ,.52 4“ Gr)' 4- B^u 
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of the plant to the observer, on u is small In 
view of Lemma 7. the question now is when and 
how MrijO)) can be made either exactly or 
approximately 2 ero for all We note that. 

B, » B: “ KrB^ - 0 , (2 22 ) 

is a sufficient condition for to be 

identically zero. Unlike in lull order obser\ers. 
the condition (2.22) involves K, and hcncc there 
is a possibility of solving (or K, from it 
Sogaard-Andersen (WH7b) under the conditions 
that (a) the given system is square and invertible 
and (b) B^ is nonsingular, solves lor A,, 

»:», (2.23) 

It turns out that a gain A, which salishes (2,22) 
and thus achieves ELI R can be obtained under 
much relaxed conditions. We have the following 
result analogous to Theorem 1 

Theorem 3. C onsider the closed-ltHip system 
comprising of the plant and the reduced order 
observer based controller as in I ig 4 Fhcn both 
the asymploiic siabiliiy of ihe closed‘l(H>p system 
and ELI Rl can he achieved under the following 
conditions; 

1. The given plan! has all its infinite zeros o( 
order one 

2. given plant is left invertible and is of 
minimum phase 

Moreover, a constructive method o( obtaining a 
gain Kr to achieve both EI IRI and asymptotic 
stability of the closed-loi»p system can he given 
under the above two conditions Such a gain A, 
in general is nonunique and belongs to a class of 
gams denoted by 

Proof. Under the conditions given in the 
theorem, a method of calculating the class of 
gains IS given in Appendix C . 

Remark 4. When reduced order ohscrvci based 
controllers are used, the condition /7i - 0 is not 
necessary However, while full order observer 
always results in a sinctly proper controller 
transfer function, the reduced order observer 
based controller has a nonsinclly pro|>cr transfer 
function. As discussed by Khalil (19H1,I9H4) 
and by Vidya.sagar (19H5a), a closed-loop system 
with a nonstriclly proper controller is not robust 
under unmodelled high frequency dynamics 

Remark 5. Madiwale and Williams (I9H.S) gave a 
sufficient condition for ELTRE 

A.(V^ + - B, (2.24) 

There is a one to one correspondence between 


(2.2) and (2 24), In the same way as we showed 

(2.3) IS equivalent lo B ^ 0. we can show that 
(2.24) IS equivalent to W, 

Since in genera) cannot exactly \k made 
zero, one Uk^uscs attention on AITRI That is. 
one needs 

.M,(s) ~ ^ AT^vIA.*) '0 

l>ointw'ise in s as o , 

where the gam A,(fi) is now para met enzrd in 
terms of a tuning parameter n However, as in 
the previous section, in order to have the state 
feedback and observer designs to Ik independ¬ 
ent of one another, one needs to require that 

(♦:V 4 A,(o)A,7 ‘W, poinlw'isc* m v 

as o X (2 25) 

lo design such a Ajd), Dowdle et aJ (1982) 
study a restrictive clas.s of systems where all the 
first Markov parameters of the given plant arc 
zero. Such a severe rcsinction on the given plant 
is not imposed m Madiwale and Williams (1985), 
instead they require that certain matrices are of 
full rank and a ccriam subsystem of th<‘ given 
system IS of minimum phase Rased on 
asymptotic 1 X )(i methods. Sogaard-Andersen 
(19K.Sb) studies the general case without any 
restrictions Since Sogaard-Andersen divides it 
into three diflercnl cases, his analysis and design 
besides being not unified becomes unnecessarily 
inveivcd Sabt'fi and Sannuli (19K8) give an 
explicit method of calcuiaiing the gam A,(o) 
which satisfies the condition (2 2.S) In (ad. (hey 
convcri ihc problem of designmg ihc reiluccd 
order observer for ihc given plant mio that of a 
full (uder observer, however, for a reduced 
order subsystem of the given plant. 

I'hc abijve discussion can be summan/ed as 
nicorem 4 which is analogous lo I'heorem 2 

Theorem 4. C onsider the closed looj) system 
comprising ol the plant and the reduced order 
observer based controller as m I ig 4 Let the 
given plant be lell invertible and be of mininuim 
phase rhen a gam Ado) can l>e designed such 
that both asymploiic stabiliiy of Ihc closeddcHip 
system and Al l Rl can be achieved Such a gain 
A'do) in general is nonunique and belongs lo a 
class of gains denoted by 

Proof. Sec Saben and Sannuti (1988). 

Ixl us next examine the eigenvalues of the 
reduced order observer based controller These 
eigenvalues arc given by 

MAj: - KrAyj B.f}) 
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ITiesc eigenvalues arc not ncccsfiarily in the left 
half i plane for ail K,. As in (2,8), we can show 
(hat 

(Jet \.%l„ ,, “ A 22 ^ KrA M 4 Wjj/'j I 

del [i/„ „ - An ^ K^A u] det (/^ -f Af,(i)l 

(2 26) 

Ihus whenever EI/IRI is achieved, i.c. 
whenever M,(v) “0, the controller eigenvalues 
arc given by A(AJ and hence the reduced order 
observer based controller is asymptotically 
stable On the other hand in the ease of AITRI, 
the eigenvalues of the reduced order observer 
based controller lend to A(A/) as 
However, as in full order observers, the value of 
o needed for the desired degree of recovery 
might not yield an asymptotically stable control¬ 
ler. In fact, this is the case in most practical 
problems 

Now as in I.cmma 5, we would like to develop 
bounds on the sensitivity and complementary 
sensitivity functions generated by the use of 
reduced order observer based controllers I.ct 
and 7„,(.v) be the generated sensitivity and 
complementary sensitivity functions in the 
configuration of l ig. 4 when the loop is broken 
at the input point of the plant, 

.V,„(v)-(/„. + C,„(v)/*(.v)J ' 
and 

/;„(') = L 

- + (:,„(.v)/'(.v)| 'C,„(,v)/’(,v) 

where C„,(.v) is the transfer function of (he 
reduced order observer based controller We 
have the following result analogous to Lemma 5 


Lfmrna 8. ('onsider the configuration of f ig. 4. 
We have the following bounds on all singular 
values / ^ 1 to m of .S,„()nO and 7,,,( jni): 






and 




I* 


/Voo/. See Apfxmdix I). 

13. Full and reduced order observers—liLTRO 
and A L TRO 

The target opcn-liHrp transfer functions can be 
designed when the l(X>p is broken at either the 
input or the output point of the given plant 
defending upon the given s^xcificaiions. We 
have discussed so far LTR recovery at the input 


point, either exact or approximate type (ELTRI 
or ALTRI), using either full or reduced orcicr 
observer-based controllers. Now we would like 
to consider LTR recovery when the loop is 
broken at the output point (Kwakernaak, 1%9). 
Tliis method is used when the designer 
specifications and the modelling of uncertainties 
arc reflected at the output point of the plant. In 
the literature, it is commonly said that LTR 
recovery at the input and output points (LTRI 
and Ll’RO) arc dual to one another. This 
duality is well understood in the case when full 
order observers or Kalman fillers arc used in the 
controllers. That is, in the ease of LTRO, the 
first step is to design a Kalman filter, via Imp 
shaping techniques, whose knip transfer function 
meets the design specifications. The next step is 
to recover this Kalman filter loop transfer 
function via ITR technique However, this kind 
of duality is not well underslcK>d when reduced 
order observer based controllers are u.sed. For 
instance, Sogaard-Andersen (1987b) who has 
contributed much to the development of reduced 
or minimal order observers for LTRI makes the 
following comment; “The loop-shape formulation 
used here requires that the uncertainties and 
performance specifications arc reflected to the 
plant input Unfortunately similar results for the 
plant output cannot be derived since the 
minimal-order observer and the plant model are 
not dual ' The confusion arises here because the 
duality is sought between the plant and the 
observer. The proper way is to .seek the duality 
in the design methodology and when this is 
done, contrary to the staterncni of Sogaard- 
Andersen, minimal order observer based con¬ 
trollers can be designed lor LTRO as well. In 
other words, one needs first to clearly define the 
duality in a mathematical way and then needs to 
interpret the implications of it as to the 
controller implementation. In order to avoid any 
confusion, we give below a formal step by step 
algorithm to show how duality arises for LTR 
recovery at the input and output fKiinls. 

1. Let the given plant model 1 be charac¬ 
terized by the triple (A, B, C ) where A, B and C 
are respectively n x n, n x ni and p x n matrices, 
l^t 1' be of minimum phase and be right 
invertible implying p Also, let 7^(,v) he the 
transfer function of the plant X, 

P(s) = C(sl,-Ay Ui. 

Let L(s) be the required target open-lcxip 
transfer function when the loop is broken at the 
output plaint of the given plant. Thus, in the 
configuration of Fig. 1, we are seeking a 
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(X^nirollcr C(5) such that H](o) is either exactly 
or approximately equal to P(ja>lC(|iii) 

2 Define a transpi>scd system mtxJel 1, 
characterized by the triple M,. fl,. ( ,) where 

A,^A\ C\^B\ 

Note that since 5- is of minimum phase and right 
invertible, Z, is of minimum phase and left 
invertible Also, note that P:(s), the transfer 
function of the plant 1, is Let L,(x) be 

defined as 

LAs) 

3 For the purp<isc of design alone, consider 
the fictitious plant 1, as given m step 2 Then 
design a controller C,(v) such that €A}(i>)PAp^*) 
is cither exactly or approximately equal to 
LA](^t) For this purpose one can use either a full 
or reduced order observer based controller 
design of Sections 2 1 or 2.2 In fact one can also 
use any other comf^ensator design schemes such 
as those to be described m Sections 3 and 4 We 
note that the dynamic order ol C,(.v) is either n 
or n m depending upon either full or reduced 
order observer is used for the controller design. 

4 Define a controller ('(v); 

C( 0 - C'(.v), 

We note that the dynamic order of C( v) is same 
as that of VAs ) 

Ihcn It can be shown trivially that the 
controller (’(v) deMgned above and implemented 
as in Fig. I achieves either FJ I RO or ALI KO 
deperuling upi)n whether (Mn) in step 3 is 
designed to achieve f.Ll KI or Al IRI for the 
hctitious plant 1, 

^ Fil l (mi)l K (OMPF NSAIOK f I IKI AND 
Al l HI 

In this section and the next, we prevent our 
main contributions 1o start with, let us recall 
the concept of I TRI Ciiveri the plant transfer 
function /'(v)^Cd>/f and the target loop 
transfer function L{\} one warns to 

design a controller with transicr (unction C(v) 
such that C()(/>)r()o)) is cither exactly or 
approximately equal to /(pa) I he only 
Ciintroller that is available so far lor this purpc^sc 
IS observer based. As reviewed m the last 
section, in observer based com rollers, M{s) 
plays a central role in the recovery prcKcdurc 
Numerical experience show's that m order to 
achieve a satisfaclorv degree of recovery, large 
values of gam in general are required by the 
observer based controllers In an attempt to 
reduce the size of required gams, one then 
naiinrallv seeks new structures for the control¬ 


lers. The phym4»l meaning of the transfer 
function Af(,f) m explained in the last section, 
leads us to examine the ohserver based 
ctmiroller structure m which the link from the 
input point of the plant via the cxmtrol 
disinbution matrix B lo ihe amtroller is 
removed. Such an omission of ihe link generates 
a new structure f(»r ihe ctmlrollct which wc now 
call a conifH'insalor. Because of the omission of 
the link menitoned earliei, the celebrated 
separation principle is no longer valid and hence 
the pro[H‘ilies of the compensaftvr as lo 
closed l(M»p siabiliiy and achieving I I R have to 
be examined carefully This is ihe pur|>ose of this 
section and the next 
( onsider the dynamic compensiiior. 

(A K( ): 4 K\\ ( 3 . 1 ) 

1/u L: ( 3 2) 

Vhe only unknown matrix m (3 1) is K which is 
considered a a lice design parameter llie 
compensator transfer limction (i e , the ttansfer 
(uruiiun Irom y to ii) is given by 

r.(v) f {<P ' f K( ) K (3 3) 

We would like lo ilesign K to salisly Ihe 
following conditions 

I. Suihility oj the i loM'd linip system Lhc 
closed-loop system as depicted in Fig 3 and 
chanietcn/ed bv (1 1), (3.1) arul (3.2). is 
asymploiically stable, i c 

Rc|4(A,,)1- I). (V4) 

where 


2 LI TRI or AI TRI I he achieved Imip 
transicr function /.,()(/>), 

I , (|fa) ’• C p/l), (3 h) 

IS either exactly or approximately equal to 
Lijio) 

3 Open-loop stability of the ((fmpen' 
sator Fhe cornpensahir is open hnip asymptot¬ 
ically stable, I e 

Re 1A(A /v'f )|' 0 (3 7) 

The ahiive three conditions are important from 
technical point of view. However, merely 
determining K to satisfy the above conditions is 
not enough because our primary goal as staled 
earlier is lo come up with a scheme which 
requires smaller values of gain than the observer 
based controller to acliieve the same level of 
I.TR In what follows, wc show that our new 
compensator structure does exactly this. We first 
give the following lemma analogous to L^cmma F 
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l^mma 9. E,{s), the error between the target 
apcn-kK>p tranftfer function L(s) and LAs), the 
one realized by the compensator, is given by 

EAs)^Mis). (3„H) 

where 

U AfC) (3.9) 


selected as an element of and hence M{s)» 0. 
It is also evident that the compensator is 
open-loop asymptotically stable. Next, the 
closed-loop stability can be proved as follows, 
llie dynamic matrix of the closed-loop system is 
given by (3.5). Then consider the following 
reductions; 


Proof. 

LAs) lAs) - LAs) 

‘ 4 ^ K( ) ^KC]^H 
^ F{^ ' ^ KC) 'IL 

Remark 6. Observe that M(s) defined here is 
exactly the same as the one defined earlier for 
the full order observer-based controllers, sec 
(2.5). In view of this, the two expressions for the 
error between the required and the achieved 
kK)p transfer functions, one for the conventional 
observer-based design (2.4) and the other for the 
new compensator design (3.K), differ sig¬ 
nificantly. This as we shall see later on in 
Theorems 7 and 8 leads to an overwhelming 
advantage in favor of the new compensator 
approach. 

Since M(s) defined here and in the case of full 
order observer based design is one and the same, 
we naturally .sec that ELT'RI or Al.TRI is 
achievable by the new compensator under 
exactly the same conditions as in the previous 
case. That is K has to be an clement of either 
for fcLT'Rl or an clement of HAo) for ALTRI. 
However, the stability of the closed-l(K)p system 
has to be separately examined. We have the 
following theorem. 

Theorem 5. Consider the closed-loop system 
comprising of the plant along with the 
compcn.salor as in Fig. 3. Then Inith the 
asymptotic stability of the closed-loop system 
and ELTRI can be achieved under the following 
conditions; 

1. FB^i). 

2. The given plant has all its infinite zeros of 
order one. 

3. The given plant is left invertible and is of 
minimum phase. 

Moreover, under the above conditions, K can be 
selected as an element of Also, the 

eigenvalues of A,f are given by A(A KC) and 
A(A - BF). Furthermore, the developed compen¬ 
sator is always opcn-kx)p asymptotically stable. 

Proof Under the conditions given and in view 
of the Theorem L it is obvious that K can be 


det [5^2^ - A,A - det 
= det 

= det 

= del 


sl„-A+KC -KC 

BF 

sI„-A 

4 , • 

-AC] 

(p ' + BF 

D ■ 1 

4> ‘ 

AC 1 

BF D ’ 

4 ACJ 

D ' 4 BF 

D ' 

BF 

D ' 4 AC 


(3.10) 


Now using Schur'.s formula for calculating the 
determinant of a partitioned matrix, we have 

del (j/jn - A,i] 

= det 14> ' + KC\ 

X det [4) ' 4 BF - <D ‘(<I> '4 AC) ‘fl/'l 
= dct|4> ' 4 A'C’|dct|«t '] 

X det |/„ 4 <1>BF - («|) ‘ 4 AC) 'BF] 
==dct(<D ' 4 Ar|dct(«I> 'I 
xdet IJ„ 4 |4>tf - («I> ‘ 4 AC) '«)A),(3.11) 
Now using the identity 

det |/„ 4 =- det |/„, 4 .4,/t,] (3.12) 

for any n y m and rn x n matrices A, and A >, 
det l-v/^ - A,,\ 

-dctl4> '4AC |det(4> '] 

X det {/^ 4 f|<I)» - (<I> ‘4 AC) '«!) 

= det ID ' 4 A'C|dct[D '] 

X del {L 4 F^B - F{<t> ' 4 K( ) 'B) 

= dcl|D ' 4 AC) det (D '] 

X del (/„ 4 - M(,t)}. (3.13) 


Noting that M(.v)*®0. (3,13) reduces to 
del ( 5 / 2 ^ ~ A,/I 

= del [d> ’ 4- A.'C'] det [d> ‘] del [/„ 4- 4>BF] 
= det [ip ' 4 AT] det (0) ‘ 4 BF] 


Since by design A - AT and A - BF are 
asymptotically stable matrices, the closed-loop 
system of Fig. 3 is then asymptotically stable. 

As in the case of full order observer based 
controllers, the conditions given in Theorem 5, 
especially the conditions 1 and 2 arc very 
restrictive and hence arc not true for many 
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practical systems. To broaden the class of 
systems, one abandons the goal of achieving 
ELTRI and instead seeks ALTRI For this 
purpose, as in the previous section, we 
parameterize K in terms of a tuning parameter 
o. We have the following theorem dealing with 
ALTRI. 

Theortm 6. Consider the closed-l«x>p system 
comprising of the plant along with the 
compensator as in Fig. 3. Assume that the given 
plant is left invertible and is of minimum phase. 
Select the gain K which is parameterized in 
terms of a tuning parameter a, as an clement ol 
3if,(o). Then ALTRI is achieved as 
Furthermore, there exists a a, such that the 
closed-loop system is asymptotically stable for all 
o>a,. More specifically, as rr^x, eigenvalues 
of A,., arc given by 

and 

A(A-«/•') +0(1,/a). 

Also, the developed compen.sa(or is always 
open-loop asymptotically stable. 

Proof. The re.sults of achieving AL7RI and 
opcn-liKip asymptotic stability of the compen¬ 
sator arc obvious. The proof of closed-loop 
stability of F'ig. 3 can be seen as follows In view 
of (3.13) and noting that ,V/(.v) tends to zero 
point wise in r us o—**, we have 

det [sl 2 „ - A,,\ 

— det[«l> ' -h A'(a)Cldetld> '| 

X det (L + tPflf I as a X 
= dcl|<l) ' -f K(n)C\dc{\^ U BF]. (3 14) 
This completes the proof of Theorem 6. 

Remark 7. The full order observer is not in 
general open-loop stable while opcn-lcHip stabi¬ 
lity of the compensator is always guaranlecd. 

As discussed earlier, one often opts for 
ALTRI design as it requires less stringent 
conditions than ELTRI design. However, 
ALTRI is fundamentally an asymptotic result. In 
practice, the degree of recovery depends on the 
size of gain. Both conventional observer-based 
controller and our new compensator are capable 
of achieving ALTRI. The following theorem 
however shows that for the same value of gain, 
the new compensator achieves much better 
degree of recovery than the observer-based 
controller. 

Theorem 7. Let K{a) be an element of 
Assume also that the same gain K(a) is used for 


m 

both the obscrvcf*hased cxiniroller and for the 
new compensator ixi o be such (hat 
is small (say, «1) for all m 
Furthermore, assume that 

.4) 'B\ » 1 for all «i c D,, 

CVl.S) 

for some frequency region of interest, /), Then 
for all 111 € /V. the mismatch between the target 
loop transfer function and the one achieved by 
the comptmsaior is always less than the 
corresponding one achieved by the full order 
observer-based controller More specifically, wc 
have 

tii{Jl'Ml » (ju#)] for all lu t /),, 

(3.16) 

where F,{\) is us in (3>!) and / olO is as m (2 4) 

Proof Recalling the expression for from 

(2.4). wc have 

" 4 Af(jflJ)) ‘(L, 4 F4>(jlll)ff)) 

^ 4 F<lHnn)B\ 

^ (3 17) 

where 

tl(jO() 

I ^ ^ )) 

Now by our assumplion, c;„,,(M(j(o)| is «1 and 
(FOIj u))B\ IS >:> 1 for all tut/) and hcncc 
n(j(u) IS ->>1 for all w i />, T hus 

^^nii.|/'(i(j^^>)| (]<>>)! all e /), 

Remark H It is well known (Doyle and Stein, 
IMKl) (hat in order to have goiHl command 
following and dislurbancc rejection properties, 
the l(K)p transfer function matrix /4jui) has to be 
large and consequently, the minimum singular 
value o^,„(/..(jtM)) should be large in the 
appropnalc frequency region. Ilius the condi¬ 
tion (3 I.S) is always satisfied in all practical 
situations 

Remark 9. I'hcorem 7 is intuitively evident. In 
our compensator Eji). the error between the 
required and the achieved loop transfer function 
is equal to M(s ) which is designed to be small in 
sr>mc sense On the other hand, in amvcniional 
observer based design, the corresponding error 
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!!» a multiple of M(s), Af(5)| ' and 

^ F<PB But in any gtxid design, the kK>p 
transfer function F*Vli \h Urge in the frequency 
region of interest T hus for the same gam K(a), 
differs from / , (a) by a large factor 
making /v(,(a) much worse than 

/Uv)- 

Once again, as in i^emma 5, we now develop 
bounds on sensitivity and complementary sen¬ 
sitivity functions when the new compensator is 
used. Lxl .S'(v) and 7,(v) be the generated 
sensitivity and complementary sensitivity func¬ 
tions in the configuration of Fig. 3 when the liH)p 
is broken at the input point of the plant, 

.V.(.v) -|/.. ^ C(v)/ 1 a)) 
and 

FJs) - L - S. (v) - \L f C, (.v)/*Cv)| ‘t\ ts)P(s) 

where C, (a) is as in (3.3) We have the following 
result analogous to Lemma 5. 

Theorem K. Consider the configuration of Fig, 3. 
Assume that (3 13) is true We have the 
following bounds on all singular values t - 1 to m 
of .V, (jni) and /, (jn#): 

^^rliiinl 'S 0 ) I 

)I 

« W(j«i*)| lor iill un i), (3. IK) 

and 

I "■ I 17 . .‘’i I ^ ij 

\Fi\y(jio)H\ o„.,„(m(jo))j - I 
«o,„i,jAf (jfu)| for all rue/),. (3.1M) 

Proof, See Appendix L, 

Remark 10 It is evident that due to the 
presence of the sign « in the expressions (3.18) 
and (3 1^), the new compensator yields much 
better sensitivity and complimentary sensiliviry 
rectwery than the conventional full order 
observer based controller. 

4 Kl niK EO ORDF R (OMPt NSA H )R tt TRl 
AND Al TRI 

In the previous section, we studied a new 
compensator whose dynamic order is the same as 
that of the given plant. Corresponding to the 
reduced order observer-based controllers, one 
naturally w-ould like to investigate also the 
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possibility of a reduced order compensator for 
the purpose of achieving either ELTRI or 
ALTRI. Motivated by the results of the previous 
section, in this section we study such a reduced 
order compensator structure (sec Fig. 3). 

Fhe structure shown in Fig. 3 c(»rresponds to 
that of the reduced order observer-based 
controller except that, as in the case of full order 
compensator, the link from the plant input point 
via the matrix H to the controller (or what is now 
called a compc'iisalor) is omitted. Because of this 
omission of the link, again the separation 
principle is no longer valid and hence we need to 
study and establish the necessary properties of 
the reduced order compensator for I, I RI 

As in Section 2, without loss of generality, we 
will assume that the given plant is described by 
(2,‘f) and (2.10) while the stale leedhack gain 
matrix F which achieves the target loop transfer 
function L{s) be partitioned as in (2.11). Vhc 
reduced order compensator is dynamically 
described bv 


Z; - 4 (t, y. (‘f 1) 

u “ u - , /sK, (4.2) 

H - K, \ f (4 3) 

The matrices A, and (/, arc as in (2 18). Here K, 
is a free design parameter which is to he selected 
to satisfy the following conditions: 

1. Siahility of (he l UKseci-loop system. I he 
closed-loop system as depicted in Fig 5 and 
characterized by (2.9), (2.18), (4.1) to (4.3), is 
asymptotically stable, i.c. 

RcIA(.4,Jl<0, (4.4) 

where 


A 22 ^ I . “ f I ^ 

-B:F: 


.4ji — , K,Ai2 

/4 11 — fl 1 /” I I j 

- W./-, .4,. 

(4.5) 


2. ELTRJ or ALTRI. The achieved loop 
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transfer function 

(4 e>) 

is either exactly or approximaJely equal to 
L(jw), where denotes the transfer 

function of the compensator (i.e. the transfer 
function from y to -ti). 

3. Open-loop stability of the compensator The 
compensator is open-loop asymptotically stable, 
i.e. 

Re(A(A,)J<0. (4 7) 

Besides satisfying the alx)ve technical conditions, 
as in the previous section, one expects that the 
value of gam needed for a certain degree of I I R 
is much smaller than that required bv the 
reduced order observer-based controller We 
have the following lemma: 

Lemma 10, /:,,(a), the error between the target 
loop transfer function /.(v) and that reali/ed by 
the reduced order compensator, is given by 


h. ,{■'>)- LU) - 

/.,.(.v) = Af.(.s), 

(4.K) 

M,(s) - ^.(4)., 

' + '/y. 

(4 'J) 


Proof See Appendix F. 

Remark 11 The expression for E,As) is identical 
to the corresponding one for the full order 
coTTipensaliir, see (3.8), except dial now M^s) 
takes the place of A/(\). Also Af,(s) is the same 
as dehned in (2 20) for the case o( reduced order 
observer-based controller. We also note that the 
two expressions for the error between the 
required and the achieved loop transfer func¬ 
tions, one lor the conventional reduced order 
observer design (2 10) and the other for the new 
compensator design (4 8), again differ sig¬ 
nificantly Thus as we expect from Ihetnems 7 
and 8, this leads to an overwhelming advantage 
in favor of the new reduced order compensator 
in contrast to a reduced order tibserver-basi'd 
controller 

We have the following two theorems 

Theorem 9. Consider the closed-loop system as 
depicted m Fig. 5. Then both the asymptotic 
stability of the closed-Uxip system and FJTRI 
can lie achieved under the following conditions; 

1. The given plant has all its infinite zeros of 
order one. 

2. The given plant is left invertible and is of 
minimum phase. 

Moreover, under the above conditions, K, can 


be selected m an clcmcfii of Mm. the 
eigenvalues of A,*, are given by 

AfAj: - and A(A HF) 

Furthermore, (he dcvclojxrd compensator is 
always open hxip asymptotically stable 

Prtmf. Under the gtven conditions, K, can be 
selected as an clement of and hence 

llius FJTRl IS achieved Also, it is 
evident that the compensator is open-UHip 
asymptotically stable Fhe chised-Uxip stability 
of Fig 5 is given in Appendix G 

Theorem It) C onsider the dosed-liKip system us 
depicted in Fig 5 Assume that the given plant is 
left invertible and is of minimum phase Select 
the gam k, which is paraiiie(eri/( d in terms of a 
tuning piirameier o. as an element of .A,*,(o) 
llien Al I Rl is achieved as m ♦x, 
Furthcimore ihcrc exists a o, such that (he 
closed loop sssiern is asymptotically siablt for all 
o MJ; More specilieiilly, as o eigenvalues 
of are given by 

A(A;; A',(o)A,;) ^ G(l/o) 

and 

A(/t H! ) 4 (;(l/o) 

Also, the developed com|HMisaloi is always 
open-loop iisymploliciilly stable. 

Proof. Ihe results of acbicving Al.TRl and 
open-loop asymptotic stabilily of the compen 
salor arc obvious The prool ol dosed-liHip 
stahiliiy of t ig S is given m Appendix II 

As IS clear hy now, one often seeks an Al TRI 
design which as we know is asymptoiic where the 
degree of recovery depends on the si/c of gain 
Both Ihe conventional reduced order observer- 
based controller and our new reduced order 
compensator arc capable of achieving AI TRI. 
As expected, the following theorem, however, 
shows that for the same value of gain, the new 
compensiilor achieves a much belter degree of 
recovery than the observer-based controller. 

Theorem 11 l.et KAo) be an clement of 
Assume also that the same gam KAo) is used for 
both the reduced order observer-based control¬ 
ler and the reduced order compensator. IjcI a be 
such that Oru^^lMAp^)}] is small (say, «1) for all 
(u. Furthermore, assume that (3 LS) is true, 
llien for all w e f ),, ihc mismatch between the 
target loop transfer function and the one 
achieved by the reduced order compensator is 
always less than the corrc.sponding one achieved 
by the reduced order observer-based controller. 
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More ^specifically, we have 

Om..|£,-r(jw)| » for all w e D,. 

(4.10) 

where E,As) i% m in (4.8) and is in 

(2.19) 

Proof. Tlic pr(Kif follows along the same lines as 
that of Theorem 7, 

As in the previous section, we now turn our 
attention to developing hounds on sensitivity and 
complementary scn.sitiviiy functions. I^et 
and 7;,(.y) be the generated sensitivity and 
complementary sensitivity functions in the 
configuration of Fig. 5 when the loop is broken 
at the input point of the plant, 

.s„(i) = l/„. + c:.,(.v)P(.v)| ' 

and 

» - .V„(,v) = |/„, f C,.,(.v)/*(,v)| 'C„(,r)/*(.v), 

We have the following result analogous to 
Theorem H, 

Theorem 12 (Vmsidet the configuration of Fig. 
ft. Assume that (.Tl.*^) is true. Wc have the 
following btmnds on all singular values t - 1 to m 
of and 7;,.(ja>): 

for all ru e D, (4, 11) 

and 

« o,n,,[Af,(j(u)| for all to e l\ (4.12) 

Pr0i}f. It follows along the same lines as that of 
llicorem 8. 

Remark 12. Remarks similar to 7-10 are 
obviously true even for reduced order 
compensHtoi^, 

.s mi l AND RKDIK l n ORDtR 
aiMPENSArORS^ Ul IRC) AND AITRO 

'Fhe results for the case when the target 
open-lmip transfer functions are specified at the 
output point of the plant can be obtained by 


dualizing those for the case when the target 
open-kx)p transfer functions arc specified at the 
input point of the plant. However, one has to 
interpret duality in a proper manner and this was 
discussed earlier in Section 2.3. All this 
discussion also applies to compensator design. 
All one has to do is to use cither full or reduced 
order compensator design of Sections 3 and 4 to 
achieve LTR in the third step of the design 
algorithm discussed in Section 2.3. The remain¬ 
ing steps of the design algorithm given in Section 
2.3 remain intact. 


u IXAMPI.I'S 

Examples arc presented in this section 
comparing the new compansalor with the 
conventional observer approach. These ex¬ 
amples arc worked out using the software 
reported by Chen et ai (D)H9). Clearly all the 
examples support the theoretical development 
given earlier and demonstrate that the new 
compensator approach is much better than the 
conventional observer approach in all cases, 
namely, (a) when the performance specifications 
arc reflected cither at the inpul or at the output 
point of the plant, and (b) whether the full or 
reduced order compensattir is used 

Most often in the literature, the maximum and 
minimum singular value graphs of the target and 
achieved loop transfer matrices are drawn with 
rcspi'ct to w and are then compared. These 
graphs could be misleading. Although the 
singular values of target and achieved loop 
transfer matrices may match perfectly, the 
difference or mismatch between them could be 
very high owing to the phase difference between 
them. Phis has been pointed out by Ridgely and 
Banda (1986) in an example. The best way is to 
check the singular values of the mismatch 
functum between the target and achieved l(H)p 
transfer matrices. 

I'o show the cftects of the phase difference, 
consider the example of Ridgely and Banda 
(19Hb) 

V " Ax 4 Hu 4 rt 

0 I II 3 S 

14 Wf (6.1) 

4 llJ 61 
and 

y = (T 4^ r/ - [2 1 j.t 4- r/, (6.2) 

The slate feedback law is selected as 

u- Ev^~f5() (6,3) 

Ilie full order observer gain K{a) is obtained by 
solving the filter Riccati equation. 

AI 4 lA' ^ Q{a) " ICTT - 0 (6.4) 
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and 

Kio) = lC' 

where 

(2(a) = rr + crflB' 

The magnitude plots of the target and 
achieved loop transfer function when a* takes 
values 0; 500; 2500; 3600; 8100; and 250.(XK) are 
presented in Fig. 6(a). As (T begins to increase, 
the low frequency region of the achieved loop 
transfer function begins to approach the target 
loop, while the high frequency region remains 
virtually unchanged. As takes the value 3(K)0, 
the low frequency region also almmt matches 
the target loop. At a^ = 36(K) a.s shown in Fig. 
6(a), the target and achieved loop transfer 
function magnitudes are almost "tight" together. 
However, as shown in Fig. 6(b), the phases arc 
about 180° apart in the low frequency region. 
This shows that no recovery has iKen achieved 


Tabij- ](a) Siwirsnua r» maximom MMUifiA* vaioi* or 
MISMATCH nsKTioKs ov*» m«:o»«r>*(Ws nom n 

Tuning .Supremum Supivmiim 

IwranMifr 

C«* 1 (T'-Mtn 20.th27 «07t7 

tW 2 a' - to' 21 (024 .S 4SM 

( jBic :» (1^» to* 5.S TVJO 0 TVIO 


Tabu 1(h) toMrAutsiiM or mu okmm oasiiBS'isii »a»i;o 
coNTanui* uaj oboim idmkmsatoh h>ii rnr nami> 
oiURir or 

l.>tfrrc ol rcoivcry 

m * « r nil s * 

CHwrrvcr tNiheid I aU Mklrr 

cx)nfn.i4ler a>mp€titMiicMr 

(imn nomi 4 W M fmi 

Eigcnvjilucj "IH664 2(m} 

9527 ttKI 4V2g 

HanJwidth SnOiad/h ' 1682 iad/« ' 


m 

'O 



-250000 and Target loop 


Taigat 

loop 



-80 

10^ TO'-* 


10' 10® 10 ’ 
Frequancy in rad s 


10^ 


10^ 


Frci 6(a) Singular values of large! knip and design lotips 


I 



10 "* lO'* 10'^ 10 ® to’ 10 * 10 * 

Fnqu^ncy in nd a ^ 

Fig. 6 (b). Phmsc rciipoiises of large! loop and dc?vign loop 
with ® 36 i[]K) 


a! <T' ^ 36(M) It lakes a a ’ of 250.01)0 to achieve 
the needed recovery. 

In wha! follows, for each example, we present 
the traditional maximum and minimum singular 
value graphs of the target and achieved liH>p 
transfer matrices However, in view of the alxwc 
discussion, the maximum singular value graphs 
of the mismatch function are also separately 
given Also, a tabular column presents the 
supremum of (he muximuni singular value of the 
mismatch function with respect to uf over the 
frequency range of interest All of the above 
data relate to the comparison between the 
olrservcr bascd controller and our new compen¬ 
sator when both of them use the same value of 
gain. Another method of comparison is to give 
the value of gain, eigenvalues and bandwidth of 
both the observer-based controller and the 
compensator in order that both of them achieve 
the same degree of recovery as measured by the 
supremum of the maximum singular value of the 
correspondingly generated mismatch function 
Another tabular column shows this information 
AIm), for a chosen supremum of maximum 
singular value, a graph shows the variation of 
maximum singular value of the observer-based 
controller and that of the compensator with 
respect to io over the frequency range of 
inicrcsi. From all these data, it is easy to see that 
the new compensator approach has better 
rcaivcrv properties than the amventional 
observer approach. 

Exampk 1 (Full order ALTRI). Consider the 
example in Doyle and Stem (1^79) (and see 
Tabic 1 (a, b) and Fig. 7 (a. b)] 
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n. 


I ahi I 2(h) Si phi Ml m 01 maximum sini.i iar vah i s oi 

MISMAH H Kl'NlTKlNS OVt H 1 RI Ul’l N( II S PI OITI I) 

Supremum /-nija')) Sapremum F. 

471 W51 0 :3‘JH 


State feecihuck gain: 

/'- (.SO I0| 


lixample 2 (Full order ALTRO). Consider the 
following example in Ridgely and Banda (1^86) 
(and see Table 2 (a, b) and Fig. 8 (;i, b)| 
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(1 
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Degree of recovery 

sup » sup f t) 

2398 for 1(1 ' 

io • * rad s 
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Full order 
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compcn5mtOT 

Gam norm 3 1623 ^ 10** 

317 4681 

Eigenvalue-^ - 158 15 
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Fr«pvi6ncY rad s ' 


Fk. 7(h) Mdxinuim singular va(Llc^ o( full ordrr i^hMrrxcr huMriJ a>rnroHri ami otmipcnwiivii given in Imhlr 

Mh) 


[0 0 n 0 2(1 ()]' 

io 0 0 0 0 2(1 ‘ 

^ I 0 0 0 0 0 

lo 0 0 1 0 0 

For this example, the observer gam is given, 
instead of the stale feedback gain, lo meet all 
the design specifications for the loop broken at 
ihe output of plant. 

^ I 4 Jl) 1H.17 - I (I IIIKI II I14M j' 

! - I IV ss 81 OfiO |(I4V 0 .VVUI u I 

Example 3 (reduced order Al/IKI) Consider 
the example in Sogaard-Andersen (lM87b) [and 
see T able 3 and Fig. 



c=i/. 

The stale feedback gain is an /.e'^lcsign with 
weights Q = A and R = 10 'A 


I ABU \ MTRI MOM (»l MaXIMI 'M VINltlUAR VAUH S Ol 

MivMAit h n'NtiuiNs ovi K mi ooi Ni II S pi orn n 


I uning Suprcnium Suprrinum 

liRiiimrlci F, (juf)} 

C rtvt 1 i» in IV 

C ASC 2. <I inn 1 Vi IM7 2 Ihfin 



r ri»Qu#ncv m r*d • ' 


t If. H(«) irrquenev frsrxmM:^ loi ibc given in Tabk 
2(a) 



Fr*qo#ncv m rid • ’ 

Ff(t fVh) Maximum singular values uf full mdcT obicrvcr 
bailed cMmlrollei and atmperiiiuiKn given in Table 2(b| 
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Fkj Frc(|uciu:y rcsp^inst-s fur NilK the canc given in I able A(ii) 


7 (ONd UNIONS 

The IcKip transfer recovery (I.'IR) methods 
using obnerver or Kalman lilter-hased controllers 
are streuinlined and the theory of both full and 
reduced order observers is brought to the same 
framework. It is shown that either exact or 
approximate l.l'R can be accomplished iR 
M{\iu) |or equivalently Af,(|n;) lor the reduced 
order obscrvers| either exactly or approximately 
zero for all ok I'he term M{s) |or Af,(v)| has a 
physical interpretation; it is the transfer function 
from the point where the input u of the plant is 
fed to the observer based controller to the 
output point li of the controller Also, the 
conditions for KI/IR arc presented directly in 
terms of the given system matrices A, H and ( 
and the state feedback gain F. Ihe methods of 
calculating the needed observer gain for both full 
and reduced order observer based controllers to 
achieve LTR arc presented. The singular value 
bounds on the difference between the achieved 
and the target sensitivity and complementary 
sensitivity functions arc developed when both 
full and reduced order observer based control¬ 
lers are used. The duality between the two cases 
when the design specifications reflect at the input 
or at the output point of the plant is discussed. 
One has to interpret this duality carefully. From 
the view point of design methodology* the two 


cases are completely dual and this duality holds 
for either full tir reduced order observer-based 
controllers or in fact for any other controllers or 
compensators 

A new compensator structure for loop transfer 
recovery either at the input or at the output 
point of the plant is proposed. It could be either 
full or reduced order type The compensator is 
structurally different from the observer in the 
sense that no link from the input point of the 
plant to the controller is used. This omission of 
Ihe link from the input p<nn\ of the plant to the 
controller has a profound cffecl on all aspects of 
the loop transfer recovery It results in an 
open-loop stable comficnsalor. Also, the ckxsed- 
loop stability can be guaranteed. More impor¬ 
tantly, the value of gam required for a given 
degree of LTR is orders of magnitude less than 
what is required in the conventional approach. 
Also, singular value biiunds on sensitivity and 
complementary sensitivity functions illustrate 
that the proposed compensator has belter 
recovery properties than the conventional 
observer based controller. These advantages 
reflect in various ways. F'irst, the woes of 
saturation arc cither eliminated or at least 
dampened. The controller band-width is reduced 
and consequently the control signal to noise ratio 
at the input point of the plant i.s increased. All 
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these claims arc theoretically obvious from our 
dcvelopnient. Also, numerical examples illus¬ 
trate the same. 

A fundamental assumption throughout this 
paper has been that the given plant is of 
minimum phase. Wc are presently in the process 
of developing compensators for nonmmimum 
phase plants where obviously, the structures 
given in this paper will not work out since in 
general nonminimum phase plants might not be 
slabilizable by stable compensators Hence we 
are kxiking at st)me other appropriate structures 
to deal with nonminimum phase systems These 
results will be reptirted in a forthcoming paper 
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APPI NDIX A PK(K)| Ol THrORI M 1 ANf) 
(AMI I AVION Ol (lAIN K lO ACHMVI I I TRI 

I rutyi the i.iHuliii(Mis (2 I ariiJ ( i) ol I'heoiem 1, a throrrm 
of Sannuli anil Salvrn (1987) implies that there exist 
muisingular iiarislooiuKnnis 1,1 and I , sin h (Inti 

( I . I I I I i v ^ { . U l\li 

^ I *.» ' OI ■ 

P, ^ b * f .w V- I A I) 

P I.L. * ^ / r»r ^ ** y ' E 

Here the* pair f J o "bservablc I urthcrmorr, A(A^) 

are ihi invariant /crov y»( ihc given plant and hence in vrew 
ol ioiidiiion (21 ol riu'ini'm I thc> are in the left half i 
plane, * 

Suuc ( 4,,^ < \) IS observable, onr can srlecl a gain 
sucli lhai MA, f, I arc in the desired l<K:ations in t 

Als<». i»nc I, an always choov a gam Kff mk li (hat MEf A'^) 


an in the di urrd loialinns m * 

N11 w 

1 boose a gam A as, 




K,.,. 

Thf 

(A 2) 


A, 


where is an arbitiarv 

dimensions f inallv let 

matrix 

with rtt>|>ropriate 


A r ,AI ; ' 

All such gams A with A^, arbitrary form the datis of gtnns 
l>ue to the special striKture of matrices in (A I) and in 
view of (A 2) It IS slraightlorward to verify that A - AC hm 
eigenvalues m 'f anti that 

El4* ’ t Af ) ‘W wO 

whenever TH 9 Hence m view of Eemmas 1 and 2. El.TRI 
IS achieved 
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APPENDIX B PR(KJf OF LEMMA 6 

In ihc rcduccil arckr obicrvcr-hiiHcd fecclhack control 
fiytiem of Fig 4, jii lino wc Wiint lo cvuluatc the Unip transfer 
function L,,,h) when the hK>p \% broken ai the input point of 
the plnnt For ihi% purpoic, consider the plunt input u and 
the cofilrotkr output u as two separate variables Then from 
(2 13) w (2 I7l 

iI 1-4^ji ■“ ^ ^ A ^fjf f i K^(i f A f ). 

HcfKC 

i/«) - («>,; f ‘KAj, ^ * H.OiJil. 

- <J(r) *■ K,A,,) ' 

X + H,uU)\ 

Thun 

iL ♦ * K,A„) ‘fl,l|/,i,(5) ^ M;(v)| 

- A;i,(.r) ♦ 4 K,A,,i '(/»,, + 

and (htrefore 

I .(»)“-U-, +w,(«)i V;+ + ' 

where 

M,(s) 'H, 

Wc wdl ncai simplify some rxpresHions Using (2 12). 

(A,*,; 4 yt,i)nr) 

~ (A,«!>,,' ♦ /»;,)(<!>,,», ♦ <»>,,/»„//,(«)) 

^ A,fl, H, + + H. t (A, t 

(H 2» 

Hut from (2 14) 

4 H.. - ,4.)//_,(>) 

(B 


I*hus (B 2) and (H 3) imply ihai 

(A,<l>,,' t - U, + (<!*..,' ♦ A,/l,..)//,(t) 

(H 4) 


Using (H 4) and (2 If). 

^ K,A,!) '(A,1>|,' < 

• A ,(< I >,,' » A ,>»,.) '/), 4 A .//,(0 

>/.(() /-int) M,tO (B •>) 

Now m view ol (n 1) and (H 5), 

‘ ^ W,(.0| ‘|/(') W-(')| 

llius wr have 

F ‘..(0 "" L (0 L .„(0 

[L ^ H(U1 'UL ^ M,(.0)L(i) f.fo t \L(.v)| 

\L ^ <WdO| 'MAs){L ^ f.lO) 

‘ mas)\L ^ 'iL ^ f (')) 


APPENDIX C PROOF Ol I HLORl M t 


Without loss ot generality, wc will assume that the given 
plant IS in the form ol a special coontmaic basis as in (A I) 
(see ApfKndix A) llien partiiuming the state variable jt^ as 
(•m- ^i»A '*''lh V, " wc can write the mainccs A. H 
and C charactrn/ing (A I) as 


■ L F'm F—' 

f*sn 4^,1 A A,; (I 
f-sr? 4^,, 0 

_ l d A^__ 


L' 

rJ'- " " 

0 ■ 1.0 f,, 0 

{) 


(( 1 ) 


The tnpic fA. B, C) tn (C l) aatumci that the cuoditjof) 1 of 
Theorem 3 i* true. Ilicn m view of (C.I), (2.9) and (2.10), 
wc have 


A 22 








Al.% 0 , 11 can be easily seen that Ihc pair (A^2 .t>4^,^) is 
observable (Saben and Sannuti, 19H8). Hence there exisu a 
K,,> such that desired ItKations in C 

where A\, 2 i con^der a reduced order 

observer gain matrix K, as 


where K^, is arbitrary It is then simple lo verify that A,. 


A, ^ A22 ,4 


4;z: 0 

A^ 


IS a stable matrix provided that the given plant is of minimum 
phase. I c He A(A^) * 0 Furthermore, wc note that 

H, - H , K,B, - 0 

Ihi-s in view of (2 22) shows that Id TRI is achieved Also, 
wc note that all gams K, as in f( 2) with arbitrary form 
the class of gains X,, 


APPENDIX D PKOOI OF I I MMA K 
From (2 19), wc have 

I ,Js) ^ (a)/’(' ) 

" M,(v)(/,, -r H(.0) 'tC. Fa>/f). 

and hence 

L^LMUV) 

- L ^ f .(U 

^ f <t^B - V/,(.0|L ♦ MAs)\ UL ^ Fd>/i) 
|/^^/VfAO| 

Thus 

\JU A,(a)|/„. f MAs)\ (D 1) 

Lhen using singular value inequalities, wc have lor each i I 
to m, 

and thus 

o,lV (j"')| - 

(D 2) 

Now rewriting (D I) as. 

Sf (V) -- ( t) .V; (.OAf, (V). 

wc have for each i - I to m, 


(7,|.V^ (jrjj )] - oJ.V„(j(i>)| * 

Then in view of (D 2) and (03). wc get 

Nc»t in view of (D U. 




(D.1) 


Ijs) = /, - .v„.(.t) - r,(u - 

Now using singular value inequalities and proceeding as 
ttbsivc, we get 
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APPENDIX E PRO<3r W THEOREM H 
From (-^.8), wt* have 

t; (i } «* /• tp/i " C. (j )/*(.*) ^ Mi l ). 

and hence 

L ^ lv)nr) = ^ F«*^r - iW(j) 

- {/„ - MU)\i^ ^ F^B\ ' 

Thus 

A (si - SfU\{t^ -- W(s|(/^ ^ FiPB\ ‘} ‘ 

-.V,(s)U^ ^ M(sHC ^ M(s|| '} 

- 5, is \ f S, is lAf (s )(/^ + FPH Mis )| V (F U 

Tlicn usinii! singular value inequaliiics. sve have lor each i - I 
lo m. 

or equjvaicnllv 

(I :> 

Nim rcwnhiig (I I) as 

.S,(s) .S;iv) S,is)Kt{K)[l„, * FipH M(.)| V 
we have loi each i - 1 lo rn. 

(jCOll •: flJ.V (jlr> || 

^ IM'' /'‘l>(Mli)// W()fH)| '}. 

or equividcnlK 

fT,|A(jfD)| 

* '* /Vf(H)>)| ’) (1.3) 

(’omhimng (I ’) and (I V) vse wei (<n each t 1 ui iri. 

if» I V (jfiO) n |.V(j<o)|l 

"rn.rJA., " / .V/(|rO)l 

'' jCj>)| loi .(II Ut i l\ (I. 4) 


Ihc las! step m (f 4) hillnws Irnm l M I Next, in virrw o| 
(T 1). 


^(O C \(') 

- L \<'l S,(t)AI(0|/,. ^ f WtUl ' 

7,(1) .SV(v)M(n|/„, > f Pfi M( 1 )| ’ 

Now using singular \aluc incquiiliocs and priHcedmg a\ 
ahryve. we gel 




\M{\t\> 11 for all u> r /; 


APPFNDIX F PROOF Of I I MMA 10 
In the reduced order compenvaior based Icedhack control 
system of Fig at first we want ii> evaluate the loop transfer 
function /.,d’) when the Unip is broken at the input point of 
the plant For this purpose, consider the plant input u and 
the controller output u as twf« separate vanahfes Iltcn m 
View of (4 1) to (4 31, 

^ ^ A',(o)tJii - (F I) 


Hence 

i.(j ) + K,[o\A,.) ’(A., t 

A,(ti)0,,'iP(..>«(«) lE*’) 

Illut in view o| (F 2), 

-|J(0 

^ F,♦ F>(.0 

|f, Fd***'/ ^ A.(i04v:) ‘(A,, ♦ Ado>4>i,V)|P(l)ir(A) 

(F:m 

Now using (B 5). 

/-,,(0 - / (I) - (F 4) 

Hcoct 

/,(.) /,,(<)' 


APPENDIX (i PROD! ()l IHIOREM 1 
Wr Ills, nnic the lolliming 

*u' .^,..1 


and hence 


where 


a/, a « ^ ’ 


a» ’ 




ITius 


A;, 4 * 2 : 

Q, 


■A,, 


A, 


((» 


I King Aj, as in (4 S). we have (hr lollowiiig serirs of 
reductions 


dell./-, 





4 K.A^; 4 

A;, 4 

A, 71,7 , 

k, 

A 

del 

/f,A. 


71,7, 

'll 


B.f. 

■ A,., 

4 71; A, 

4».; 


<F, ' 4 A7f,/ 

A;, ♦ A,/f,/, 

f:a, 


del 

A, 4 nj. 


A,,. 



^ B Fj 

A,, 4 71,A, 




' ♦ kji,/; 

A,. 4 A,71,A, 

A, A 


1 

ilci 

A,. 4 M,F 

I-,; 4 71,A, 

A,, 



JH, K,H,)F: 

(71; A,71,)A, 

4 A, 



<l> , ' 4 H J 

A j ♦ 71/A, 




del 

- a', 4 /f' A, 

d».; f 71, A, 

A,; 




JH. A,/f,)/ 

(71 A,71,)7, 

1»;;' 4 A, A,; 



n»n' " 

A,, 4 71,7; 

.''l: 



‘ det 

A;. 4 « /, 

«!» ; ' 4 71; a; 





l/f. A,AI,)A, 

(Al; A,7<,)F 

I',.,' . K,A 

i: ., 


del 

1 ‘ 4 Hi 

l(7f, K,li,)F 

4 A,A,;| 




- dct(<l»..’ f F,A,.| 

(let (a> ’ ■♦ /fA ^ A\A,,) 'iH, A,Af,)A > 

- det (<!>;-' 4 A^A,;Jdrl |<l> '] 

del (/, 4 |(t>AI ^ A,A,,) '(/f, A,«,)1A ( 

- det + A,A ,^| det |<1> *1 

del |/^ 4 A4»/f F<P*PJ<P^J 4 k\A^2) '(«; ' A,Af,)| 

(Ci 2) 

- del ♦ A,A,;.l det |4> ‘| 

del il^ ^ F^h - A,(1»;,‘ 4 A,A,j) ’(«, A,«,)) (0 3) 

- del 4 AVA,J del 14» ‘1 del f A4)Af M,(0) 

(0 4) 

We used (Cj I) in order to get ((i 3) from (O 2) Noting that 
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lincc K, * X„. M,U)" 0 •«! hcn« 

- del (♦„' + del !♦ ') del (/« + f ♦«) 

» del (♦jj‘+ III dell* 'Jdci (/„ + ♦flf) 
«• del del I* '-i-Bf'\. 

Thi* pruves the Iheorem 

APPENDIX H PROOF OF TFlIiOREM U) 

Since X,(€i) 6 af„(f»), M,U) lend* lo wro puini-wiie in i u 


Then from (G. 4 ). 

p ~ Aff,] 

« del (*,; + A,(0M„| del |* ') del {L + - «,(0> 

-•del (*22'+ "I 

“■dei|*2j' ■*■ ^r(®Mij|‘l«i [♦ '!**«' (A. + *flF) 

- del 1*12'+ del [* ' + fiF) 

Thin proven ihc theorem. 



Ajiimaca. V(ji r :.p|, >1 m\ 

l^nutni m G(c«i BntMB 


fj m» * otw 
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Trade-offs in Linear Control System Design* 

R M MIDDLHTONt 

Unstable poles, non-minimum phase zeros and time delays in an open loop 
plant impose fundamental cortstraints on achievable performance in control 
loops, and also imply restrictions on the ImndHidth of the control /oo/k 


kry WiMih ( s>^tfnis, diwrcU* iinu* %vMem%. non mi nun urn phas* sysicm^ uiiM.ihlc '>yMcmN, 

tune delays 


"For some time now, iniin> practitioners and 
researchers in the amtrol area have been aware that 
unstable open loiip poles, rum minimum phuve zeros, and/or 
lime delays make control systems design diflicult In this 
paper we cKaminc the nature o( these ditlicullu's hy 
discussing the results (d I rciulcnlH’rg and l.4vo/c tlM87. I9K8) 
and Sung and Hara (l%8) on tnicgral constraints on 
sensitivity functions One of the kev conclusKins here is a vet 
of rules of ihumb, giving limiialions on ihc closed hnip 
bandwidth which are ini|>osrU by unslabit i>fsen lo^ip |s«des. 
non-minirnum phase zeros and/or lime delays 

1 INIKODIKMION 

Mik h (IF the control literature to date has 
addressed a question of the form ‘(jiven a 
nominal plant and a scl ol design criteria, design 
a controller to best achieve these criteria”. Some 
examples of this are quunlitalive feedback 
theory (Horowitz, where the dcisgn 

criteria takes the form of frequency domain 
performance spt;cifications in the face of plant 
uncertainty. I OCi control (e g Kwakernaak and 
Sivan. 1M72); |>ole placement (e g. Middleton 
and Cioodw'in. 19^X1); and //, optimal control 
(e.g Francis, 19H7), 

In this paper a differeni question is addressed, 
namely “Given a nominal plant, what fun- 
damental constraints are implied hy unstable 
open l(K)p poles, non-mimmum phase zeros 
and/or time delays'^' 1 he mam aim of this paper 
is to answer this question in terms of constraints 
on the bandwidth of a control system, imposed 
by unsiabfc open IcHyp poles etc 

Many of the works on /Y, optimal control have 
demonstrated certain constraints imposed by 
unstable open kK>p poles and/or non-minimum 
phase zeros. For example, in many of the early 

•Received 7 June IVWI, reviycd IS December revised 
I? Jui»c 1990. received m final lorm June 199U llie 
onginal venuon of this paper was not prcsenicd at any IFA( 
meeting llus paper was rccommcfMk'd for puhlicalion m 
revised form by Asksociaic f'ditor M Kimuia under the 
direciiofi of Editor M Kwakernaak 

t f>epartmeni ol FdeeincaJ Engineering and f nmpuirr 
SaeiKC, lintvervity of Ncwcasile. N S W , Australia 

A1 'T', j ^ : ■ )■ 


works on II, optimal control using intcrpoUition 
theory, il was clear that the inler|xilat»on 
constraints. im|H>sed by unstable plant |Xilcs 
and/or zeros, made controller design more 
diflicult (see for example Zarnes and Francis. 
1*^83). It has also been shown, (e g Francis aiul 
Zanies, 1984) that non-minimum phase zeros 
dictate a lower l>ound on the wcighteil sensitivity 
function 'Fhis coiuiusion. combined with the 
ubiquitous case ol having a low pass weighting 
(unction, suggests that norMTiimriuim phase 
zeros place an upper limit on the bandwidth 
(see for example /.ames. W8I, Remark 
following I'heorem 4) O'Young and I rancis 
(L>H6) have discussed some liadc-ofls in the cast* 
where a description of the plant unccriainly is 
given 

Other wiirks which discuss constraints iin- 
fxised by unslahie open loop |xilcs etc include 
the works o( Freudenberg and Looze (1^88) and 
Sung and Flara (IM88) In these works, integral 
eonsiramts on the sensitivity and complemcnlary 
sensitivity functions are presenied These con¬ 
straints can be clearly seen to be worsened by 
the addition of unslahie poles, non-minimum 
phase zeros and or time delays 

This paper unifies the work (m continuous 
time), of Freudenberg and l.(K)/e (T/K7. 1988) 
and the discrete time results of Sung and Hara 
(1988). In addition, lime domain results 
concerning undcrshiwii and ovcrshiMU are dis¬ 
cussed here The mam contribution here is to 
argue for some simple rules of thumb, 
constraining the bandwidth, based on fxilh 
frequency domain senMliviiy functions and lime 
domain arguments 

This paper is organized as follows. In Section 
2 we present several lime domain consirainis on 
the response of a stable closed IcMip, feedback 
system, imposed by unstable open loop poles 
and/or non-minimum phase zeros. In Section 3, 
we discuss the implications of these constraints 
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with particular reference to riise time, settimg 
lime, undcrshiKJt and overshoot Presented in 
Section 4 arc several frequency domain sen¬ 
sitivity function constraints which unify the work 
of Freudenberg and Vxhtic (19HH) and Sung and 
Hara (19K8) In addition, we present a new, 
closely related result, Ij^mma 4.3. In Section S 
we discuss the implications of these constramt.s 
with particular reference to the closed kxrp 
bandwidth. This discussion, together with that in 
Section 3, leads to several design guidelines 
which are presented in Section 6 flicse 
guidelines are illustrated in Section 7 by 
discussion of the well known inverted pendulum 
problem. 

In this paper the following unihed notation 
afforded by the use of delta operators (see 
Middleton and (ioodwin, 199t)) is used. 'Fhc 
delta operator notation was chosen for two 
reasons; (i) "fhis notation allows a unified 
presentation where l^ilh continuous and discrete 
results are treated within one framework; and 
(ii) except in the ca.se of slow sampling, the delta 
operator has superior numerical properties (see 
for example Middleton and (ioodwin, 1986). 
1'he generalized notation is. 

((je ne r a I r/ed Dc r i v all ve) 




xit I 


A) xit) 
A 


i.\x 

dr 


(II) 


(liven the above definition (11), it can be 
shown that the stale transition matrix for the 
(jcncralized Linear lime invariant system. 

(^if(r) - 4i(r) 

IS the following (ieneralized hxponenlial 

h:(A. I) (/ + (1.2) 


The inverse operation of the generalized 
derivative can he shown to he the following 
generalization of integration; 

(Ij)wer Kicmann Sum) 


(, A f, A I 

S'/(ir)dT^ A V /(AA)— |(T)dr. (1.3) 

*' r, A 


Given the above definitions. the following 
transform definition will he used: 


to the shift operator, q. Also, /^(y) = 
where fj( ) is the Z transform of 

Given (L2), it can be seen that the stability 
region is the circular region, jl + Ay| < 1. which 
can be rewritten as: 


(Stability Region) 


Re (y) “ |y|‘ < 0Left Half Plane. (1.5) 


The associated stability boundary is given by; 
(Stability Boundary) 

~ 1 


~ 1 V 

^—- IImaginary Axis. (16) 


2 riMI DOMAIN (ONSIRAINIS 

Consider the simple feedback control system 
shown in f ig 1, which by use of the unihed 
notation introduced above, includes both the 
continuous and discrete cases (For the remain¬ 
der of this paper, unless otherwise stated, all 
results apply to both the discrete lime case and 
the continuous lime case.) 

In Fig, 1, the symbols have the following 
meaning: 

G(y) plant transfer function 

C{y) controller transfer function 

y*(t) desired output, i.e set point for y 

e{() error signal 

u(r) system input 

y(r) plant output 

We shall also use lAy) to denote the open 
loop transfer function 


L{y) = (j'lylCly) (2 1) 


(where wc assume L(y) is rational, except lor a 
possible multiplicative lime delay m continuous 
lime). 

We also use A(y). T{y) to denote the 
sensitivity and complementary sensitivity func¬ 
tions respectively; 


,S (y) ^ - 

\^L(y) 


and 


7‘(y)^ 1 “ .S'(y) 


/.(y) 
i +/.O') 


( 2 . 2 ) 

(2.3) 


(Della Iransform) 

/*(y) - V FT y, t)f (/) d/ -■* l.aplace Transform. 

() 

( 14 ) 

Note that the variable y in the Della 
Transform is related to the operator in much 

the same way as ,v is related to , or r is related 


Wc shall say the closed ItKip system is "stable" 
if and only if all of 7Ty), .V(y), C( 7 ).STy) and 
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f;(y)5(y) arc analytic lor all y outside the 
stability region (1.5). 

We then have the following results: 


Lrmrna 1. ("Unstable" open Imip poles) Let 
t’(r), y(f) denote the responses for y*(/) a unit 
step, and suppose there is an open lot>p p»»le at 
y = p (p outside the stability region) i.e. 
L(p) = ^. Then, for any stable closed Unip 
system: 

(a) ,V Lf/j. - f)e(/) d/- 0 (2.4) 

II 

iinc! (b) 

sr(p. -nv(f)df - * - ^ (2 5) 

" p 


Proof Lci 
(i.c. y-(y) 


y'*(y) he ihe iran.^storm 

(1 A^ 


1 hen 




of v*(/). 


/ (y) - .V( 

Siiiie (he closed loop is stable, y “/> is m (he 
rej^ion of eonverjienee of My), and ihus: 


A IK p, i)e(t) lU - /:(/!) - S{p)Y*(p)i) (2.7) 


Part (h) follows, since v *(/) ^ 1. and 

1 ^ A/; 

Sf.{p,-()iM- ' 


(2.H) 

vrv 


Lemma 2 ( “Non-niinimiim j'lhasc ’ zeros), i.et 
r(7), v(M denote the res[X)nse for v*(r) a unit 
step, and suppose there is a zero at y~z (c 
outside the siahililv region) i.e /.(r) - (): then 
for any stable closed loop system 

la) .S/.(r. /)v(7)d/-(l (2 9) 

11 

and (h) 

1 f Ar 

A /:(j. - i)e{l) d^ - (2 10) 

11 z 


Proof As for l.emma 1. except that in this case. 

Remark 1. Lemma 2. pari (a) applies also in the 
case where the plant. (L has an unstable zero at 
y ~ r. and the control signal is u^iv hounded, 
integrahle function. Thus, in particular, this 
constraint is independent of whether the 
controller is linear or nonlinear, time invariant 
or lime varying, etc VW 


L INlt^RPRI rATION Of TIMl m>MAIN 
CONSTRArm^ 

In this section wc discuss the implicaitiom of 
the results in Section 2. Wc hrsil show that real 
nght half plane poles in the open hnip imply 
overshcKU in the ciosed Unip step response. 


l^mnui } (Rise unc, overshixit and real RHP 
poles). 

(a) A stable unit feedback system which has a 
real, right hiilt-planc open Uxip pile. mUvSt 
have oversluH)! in its step rcspinM;. 

(b) llie amount of overshcmi is related to the 
“rise lime * and the location <if the righi half 
plane pile, p, as follows Define the “rise 
tmu*’\ f,, as: 

r, sup j I y(M lor (t (0, / j j ( V 1) 


(and where in discrete lime, the sup is over 
7 ^ k € ) then the overshoot, ^ 

sup ( r(r)). satisfies 


Ph 


. , pit, 4 A) 

\{pt. I )/.(/), (,) 4 1) ■ ^ 


(3.2) 


7Voo/ (a) I dIIows directly from Ixmina I (a) 
since for p c R ’. Lip, f ) * 0 

(b) from the rise lime definition, (3.1). 

.■(f) -( l (,1, (3,.4) 

Using (3 3) in the integral equality (2.4) we 
obtain: 

- S Lip. 0c(0 dr - S Lip. o( I M d/ 

/, " t,' 

(3.4) 

Lrom (3 4) and the dehnilion of the 
overshoot, It follows that 

yJsLip, t)i\t zSLip. /)(l Mdr (3.S) 

L " L 

which leads to (3.2) since 

{s hip. -f)(l -{dlj/ls Op. /)(!/) 

- ’ \ipt. - \ )f:(p. h) +1). (.3,6) 


Thus It IS seen that long rise limes (i.c. “slow” 
closed IfKip response) in a system with real 
unstable open IcKip piles implies large overshcxit 
in a unity feedback configuration. I1iis differs 
from the case of an open Imip stable system 
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where wc would normally expect sihort rise timeji 
Id give large overshixit, llic result here can be 
thought of as a “demand’' for “fast action” 
imposed by unstable poles in the open Icxip. 

Using the standard rule of thumb (eg. 
Middleton and GcHidwin, l<>90), the rise lime, t,, 
can be related to the bandwidth, Wgi, (in rads 
via; 

t,o}fj 2.3 (3 7) 

where the bandwidth» (Oh. is defined to be the 
angular frequency where the magnitude of the 
complimentary .scn.silivity function is “ 3dB, i.e. 



Wc assume that a unique frequency o)^ within 


the raingc 



exists such that (3.K) is 


satisfied. Note that the rule of thumb, (3.7) is 
approximately true for a wide range of systems, 
7'(y). which have a “reasonable” step response. 
Cases where this rule breaks down may include 
systems with lightly damped complex poles in 
the cIoschI loop (in which case may not be 
well defined). 

From (3.7) we see that to be able lo keep the 
overshcHJt >■,,, below about 2(1% wc require 






1 - 2 ’ 

In the next lemma we show that real, right 
half plane zeros imply undersfunU in the step 
response, and that to keep the undershoot small, 
a low bandwidth is required. 


l.emma 4. (Settling time, undershoot and real 
RHP zeros) 

(a) A stable closed loop system which has a 
real, right half-plane, open loop zero must 
have undershoot in its step response. 

(b) The amount of undershoot is related to the 
settling time and the location of the zero, r. 
as follows. Defining the “settling time” as; 


With the settling lime, r,, as defined in (3.10) 
and the undersh(M:>l as defined above, we have 
from (3,12): 

yJsEiz, -Odr 2!:5 0.9£:(2, -r)d/. (3.13) 

U I, 

From (3 13) it is clear that for a given z, the 
undershr>ot must become large as r, becomes 
small. In particular (3.11) follows from (3.13). 

vvv 

If wc assume, as is usually desirable, that the 
settling time is approximatly equal to the rise 
time, and using the rule of thumb relating the 
bandwidth, a)„, and the rise time, r,, (3.7), we 
note that to keep the minimum undershemt given 
by (3.12) below about 10% wc require 

+ A;)-z(l (.114) 

Thus we sec that unstable zeros place an 
upper limit on the bandwidth that can be used. 

Remark 2. As discussed in Remark 1 the above 
conclusion is, in fad, independent of the type of 
controller used; i.e. (3.10) holds for any 
(Non-Linear, Time Varying) control signal 
generated in open or clo.sed loop etc. provided 
only that the input step rcstxmse is hounded. 

VVV 

Remark 3. The above results appear lo con¬ 
tradict the results of dark (1962), and 
V'idyasagar (19H6) where system “undershoot” 
occurs if and only if there are an odd number of 
real right half plane zeros. This paradox arises 
due to different definitions of “undershoot”. In 
the above two references, a system is said to 
undershmil if the initial sign of v(f) is negative. 

VVV 

The following lemma describes the trade-offs 
inherent in systems with a real right half plane 
pole and a time delay. 


^ inf ( 7 : v(r) - 0.9 for t e | / , ^)) (3.10) 

/ 

(and where in discrete lime, the inf is over 
T^kAk. kel*) then the undershm^t, 

y,„^sup (““V(0} satisfies 


Lemma 5 (Real RHP pole and lime delay). A 
stable unity feedback system with a lime delay, 
T, and a real right half plane open loop pole at 
y = p. must have overshoot, y,>„, which satisfies 

E{p, T) - 1 :^pT. (3.15) 


.v\.. 


0.9 

E(z7o d 


Pr(H}f. Follows directly from Lemma 1 on noting 
that y(0 = 0 for f < r. VW 


Proo/(similar lo Lemma 3) 

Y(z)^{)^SE{z, -r).v(r)d/. (3.12) 

0 


From (3.15) it is clear that to be able to keep 
the overshtK)t below 20% we require: 

pr sO.2. 


(3.16) 
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In discrete time, r will be al least A in 
practice, and so (3.16) suggests: 


A ■< 


0.2 


P 


(3.17) 


The following lemma discusses the case where 
we have real right half plane poles and ^cros in 
the open loop transfer function 


Lemma 6 (Real RHP poles and zeros) Suppose 
a stable, unity feedback system has a real right 
half plane open Imip pole al y-p. and a real 
half plane zero at y-j then (a) if p < z. 
the overshcxit, satisfies; 


I 


1 


p(l ^ Az ) 

(b) If p > 2 , the undershoot satisfies 
1 


(3. IS) 


P( 1 + ) 

z( 1 -f Ap) 


(3 19) 


1 


below 20*^', we require 

2 >^0.2^ 0 4 
P .1»^ 




(3 24) 


From (3.11), to Ik able to keep the 
undershcKii below lO'S^ we require* 


:( -23 


(3 25) 


From (3 25) and (3.24) we sec that for 
0‘ r- p, less than 20^v ovcrshiKM, and IcjiS 
than 109J undcrshiKU. wc must have 


/, .-b3/, (3 26) 

Thus the system must rise quickly but settle 
shiwly. Although this wade discrepancy m rise 
time and scitlmg time is fxrssihlc. wc suggest that 
it IS almost always highly undesirable, and thus 
wc suggest that the case tl : * p is very difficult 
to control 

Similar arguments do not lead to the same 
conclusion in the case where 0 - p * z In 
particular, provided (3 21) is satisfied, it appears 
that control with resonahle overshoot, under- 
sluKit. rise and settling limes is possible 


Proof, (a) From Lemma 1 and Lemma 2 we 
have 

S(E(p. -D - /■:(:. -/))v(f)d/= ^ (V2(») 

0 /> 

The result follows since 

L(p, - /) ??/:(z, t) lor p > z. 

(b) F'ollows similarly to (a) VW 


Wc note from part (a) that for 0< p* z. an 
overshoot less than 20% can only be achieved it 

2 P 

-- . (3.21) 

1 + Az I i Ap 

(Note that for pA >0.2, there is no z -0 such 
that (3.21) is satisfied. ) 

Conversely, for 0<z<p an undcrshrKit of 
less than 10% can only be achieved if 


1 + Ap 


11 


1 Az 


(3.22) 


(Note that for Az > 0.1, there is no p ^ 0 such 
that (3.22) is satisfied.) We would argue, from 
Lemma 3, Lemma 4 and (3.22) that in fact, it is 
very difficult to achieve satisfactory performance 
if z <p. To see this, wc will assume A is small, 
in which case (3.22) becomes: 


p>rllz. (3.23) 

From (3.2), to be able to keep the overshoot 


4 I Hl OUl N( Y DOMAIN SI NSiriVIl Y IUNC'IION 
(ONSl RAIN IS 

It can be seen above that there are 
fundamental limits on the bandwidth im|>osed by 
the locations of the |>oles and zeros of the 
system In Section 3 the bandwidth limitations 
were molivaied by time domain arguments lo 
gam further insight into (he constiumls, wc next 
view them from a frequency domain perspective, 
lo do this the sensitivity functions, .S(y) and 
/(y|, defined in (2.2). (2 3) arc considered 

Having .S small reduces ihe closed IcMip 
sensitivity to disturbances and plant variations 
whilst having / small reduces the closed Kh>p 
sensitivity to measurement errors However, 
both sensitivity functions cannot be simuL 
taneously small since S f 7 - I. 

It will be seen below that there are integral 
constraints on these sensitivity functions Lhc 
consirainls presented here are unifications of Ihe 
results in Freudenberg and Loozc (19HH) and 
Sung and Hara (19HK) which arc based on the 
work of Ffodc (1945). 

Lrmma 7 (Sensitivity function and unstable 
poles). FVovided the OfK*n ItMip transfer function 
has relative degree -I (discrete time or 
continuous time with a pure time delay) or >1 
(Continuous Time), and the closed loop system 
is stable, then the sensitivity function, S(y), 
satishe.s the following integral constraint: 


f" i, 



log 

'(.i 

: 14 , 1 ) 







2K6 
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/e' - I \ 

where .VI ) magnitude of the 

frequncy response of the sensitivity function at o> 
rad see f/ is the set of integers, i, such that p, 
(the ith open loop pole) is unstable, and where 
p\ is the continuous counterpart of the ilh 
unstable pole, p,, i e. 

^ ‘ logd + A/),). (4.2) 


Proof. For the conlinuou.s lime ca.se, see 
F'rcudenberg and 1 am)/c I he discrete 

time case follows directly from Sung and Hara 
(lyHK), rheorem 2; by using the change of 
variable f/iA (p, and by translating from the z 
plane in Sung and Hara to the y plane 

where y VV'V 


Iremma 8 (Sensitivity (unction, unstable poles 
and zeros), Suppose a stable closed loop system 
has open loop poles, p, (i c U) which are outside 
the stability region, and zeros, z^ (y r (/') which 
are outside the stability region, then for all 
If W: 


constraint 


OJ 51 nc ( -- j 


log j 7 (- 


.1 V' /1 A\ n 

F/„ + ^ -T (4, 


where : W is the set of zeros i such that the ith 
zero, z,, is outside the stability region; t is the 
system time delay (defined to be rA in discrete 
lime, where r is the relative degree); sinc(ic) is 
sin (x)/x: and Ho is the system vekKity constant. 

lim (y/.(y))^0. (4.H) 

y •(» 

Proof This is a dual result of Lemma 7 which 
appears to have been unnoticed previously Sec 
Appendix A for a proof. VW 

Lemma 10 (Complementary scnsiliviry 
function). For any stable closed loop system, we 
have for all i f U 


■^l/^T|loglW,'(/),)! 


A'(.-) 


" '-A i ' 

A 

, -.. , ; 

/ 

1 iio.A 1 

— 

> log 1 / 1 i\(u (47)) 

t A I 1 


A ^' 

A 


where r is as defined in Lemma and BA)') iv 


do) (4..^) 

the discrete lime della i)|x:raio! Hlasehke 
product of the zeros 


Be (yl ^ lyr’ 

(4 4) 



where 


nnil W,,(y) is the discrete tunc delta operator 
Blasehkc product of the poles; 




.("' ") (4..M 


I 'C'- " 


where 


7cV(i f ^p:) 


rr(}of. Dual of Lemma 8. (»r. sec f reudenberg 
and I.ooze (1088) lor the conimuous case, or 
Sung and Hara (1088) for the discrete 
ease VVV 

In the following section we discuss some of the 
implications of the above lemmata 


Proof See Freudenberg and l.ooze (1087) for 
the continuous case, and Sung and Hara (lOKH) 
for the discrete lime ease, where luA ~ (p and 


Lemma 0 (Unstable zeros, iirne delays and the 
compicmeniary sensitivity function). Provided 
the open Uxip transfer function L(y) has at least 
one integrator and provided the closed Icxip is 
stable, then the coinpleincntary sensitivity 
function, l\ satishes the following integral 


5 INTKRt^RI l AI ION Ol FRt 01 I Nl Y DOMAIN 
CONSIRAININ 

In the previous section wc gave four results 
giving fundamental constraints on the sensiliviiy 
functions. In each of the four ca.ses, the 
amplitude of the frequency response satisfies an 
integral equality. The di.scussion in this section 
will centre on lower bounds on peaks m the 
sensitivity function. To aid our discussion wc 
make the following definition. For any stable 
G(y) we define: 

^ - 1 ! 

IK;( )iu =■ .su^) c;(—- )j'. (5.1) 
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Lemma II (Unstable pole(s) and Time 
Delays). Consider any stable closed kxip system 
where the open knip sy'siem has an unstable pt»le 
at Y~ P, and a delay of r. then 

(5.2) 


Proof. Follows directly from Ixmma 10 since: 
_ X(p,) 

i .It 

.1 A 


/■ 


- 1 


rdnJ - .T. 


(5 




From Lemma IL wc no*c that to he able to 
achieve a peak in / (y) of less than about 12, we 
require 

V/, r Rc {p ,} 0 2. (5* 4) 

Note that this agrees with the conclusion from 
lime domain arguments m 


Lemma 12 (Unstable pole and unstable 
zero) C onsider any stable closed loop system 
where the ofXMi loop plant has unstable poles 
and non-minimum phase zeros; then; 

lr/’(•)l^ \H ‘(/Ml (.^-M 

l|.V( )|l, - Iff,,'(;,)! (5.0) 


Lroof. Follows directly from I emmata K and 10 
using 13.3). See also Freudenberg and 1 ooze 
(1*^88) and Sung and Uara (lOHH) VW 


If we take, for example, the case where we 
have a single real fxile, p, and a single real zero, 
z, Lemma 12 gives 


p f r 4 Anri 

ii'n-)ii, - ' . 

P - 2 

(5 7) 

p > r 4 Ap: \ 

IIMTIL - . -1 

(5.H) 


P - 



t it I : 


shown in Fig 2 where 



and (he normalized angular frequency, u is 

Utf, 

I 'pper biHinds on .S(ie| aie lypieally 



1 5oi 

(n 


.S ( ii> ) ■ 

(i>r 

Ml. 75 

(5 11) 


fi)„ 




2n>#j 

ID 


•S ((..)- 

14 for -2 

(5 12) 





(Note that it /.()') is slrielly 

proper, and i 

includes 

at least one 

integrator. 

then \(0) • 

0 und 


1 .) 

We then have the following result 

Lemma W (Unstable poles, bandwidth and 
sensitivity) f*or any system wliieh is closed loop 
stable, has relative degree greater than 1, and, 
(5 11) and (5.12) are satisfied, (hen 


(See also Freudenberg and Loo/e, 1987 ) 

Thus, to be able li) keep the peaks in 7 and .S 
less than about 15, we require either; 


||.V( )il, exp (V p; 4 0 ) (5.13) 


or 


5 4 2Ap 


i\ If) 


(5.9) 



_ 

-0.4aV 


- 5/7 


(5.10) 


(See also l^mma b for similar lime domain 
constraints.) 

We next consider the integral constraint (4.3) 
In doing this, we first give approximate bounds 
on the sensitivity function .S From experience, 
the sensitivity function has the general form 


Proof. Using (4 3), we have 


v.: = f 


log .V( ti)} doj 

HI 

- I log\(fM)do) 

Jit 

4 logS(rjOdoi 

f ^ 

4 I log .S (r//) dri>. 


(.V14), 
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Using ihc bounds given in (!S.ll), (5 12) wc 
have 

J r2 71or((| ^ 

JT ^ p] 4 (i.64aj;^A. (5.15) 

vvv 

Note that this type of arguments namely, 
“forcing” to be “small” in some range of 
frequencies necessarily implies that it is large 
elsewhere has been used by several other 
authors. F-or example, Francis and Zames (19K4, 
Section V) have shown that S’ can be made 
arbitrarily small over any interval, but only at 
the “cost” (when there are non-minimum phase 
zerfwi present) of arbitrarily large sensitivity 
outside the interval Freudenberg and L<k)/c 
( 1MH8) consider several cases such as (i) keeping 
the sensitivity small over an interval, and (ii) 
“Relative degree” type assumption on /.(V) 

(e g. |/-(jni)| , (I) ‘ ni,) 

F^orn Lemma 13, if the lower limit on the 
peak in .?(<u) is to be not more than 14, then it 
is approximately required that 


iOfiil (5.16) 


Thus (as in (3.K)| unstable p<»les place a lower 
limit on the bandwidth that should he used 
Also note from (5 16) that good sensitivity 
requires to he small compared with 1, i e 

fast sampling is generally desirahle 

Next, to investigate the corresponding con¬ 
straint, Lemma for zeros, complementary 
.sensitivity function / (y) will he used To do this, 
it IS hrst noted that the general shape of the 


function 




is as shown in Fog. 3. 


A_ (utA 

where i' - - ( ol I - 


(t) and I* (normali/ed) 


IS 

Approximate bounds for /(r) arc (from 



experience) as follows; 

f{v)^l2v(i}ff for vo}/t<()J5 (5.17) 
v‘ a>it 4 36 

7 ( I') 2. (5. 18) 

V lU fi 4 30 

Ft is also assumed that at low frequencies L falls 
by at least 20dB per decade. Ficnce 

\Hu\ >iu„. (5.19) 

The following result is then obtained. 


Lemma 14 (Unsiable zeros, delays, bandwidth 
and sensitivity). For any system that is closed 
kK>p stable, and which satisfies the bounds in 
(5.17) to (5.19), then 


||7()||..?().25cxp(2r.»„ 



Lnnpf. Let 



/ f ( 



(5-20) 

(5.21) 


Using the hounds (5.19) and (5. IK) on the 
integral (4 7) and splitting the interval of 
integration gives 



F'valuating the integrals on the right hand side 
of (5.22) gives 



/'(I*) dp 


2 . 11 

4 7Ti2 (5.23) 


and Ihc result follows. 




Ihus to keep the peak in / (p) below about 
V2, we require 

’ t ' ' *■ / - 

Thus we note that unsiable zeros and/or lime 
delays give an upper Ixiund on the bandwidth 
which should be used In the next section, we 
bring together the results of the previous 
sections, particularly Sections 3 and 5 in the 
form of several design guidelines. 

6 DESIGN GGII^l:LINl:S 

6.1. “Avoid using Controllers which have 
unstable jxdes or zeros, or which have a time 
delay” 

We note from all the constraints presented so 
far that adding a time delay, unstable poles 
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and/or unstable zeros necessarily makes the 
scnsilivity/undershoot/overshcKn wnstraints 
worse. U at all possible this situation should be 
avoided. In cases where a plant can only be 
stabilized by a controller which is unstable 
and/or has unstable zeros, alternative solutions 
should be M>ught. Passible solutions are the use 
of additional control actuators, the use of 
additional state variable measurements and/or 
plant redesign. 

This guideline has been discussed by other 
authors such as Freudenberg and Looze (1988) 
and Zames and Francis (1983). 


6.2. '‘When implementing Digital Control laws, 
do not use slow sampling” In particular we 
suggest: 

V 2jr 

(o, ^ ^ ” (6.1) 

A 

Again note that the design tradeotls Ixrcomc 
more difficult as A increases Consider for 
example (5.16). A necessary condiiion for (5 16) 
to be saiistied is o>^A< 1, i.e. ^ 2jroff, Note 
also that for a proper, discrete lime system, the 
minimum time delay is A, and hence guidcime 
6.1 suggests A be small 

Note that this ‘ rule of thumb ‘ has been 
suggcslcd in many sampled data control texts; 
however, few have considered the sensitivity 
implications of violating this suggestion. 


6.3. ‘‘If the open loop plant plus controller has 
unstable poles, the bandwidth of the feedback 
loop should satisfy: 

“ i/i/yA) " ^ ^ logd ^ A/),). (6.2) 

A <,r 

This guideline is motivated directly frt>m 

(5.16) and (3.8). (Note that (3 8) leads directly 

to 


^ log ( 1 4 A/7 ) 
A 



6 1 3.5c»>,<A X 
6 4 2 5(0,< A ' 


~ iojftd - w„A), ) 

This guideline seems to be less well known than 
the other guidelines m this section, though 
Horowitz (1963) seemed lo be aware of this 
constraint. 

6.4. “If the open loop plant plus controller has 
unstable zeros and/or time delays, the bandwidth 
should satisfy: 



This guideline comes directly from (5.24) and 
(3.13). ( Note that for a single real RHP zero, and no 
lime delay, (6.3) and (3.13) agree in terms up to 



fii, 4 

order Az) This guideline is in agreement with the 
Remark m Zames (1981) following llieofem 4. 

Also note that guidelines 6.3 and 6.4 may be 
mutually contradictory. In this case, altemacive 
approaches lo the design problem (us discussed 
after guideline 6 1. and in the lollowing example) 
arc suggested 


7 INVI RTI I) in NDl I l/M I XAMIM I 
Consider an inverted |>endulum system of (he 
type* illusiialcd in Fig 4, 

Using Lagrangian mechanics (sec for example 
Kibble, 1973), a non linear stale space model for 
this system can lx‘ shown lo be: 


I 



ti 

m 

r/- 


4 fCV Sin 0 g Sin 0 Cos | (7.1) 

1 

/{ i Sin ff 

^ m ' 


X 


C(fs h f) I Cos 0 Sin fy 
m 




(' 



(7 2) 


where g denotes the acccleriition due to gravity. 

A lincarizccJ model for this system about the 
origin IS readily seen lt» he 



0 


0 





u (7.3) 
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y-Mi n (J 0) 



(7 4) 


where (x, x. x » X 4 ) “ (y, y, 0 ) 

ll is relatively easy to show that ihe alx>ve 
state space model is both controllable and 
observable (provided M, m - 0 ) and so a wide 
range of controller designs are possible The 


tran.sfer function from u to y is 



V'( v ) _ AC( v />)( v 4 6) 

(7(.v) v'(a a)(s 4 a) 

(7.5) 

where 

1 

^ ' M 

(7 6) 


'■ ^ • V: 

(7.7) 

and 



/(Af 4 m )/,' 

" V M f • 

(7.8) 


Note that, in view of guidelines (b.3) arul (6 4) 
this iransler function is impractical to work with 
f irstly It IS both unstable and non minimum 
phase Secondly the unstable zero occurs at a 
lower frequency than Ihe unstable pole. Hence, 
guidelines (6 /i) and (6 4) cannot be both 
satislied 

One can still design a controller lor the above 
case, however, Ihe above considerations indicate 
that the controller will have very ptuu 
fx-rformance ( onsider the situation where 
t ■ \m, g " 10 ms M ni O.S kg. In this 
case K - 2, h ' V 10 aiul a V20 

I'hus, from (‘^ 7) and (."S K) it is clear that any 
controller design which siabili/es this system will 
have sensitivities wliich satisly 


||/'(•)||. -.^.S2S 


Also, trom Lemma 6 it can be shown that the 
undershoot must exceed 241' / 

This IS clearly unacceptable from a practical 
point of view Ihe reader may gam some 
appreciation of the difticulty of the control 
problem when only position is measured, by 
trying to balance a brinmi with both eyes shut! 

In view of the high sensiiiviiy described above, 
a Ix'llci option is to consider this system as a 
single input two output svMcrn, 1 e to seek 
additional state measurements Suppiisc, for 
example, we retain >1 ^ v but intrixluce an 
additional measurement V;. which is the angle of 
the pendulum, (i. 


-V, 
d ' 


,v, 



functions from u to Vj and Vi respectively: 

7(7) 7(7 


and 


d(s) v^(.y" ” 20) 


(7.10) 


Note that the double pole at the origin arising 
from the acceleration of the cart is unobservable 
in Vi However, we can easily design feedback 
from y. to u so as to shift the other two poles 
well into the left half plane. Guideline (6.3) 
suggests affi * 3V^20 r 15. 

We thus suggest the following control law; 

170(.v 4 V20) 

w -4 -- 

V 4 26 

•4,1 - A',(.V)v., (7.11) 

The transfer function from r to y, then 
hccomes: 

i'(,v) v (.v + v'2II)(n 4 2I.53.V + 22.3 72) 


('learly this gives an easier design problem. 
Note that the double integrator (which is 
unobservable Irom 0) eoiild riol be shifted; 
however, the unstable pole has been shifted by 
the inner feedback loop Note also that the 
unstable zero is still present In this case design 
guideline (6 4) suggests that the bandwidth of 
the outer feedback loop should be ^ ^ rads 
f’he following control law lor the position lotip 
is suggested: 


?' - 

- lM,q(y 4 \2{))(\- > 21.53.S ^ 223 72)(a 4 I) 16) 

(A 4 26)(v 4 vTi))(A‘ 4 LS.Sa 4 10(1.31)) 

X ( V* V,) - A',(.^)( V* v'). (7.13) 

lb test the sensitivity of the controller given 
hy (7.13) arul (7.11), consider the sensitivity 
(unctions defined as follows; 

.S(.v) - (/+ (.'(.v)A.(v)) ' (7.14) 

iinci 

7 (.V) = (/ 4 (;(,v)\'(.i)) 'f;(.v)/v (.v) = 7 - A(,v) 

, (7.15) 

where 

(;(.v) - [r,',(.v)r;.(.v)|' 

and 

^■(.v)^(A:,(.^)7^.•,(,v)l. 

Since the mam interest is in the behaviour of 
y, the 1, 1 components of S and 7 shall be 
considered, which are: 

_ ,v"4 15.5a V I06.3r' 

•V"(') -- , 57 .;^. < 8*.4v-4rsy’:7vT'iTri 

(7.16) 


l.ct ( 


denote the transfer 
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^ _ -19.95 - ^5^.75^ UU 

" ' 5^ 4 15 \s ' f 86.45- 59 7.rri0 1 

(T17) 

We then find that HA,, ( HU ^ 13, ||7n( )|!, = 
1.2, (he undcrshmil is 11 *^y and the ovcrshwl is 

Thus, in this example, the design guidelines 
given sugge.st that the original problem fi.c. 
without measurement of i.s very difficult, 
while the problem where measurement of the 
pendulum's angle is available is well known to be 
easy - 


K ( (INC I l SIONS 

In this piifK'r we have considered IkiiIi time 
domain and frequency domain equalitv con¬ 
straints which arise in the feedback control of 
linear systems Based on these constraints wc 
have suggested the following guidelines lor the 
selection of the leedhack loop bandwidth, 

(t)fA I (Oni\) ' [ In (1 i Ap,) (b.2) 

( A 


(where U is the set of i such that p, is unstable) 
and 



( 


(6.3) 


(where ( ' is the sel ol i sucli I hat r, is 
“unstahle". and r is the lime dela>) 

One eonsequenee of the above design rules is 
that there exist systems which although ‘corv 
irollahlc ' and ‘observable' (in the usual linear 
system ihetnctic sense), cannot be sensibly 
controlled In ihese cases it is suggested that 
additional measurement iransduccrs/control ac¬ 
tuators may be crucial to a successlul conlrollei 
implemcnialum 
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We tdsserse lhai zeros al * in Ihir y plane map in zeros al ihe 
origin in ihe r plant 

We then follow ihi pimd of l.emma 7 m rhe aniunuous 
lime ease (see I icudenberg and l IMH 7 ) using the 

lonlour stiown in t ig S loi ihc com(>leii r plane Noie that 
tut Mds arc also required lor zeros al ihc origin in the r plane 
(I (• /eri>v al » in ihe ) plane), nt ihe iliwrcte Mine ease 

the iniegral around ihe loLd eonloui V f,, r < f 
< ^ ; IS zefo t he inlcgral along C,, sahsfics 


lim log / ( r ' I dr 2\ 


log 



(A V) 


Ihe eoritribijiion Iroin eatti ol rhe eonlours C,, 
/ I. \ t an Ih* evaluaied as 


hill I log 


Kr 


‘) dr 


:.]Ji Re 



tA 4) 



Fm. ‘v ( oniour for comple* r-plarM: um;iJ In prove l^mma 7 
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The canirihution from can cvatuaied Wi hilkiws origin in the r-pianc. On this scnu-circte we have 



The final term needed for the coniinuouH time caM; ik a cut 
•et to alkr*v for the Hingulanty of log 7 caujicd hy the time 
delay, c Thin lime delay cauinc?* u singularity at r 0, i,c 
y «• ». Thus we take a iiemi«arcTt‘. 7,, of radius i about the 




Xc, r 

- 


(A 6) 


The result then follows from (A T) to (A.6) on noting that 
the zrrm, z,, in (A 4) occur in conjugate pain, and by 
changing from the variable i' m (A T) to cu where 



VW 



1 , V(A rr. No p|), m\ 
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On the Structure of Suboptimal Controllers 
in the Sensitivity Minimization Problem for 
Distributed Stable Plants’^ 

HITAY OZBAYt and ALLFN TANNENBAUMt 

The structure of all the suboptimal W" controllers in the sensitivity 
minimization are described for a class of distributed plants. For stable 
plants with continuous transfer functiorts finite dimensional suboptimal 
controllers can be obtained by approximatinft the f/i/?ni7c’ dimensional part 

of the optimal controller 

Kry Hord» Di&inhuicd paranicicr sysicms. t>pnmal coiund, MriiMiiviiy inimmi/»linn. 
i»ub(ipliniul cuniro); tinilc dimcnsionat i'tinlrt»lU*r\. timr Ur-byv 


Abotracf—tn this paper wt* consider the //' sensitivity 
mmimirntion proWcin for SfSO distributed stable sysiems 
Wc elucidate the structure of all the suboptimal //' 
controllers for stable distributed plants with invertible outer 
parts and ranoniil weights Wc identify the finite and intiriite 
dimensional parts of the controller llie conditions under 
which one can obtain a finite dimensional suKiptimal 
controller by approximating the intiniic dimcnsitmal parts of 
the optimal controller are discussed fhe* case where plant 
transfer furKlion is continuous on the boundary is also 
dj.scusscd 

I iNTROI)liC“IK)N 

In this paper we ct)nsidcr the t)nc bU>ck //' 
sensitivity minimi/ation problem for SISO 
infinite dimensional systems. Our main purjxrse 
is to develop a method for obtaining finite 
dimensional subtiptimal If ' controllers. We use 
the results of Foias and l anncnbaiim (1989) to 
describe the structure of all the suboptimal //' 
controllers In the case of rational weights and 
distributed stable plants with invertible outer 
parts wc will be able to identify the finite and 
infinite dimensional parts of the controller. A 
natural way of obtaining a finite dimensional 
suboptimal controller is to approximate the 
infinite dimensional part of the optimal 
controller. 
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It IS known ihiit f/‘-optimal conirollcrv (or 
finite dimensional plants with ralioiul weights 
arc hnile dimensional Iherefore. another way 
to obtain a finite dimen.sional suboptimal 
controller is to approximate the original plant 
with a finite dimensional system, compute the 
optimal controller for this approximate system, 
and then check whether this controller is 
suboptimal lor the original plant However, it is 
obvious that there is no guarantee lhal the 
(>ptimal controller of the approximate system 
will stabilize and yield a suboptimal jKrformanec 
for the original plant Sec Wu and Ixe (19KR) for 
all the dcliiils about this mcihiKl and the 
difficulties asstH'iated with it. 

The techniques and resulis of this paper arc 
valid (or a large class of stable distributed plants. 
However, when we demonstrate our method in 
detail with an example, wc will .specialize to 
delay systems For such systems the approach of 
Flamm (19Hfi) is similar lo the one given here 
Ihe methods given below have already been 
applied to a flexible beam problem; sec l>cnz et 
al (19H9). 

lire rest of the paper is organized as follows. 
In the next section wc summarize the main 
results of Foias and Tannenbaum (1989), where 
the main idea is to use the one step extension 
theory of Adamjan et al (1971) lo characterize 
the suboptimal solutions lo the gcncrali/cd 
interpolation problem. In Section ^ we exploit 
this characterization to illustrate the structure of 
the optimal/suboptimal //' controllers. Wc 
apply our procedure to obtain finite dimensional 
controllers, for distributed stable plants with 
invertible rational outer parts in Section 4; plants 
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whose transfer functions are continuous on the 
boundary (e g. strictly proper plants with pure 
delays) are considered in Section 5; and a design 
example is given m Section 6 to illustrate how to 
deal with this situation f-inally, in the last 
section we summarize the results of the paper 
and make some concluding remarks. 


Notation. Our notation is standard. All Hardy 
spaces of this paper arc defined on the unit disc 
in the usual way. In particular, we consider the 
systems as transfer (unctions (of the complex 
variable z i.c. (he / transform variable) For 
continuous time systems we can think of this as 
transfer functions (of the Laplace transform 
variable v), transformed via bilinear transforma¬ 


tion A 


T •(! that maps the unit disc to 


114 2 
T 1 - Z 

the right half plane, rhcreloie one can think of 
all the formulae given m the paper, in terms of 
the variable 2 . as an expression in terms of v by 
simply replacing z by the inverse transformation 

T.v - 1 


2 l‘RM IMINAKY HI MARKS 
The sensitivity minimization problem is to find 
an internally slahili/ing controller such that 
the following optimum performance is achieved 

inf ||W(1 f n ) 'll, - :fi. 

( tlahiluinn 


problem as follows. We first invoke the Youla 
parametrization for the controller 

This gives us 

/i - inf lIVY-7^(211.. 

It IS obvious that 

p max (I W(b,J|: h,, is a zero of 7^. on JD} -: p,,. 

We will now make the assumption that 
which brings us (see Francis and Zames, 19H4) to 

p = inf ||iV - (1) 

( onversely, from (1) by linding realizing fz, 
and by inverting W and we get the optimal 
controller (which mlcrnally stabilizes the 
system and satisfies 

llVVd 4/T ,,,) -M (2) 

One important point which should he 
emphasized is that when the plant outer part 7^,, 
has zeros on the boundary it is only approxim¬ 
ately invertible as a stable causal transfer 
function (in the precise sense explained in 
vScction 5), so a proper optimal etintroller docs 
not exist in such a case. This leads us to the 
definition of subopliinality. (iiven a tolerance 
r ' 0, we say that ( , is Mih(f/?fona/ (with 
ti»leiance f ) if it inlernallv stabili/es the system 
and satisfies the bound 


Sec Fig I for the closed loop set up, where /* is 
the plant to be controlled and W is the weight 
modelling the disturbances Here wc consider 
stability in the sense of H', that is /. IHIU) 
stability (hounded energy inputs give rise to 
bounded energy outputs). Wc assume that the 
weight W and its inverse W ' are stable, (i.e 
W, W ' c //')r and nn>teover is taken to be 
rational. In this piifKr we are going to deal with 
stable plants with noneonstant inner parts. In 
other words the plant is assumed to have an 
inner/outer faclorization I* ~ where m is 
noneonstant inner and is outer. Wc will 
further assume that on the unit circle J/). has 
finitely many zeros. 1'hen wc can transform the 
sensitivity minimi/ation problem to a Nchari 

± 


w 



Fio 1 ( lo^cd Uh»p svstem 


llVV'd + /’f, ) 'll. ' II ^ - :f>. (3) 

Finding an approximate inverse for the outer 
part, when it is not invertible m //', is not the 
only problem in et)mpuling the suboptimal // 
controllers A key reason why wc are inieresied 
in suboptimal controllers is that the opiima! 
coniroller (even if the inverse of tmter part is 
proper rational) can be inliniie dimensional 
because inner part of the plant may be infinite 
dimensional It is this p<iinl which will be 
considered first: what happens when the inner 
part m of the plant is infinite dimensional So, in 
Section 3 the question of approximating the 
inverse of f], will be left aside, and it will be 
assumed that Furthermore when we 

study finite dimensional suboptimal eonlrollers 
in Section 4, wc will consider plants who.se outer 
pans are rational and invertible, so wc will be 
dealing only with the infinite dimensionality 
coming from the inner part Then, in Sections 
and 6 wc consider the case where f\, is only 
approximately invertible and may not be 
rational. 

At this point wc would also like to discuss the 
mclhtKl of first approximating the plant P by say 
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Pf and then checking if ihe controller obtained 
from this approximate plant is subopiimal for the 
original plant This method requires one to solve 

p- inf \\W 

V* //■ 

for p and (>,. On the other hand we knovb that 

W/ll. 

So, if we use the controller C) - 0^0 f/Or) ' 
for the plant P the pi'rforniancc p will be within 
i of p, prov ided 

Similarly, it is easy to see that the siability is 
preserved it 

/’Jll. ’ 1. 

I he stabilily eondiiu>n is well understood even 
il we do not know the solution to the optimal 
problem However, in order to urulerstand the 
lower bound lor r, given abi>ve, we need to tirul 
0,.p,. that IS to solve the optimal problem This is 
why m this paper we adopt the melhotl ol 
approximating the optimal eoruroller rather than 
the method ot using the opiimal eoruroller 
obtained by an approximate plant i his w ay w^e 
can compare our finite dimensional controller 
with the optimal eonlroller, and hence we can 
observe the etieels ot approximating the 
contndler on biUh stability and perhurnance 
In the light the above disiussion. we now 
assume that is invertihle, and consider the 
lolliiwing problem given m inner possibly 
mhnile ttimensional. aiul p • p, find the set ol 
all (J e //' such that 

\iW miJW^ - p j4a) 

l.,et us summan/e the results ol Toias and 
Tannenbaum (198^^0 in connection with the 
above problem Suppirse that the weight is 
rational; W{z) - p{z)i(i(z) where 

piz}^ Pn -f cp, ^ ^ 

and similarly 

q(z )^ f/o 4 4.^ 

(lc n IS the maximum of the degrees of p and q, 
so some of the above coefficients may well be 
zero) Let .V denote the unilateral shift on ff‘ 
and define the space //(m) “/f G m// Then 
the compressed shift associated with H{m) is 


m 

tklined as T where 

notes orthogonal projeerton 
First cxnisider the optimal case: p - p Hk 
optimal intcrfxslant which makes 

p. where 

can lx‘ computed using Sarason's theorem 
(Sarason. 1%7) which gives that 

p-|iW^(ni|, U’(/|:-p V 

Ilic essential norm is delined as follows; 

Ij W t 7 )ib supllVV i;)l C singular |>oirH of m) 

We need to assume p - !|VV(/)||,, (sc*c I oias et 
al , 19HK). to coiulude that W{ i ) attains its 
norm at a singular value p p In this case ihcie 
exists a singular vector h^,. tor the so-called 
(Hcrcovici et al , 19K8) sken IttepltC o|>crutor 

/V, p V/ )r/( / )* p(/ )/»( / )’ 

(‘denotes adjoini) which makes 

A,h„ -1) 

Ihc vector /i,, can be computed explicitly tiiun 
the problem data W pjq and m in lerms of a 
dcterminanial formula; see l oias and lannen- 
haum (1989), atul lanas et nl (19SS). Lhcn, /L*,,, 
can be found via Sarason s result as 


Let us now consider the sirielly subopiimal 
case; p p II is obvmus that in this case A^, is 
invertible and its inverse can be computed 
explicillv, again, the Inmiula is given in f oias 
atul l anncnbaum (I9K9) I his is going to be 
used in Ihe characieii/alKMi of all ihe suixiplimal 
solutions (J, f //' which make 

i|l^ mQ,\\. - p (4b) 

This characterization is obtained using the one 
step extension procedure o( Adamjan rf al 
(1971) Here wx* want to summari/e Ihe method 
briefly Set m, {:) zmiz) and lei 7, denote the 
compression ol S to //(m, ) - //(Vn) 0 Cz. Lor 
a f C fixed, the problem of finding a) - 

iW am tn, Q^^,^}(z} such (hat 

- am)(/j)| p 

can lx; solved using the technique described 
above for the optimal cas<* From one step 
extension theory (Adamjan et al., 1971) we 
know that the set of all such n r C form a circle, 
say r Lurthernuue. the equation of F can bt^ 
explicitly calculated Then, (he set of all 
suhopnmai solutions satisfying (4) is 
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obtained in terms of BapS.^, <P(u)): 


p(z} z^piz ^ ‘ Then, 


W - mQ, = B,^(z. 4>(u)), 

where 0(z) is a linear fractional map taking the 
unit circle to f, and u € H" , ||u|Us: | is the free 
parameter. 'Fhc explicit characterization is as 
follows. Set 


g((j^q{T)P,„„,q(Sy -p(T)P„,„,p(Sy)m. 
gi -^ q,>p{T)(\ ~ mm(0)), 
and 

hr-A„'gt, h,.^A„'g.. 

For a given or e F define 


hjz) m(z) - hy(z) - ahi(z). 


and 


Biz. a): = 


p'qiSyh., 

piSyh„ - aqu 


'Fhcn we have the following result. 


Prapo.siuon I (Foias and I'anncnbaum, 198*1). 
The set of all functions of the form 

W( 2 ) * VFfz) - m(z)Cl,(z) 

with Q. € H\ such that ||/1|| ,. p, is given by 


j/l(z, a) 

/Ti/FV)Vi, 

plsyh,, - dqu 


.u^/YMIulU-l 


where r and rj arc c'crlain explicitly computable 
constants. See Foias and Tannenbaum for 

the precise formulae. □ 


V SIRlKTURr: OK THK (Sl)B)OrriMAI 
( ON7ROLI,KRS 

Using the above parametnzation, we are going 
to obtain the structure of suboptimal controllers. 
Once more wc assume that the inner part of the 
plant is infinite dimensionaK and the outer pan 
is invertible in 'Ilicn, using the notation of 
Proposition 1. wc set /i{z, o). We can 

find the controller from the Youla parametriza- 
lion as C'= (1 - ) ', where Q. eH' is 

such that 

B, - W - PWy, 

llicrcfore, 

C^P '(B„'W~ 1). 

Wc now study B„, 

fl (2) ■ _ 

^ P(z)hM)-h,l:)-q„rd 

where h,(z) and > 1 ^( 2 ) are polynomials of degree 
s.n-1 and ^( 2 ) = 2"^(2 ') and similarly 


m ' p^q(z)hjz}- p\(z) q(z) ' 

-Mz)h„(z}~p(z}h^(z) ' 

i I _ -I- p ^q(z ) \(z) - ^„ 2" p(2 )Q: 

(p'q(z)hjz) - p'fijzj)(/(z) 


where A(z} - frg(z)q(z) - p(z }p(i). Recall that 
h^(z) =■ m(z) - hi(z) ~ dh.iz) It is easy to see 
from the inversion of the skew Toeplitz operator 
A,,, that hj and /12 have the following form [sec 
c.g. Lemma 2 1 and Corollary 2.5 of Foias and 
Tannenbaum (1989)] 

/|(2) +m(2)F,(2) 

and 

. , , /-(z) + m(2)F,(2) 

. 

for Mjrne /,, F)./-, F. polynomials of degree s2/i. 
This gives us 


rn 

^ -A( 2 )m(z)(A( 2 ) - F,(z)) + a( 2 ) 

X ( -p(2)h,,(2) + (/(2)/iJ:) 

p’</(z)i/(z)w( 2 )(A(z) /'..(z)) 

'■ p’((/(z)c/(z)/,(:) f i/(r)/i„(z)A( 2 )) 

where 

PAz):^ /'Kz) + ntF-(z), 
and 

fAz)-Mz)^dfAz). 


Since C cannot have p<dcs a! the zeros of m (by 
internal stability) we must have 

f„(z) - p(z)/l,,(z) + t/( 2 )/l^(z) - d< 7 „ 2 ' 7 »( 2 ) = 0. 

It is routine to check that this is satisfied by the 
mlcrj>olation conditions posed in the definition 
of h^ and h,. 

Hence we obtain the following expression 


^P'i 7 (z)i/(z)M+ m(z)(j7(z) 

... . F.(z)-A(z) 

0„(z) = i/(z) 

q{z)f„(z) + hAz)Mz) 


(ijz) 


where 


and 


d = ‘ -K T). 

u 






Note that 
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-A(r) p(r)p(- -) _ 

p'^q( 2 )g(z) (rq{z}q(7) ' 

„ ■) 
p' 

These formulae lead us to the following result. 

Propostlion 2. Assume that the plant is m the 
form P - mP„ with m nonconstant inner, and 
P,,P„'eH". rhen the set of all controllers 
which internally stabilize the plant P. and satisfy 
the bound 


II PC) ‘lU- 

for p /i, have the form 

M 4 m{z ) 

(5a) 

u e H\ ||i4|U s I. where (ij:) is a linear 
Iraclion Iransformation m the free parameter u 

... . U ^ U 
A:) ^ 

'vith </,.(/ .* poIvnomiaK of decree - ^/i 

They can Ik computed explicitly friiin the 
equations given in hoias and lannenhaum 
(1989) via/,. /, f and rj 

Proof. Recall that ro is a nonconstant inner 
function, and If A f If I rom the Youla 
parametn/ation, the controller must have the 
form /'CM ^ fC Then the 

weighted sensitivity function becomes W (1 
PQ, ) Detinmg (9. ” VW.X/ we see that 

Ill'll - m)ii. - i|H^ • 

Wc can use the resulis of Propnsiiion 1 to 
characterize all C/^ ff which make ||H 
^C^rll.-P This in turn characlcn/es all 
Q, 6 //' which make jiH (I )\\, * p Then 

the compulations in this section give us the 
structure (Sfj) for all the controllers ( - C/< 1 ” 
PQi ) I Qt ^ ' w hich salislv || H'( I 4 

^0-’||,-p. ' □ 

Figure 2 shows the bkKk diagram of the closed 
loop system with a subopiimal umiroller From 
the structure of the controller wc see that if //.' 
is rational and the tree parameter u is chosen as 
a finite dimensional transfer function, then the 
only infinite dimensional part of the controller is 
m and it appears at the feedback path around 
Gy. We thus identify the finite and infinite 
dimensional parts of the controller Note that in 
order lo have a finite dimensional controller wc 


m 


Dm I » , 

—— -1 

- 



f'K« - Sini^iuK o( ihc suK^umti) cAintiotki 


must chiH)st* the f^^ec parameter u depending on 
m, and moreover u iisell must be infinite 
dimensional, so that the infinite dimensional part 
of the controller gets cancelled 

As It can be seen from the above formula for 
( , It IS certainly not obvious (o chariHierize the 
set ol all u i li urui ilnjj ," 1. such that the 
transfer lunclnm 


1 i mG; 

IS rational Therclore, wc arc going to loUow a 
different approach to obtain finite dimensional 
subopiimal H controllers. T his is the subject of 
the next section 

4 IINtll DIMI NSKlNAl SliHiPIIMAl 
( IISIKIM 1 I KS 

Wc now use the above siiuclure foi the 
optimal controller and try to iibiain a finite 
dimensional sulniptim.il cimtrollcr As in the 
previous section we arc going lo deal with an 
infinite dimcnsiimal m furthermore wc will 
assume that the oulei part is rational and 
invertible Recall fiiim the TropoMtion I that 
since TV ' r // '. the structure desciihed by (Sa) is 
valid for the optimal ciiniroller as well In Ihc 
case of the optimal controller, however, the free 
parameter is absent in the term (»,/, that is, 
instead of we have a fixed function, say G. 
Hence, since T,, rs assumed to he rational, if we 
replace m by a rational lunclion in the 
feedback path around (4 we otnam a finite 
dimensional controller We nnw study the effects 
of this approximation of m by m, More 
specifically we want to answer the following 
questions under which conditions ihe stability is 
preserved, and what is the deviation from the 
optimal performance * 

For simplicity of Ihc notation and the 
computations, we will restrict oulselves lo the 
first order f>olynomtal weights 

niz) 

f/l.:)- 1. piz)-■ Ih, ^ p,z. 

If \ M, f 

and /ri(z) is any arbilrary inner function. The 
general case is similar, but explicit compulation 
of G requires to solve Zn linear equations, where 
n is the order of the weight (see Section 2), 
which complicates the notation and Ihe com¬ 
putation considerably kor (he above weight W 
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the optimal sensitivity and the optimal aintrollcr 
are given by the following 


Propoxilkm 3, For a plant P{z) - miz)P„(z) 
where P„ is rational and invertible in H‘, m 
arbitrary inner, and the weight = 

Pi, + piZ the optimal sensitivity is 




W(z) ' 


Conscqucnlly the optimal controller is 

^2 *) 

(jKz) 

X '(Z) 

I ^ m{z)(l{z) 


(5b) 


with 


(H2) 


p(z) 


The optimal [K-iformancc /i can also be 
computed explicitly. 


Proof. See Appendix A, 


[.:i 


Now we replace m by nif in the expression for 
the controller, so that the controller becomes a 
finite dimensional transfer function; 


r,(z);-( 


') 


W(z)lV(z ') 

P ■' 

1 + mf{:)pzlp(z) 


It is easy tt» see that if we use (, , in the closed 
loop as a controller, then the sensitivity function 
becomes 


W(Z)( 


I + m(z)iiiz/p(z} + A 
I + m(z)/)(z)/^ f A 


where A “ ("ir(- ) «i(z));iz//)(z ). 

Set 


R{z).- I t m(z) 

p V ,, / 

A,„(;): =- z(m,(z) m(:)). 


and 


.V(z)- 


A,.,(z) 

R{z) 


1'hen we can rewrite H, as 


This expression shows that for suboptimality of 
the rational function m, should be designed 
by studying the relation between the terms R 
and A^. 


From this point on, in the examples that we 
arc going to consider, we will conduct our 
analysts and design in the right half plane, which 
is more natural for continuous time systems. 
When we do this we transform the problem data 

u - 1 

by using the conformal mapz = ~~ between 

the right half plane and the unit circle. In 
particular k(s) denotes /?(2) i, u, ^^^d 

AJr):= A„(2) I,... 1 ). and similarly for 
all the other transfer functions. Let us now 
compare fi and to analyze the suboptimality 
of Cf 

First of all in order to guarantee stability we 
should have 

1 + -V(5) =^() 

inside the closed ri|ht half plane, a sufficient 
condition would be X e H‘\ ||A"||, < 1. 

Also, since wc are liKiking for a suboptimal 
controller, ir norm of should be close to p 
Note that if we could make 1 » ||/V||., i e 

|/i(j«i)| » |A„,(jr.))| 

for all lu 0, then we would have 

Vr.i '0 

which implies that ||W, ||,||W„p,|| r “ p However 
this is not possible in general because there is no 
good uniform (on the imaginary axis) rational 
approximation for an irrational inner function 
which has essential singularities on the bound¬ 
ary. Tins is the mam diftieulty in finding the 
finite dimensional suboptimal H‘ controllers for 
distributed systems with invertible outer parts, 
lo illustrate this point wc would like to give the 
following example. 


Example Choose the weight to be the first 
order low-pass filler 


VV(.v) 


^ h ^ 1 

T,..S 4 1 


where 0< < I, > d. and take the plant to 

be 


P(S) = C ^'Pis) 


with l\) rational and invertible in H\ Wc use 

z ~ ~—; in going from right half plane lo the 
4-1 

disc. Therefore, wc compare 
1 /4 1 


U \ T..V -t- 1 ' ' 




and 


A,,(.v) = 


,v+ 1 

T.,J - 1 


T,.V + 1 


(C 


9 T»J + 1 


m,(s)) 
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m 


where m^v) iv a finite dimensional (e g, Pad^) 
approximation tor the delay term e We 
observe that |/i(jn>)! oscillates around < I 
with oscillation amplitudes f'/r; as x On 
the other hand, assuming m, is also inner, 
oscillates between (I and 2 as 
So, we cannot guarantee stability nor gixHl 
performance bixause of the essential singularity 
of rfi(.v) = e at ,v - . [or m(: > 

r. I. ♦iM. o esscnUdl singularity at : 

e’'^” I on the unit circle|. It is worth mentioning 
once more that in this example the problem 
arises in the high frequency range, i e. near the 
point where the plant has a disconimuity. In the 
next section, we generalize ihe above idea, of 
designing m, by comparing R with to plants 
which can be approximated uniformly on the 
imaginary axis In ihis case although ihe inner 
part of the plant may have essential singularities, 
the outer pari is such ihat the plant itself does 
not have any disconimuity on the boundary, and 
wc will sec that in this manner we can solve our 
prt^hlem 

s ON III) orriK I'AKi or iiu iMaXni 

In lighi of the al>ovc discussion we now 
consider the case m which Ihe plant R is 
continuous on the imaginary axis In other woids 
the outer pari of ihc pLmi is such (hat ihe 
essential singularities of ihc inner part get killed 
Ihc assumption that I* is continuous guarantees 
that R, IS also continuous (Ciainctt, 19K1, p 78). 
and hence N)ih R and arc uniformly 

a[)proximablc by rational funclions on Ihe 
miagmary axis (Hoffman, 1^)S(S. p 77). l e lor 
any given f there exists R, t //’ rational such 
that \\R - R !l. ■ 

In this section, m order to simplify our 
exposition we will consider strictly proper 
(continuous lime) plants, with no zeros on the 
hmle imaginary axis, and with inner parts having 
only one essential singularity which is at lv| - 
Re(0 “d. A typical example is a plant with 
transportation delay, and sinctly proper con- 
imutuis outer part However, the discussion 
below can be easily extended to continuous 
plants having fimtclv many zeros on the 
boundary and m which the inner part may have 
essential singularities at these points 

As before we work with data transformed 
from the right half plane into the unit disc, in 
such a way that the jsoml Re(A)-^(i is 

mapped to z = ™ 1 

Recall that the inverse of the outer part 
appears in the controller expression Note lhat 
R, being outer cannot have zeros in the interior 
of the unit disc. But it may have zeros on the 
boundarv and in this case it is not invertible in 


H*. Following our above rtmarks we ai^ume 
that R, has one zero on 9D (at which the inner 
part of the plant may have an essential 
singularity ) Once again the argument which we 
will now give works for a finite number of zeros 
(at which the inner part is allowed to have 
essential singularities) 

We will now employ an 'iipproximate* 
inverse, in the following sense Ixt A be a small 
open ncighlxirlUKKl of the point on 31) where /*, 
has a zero. 'Hien since R, is outer and auUtnuous 
on the Ixiundary, us inverst‘ R^R exists in 
[) \.s as a Ixiunded analytic lunciion which 
is moreover Ciintinuous on /\. Now note that 

sup |/^(z)| sup |/’,(:)| WRM. 

Then from a corollary to Wermer’s maximalily 
theorem (Hoflman, IWH). is a uniform limit 
of fKilynomial> on /),, I hus given any such small 
neighborhiMHl A, and any r >d we can find a 
polynomial funclion. which wc denote by 
such thai 

i/uc)/:,/(z) II 

- ir./lz) R,:(:)\\R,{:)\^ i- WRM. 


uniformly in z t l\ NiUe lhat once is fixed we 
can make ihc left hand side of the above 
inequality arhiiranly close to zero by choosing f 
sufficiently small On the other hand, for : r V, 
Riz)f\,fU:) need not he close to 1 In fact as 
z e A approaches the |x>mt where R, has the 
zero, we have that /*,(z )/^,/(z) approaches zero, 
because of continuity and the fact that is a 
polynomial In summary, such a function R,,/ 
will he called an approximate immerse (or Ihe 
outer pari R,, of the given plant. Ihis 
approximation is uniform on the boundary 
excluding any arbitrarily small neighborh(M>d 
around the poinl on 31) where has the zero 
In case I*,, has a finite number of zeros wc lake .V 
to consist of a finite union of small open 
neighhwirhtMHis about each zero. Ihe above 
construction (hen of the approximate inverse 
goes through exactly as pist described. 

Now returning lo the problem of approxi¬ 
mating the 4>plimal controller, recall that 
structure of the optimal controller is given by 


W{z)Wlz ') 




Wc can rewriic this as 




A proper tiniJe dimensional conirnllcr can be 
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Flfi ^ Finilc dimcriJiMinal cnnlffUkr 


obtained by approximating P and P „' 
Hcparatcly; 


,V-... 

^ ' n' J \ ^ p,(z)(;(z)p„;(z)’ 


where 1} and arc hnilc dimensional proper 
approximations for P and f\/ respectively Sec 
Fig. 3 for the implementation of Of course, 
in order to physically implement C), we will have 
to a.ssumc from now on that the rational function 
C is proper. This asumption automatically holds 
for the first order polynomial weights case 
studied in Section 4. Indeed, there G'(z) was 
proper because the inverse of the weight was 
proper. In fact, we believe that the rational 
function (t appearing in the above formula for 
the structure of the optimal controller is proper 
whenever the inverse of the weight is proper. 
However, at this point we have no rigorous 
pr(K)f of this. 

Ixt us now analy/e the sensitivity function for 
the closed loop system under this finite 
dimensional controller After a simple algebraic 
computation similar to the one given in Section 
4, we sec that the sensitivity function Hf : * 
W{ \ f P()) 'is in the form 




1 

\Tx\{z) 


W{Z) 


XAz) 

1 ^ X\{z) ’ 


(b) 


where A^i •" A/W and A'.. - rVW with 


V H‘q{:)q{z) ' 

b(2)f ). 

A(2):== t\{z)P,./(z). 

ftui{z)q(z) 

PA:)Pj(z) - I, 
A,,(z):=/;(z)- P(z). 


Following the above ideas, in order to make 
Cf suboptimal we design f) and l\,/ by 
ct)mparing R with A and <^. A suflicient condilon 
for stability is Af,. A'>e //' and ||A',||, < I 
llic analysis for the performance is .similar to 
the case studied in Section 4 with one important 
difference. Since is continuous on 

6 [““ JT, ;r|, we can approximate it up to any 
given tolerance by a finite dimensional transfer 
function /), uniformly on the unit circle 3D. 
Similarly, from the discussions on the approxim¬ 


ate inverse, can be made arbitrarily 

close to zero away from the point z = where 
P,j has a zero. On the other hand, because of this 
zero, and since P,,/ is in H"\ the controller C) is 
proper and the lcK>p transfer function PCf is 
strictly proper. Therefore 

W(c'^)|-^() as 

We dlsi) know that when - 0, by 

assumption p >//,,, we necessarily have 
\W{c^^)\<fi. llierefore, in this case having a 
proper F,,/ e H* guarantees a gcKxl performance 
near the point where inner part has an essential 
singularity and outer part has a zero. Also away 
from this point, since wc have ‘good” 
approximations for P and P;/, equation (6) 
shows that we can obtain a level of performance 
close to the optimum. Again from (6) we see 
that in the transition region on the unit circle 
where P^P,/ neither close to I nor to 0 a 
deviation from the optimum performance may 
occur. It is possible to obtain at least a 
conservative bound from (6) immediately: 

IlflAll.'-(II+IHV'A',||.)( --- -'^^ ). 

1 ■“ IIA I 

However this hound is by no means tight. Better 
bounds on this performance degradation should 
be obtained by studying on what happens to the 
magnitudes of the approximation P Pf the 
weight W and (i in this frequency band. 

In the next section we illustrate the method 
discussed above by considering an example 
similar to the one studied in Section 4. 


h l-XAMPI I low PASS W'E Kilns AND Dl l AY 
SYSri MS 

In this section wc will consider a first order 
low pass weight and a plant with delay We lake 
the outer part of the plant to be strictly proper, 
so that the transfer function /’(v) becomes 
continuous on the imaginary axis. 

Let us chcK)sc the weight to be 


and Uxik at the plant 




\ s - h 
T^.v 4 1 .V 4 h 


Here h is the amount of lime delay, l/r,, is the 
bandwidth of the plant, and 1 /t, is the 
bandwidth of the weight (determining the band 
on which disturbance signals act). Typically is 
much less than I. Note that if 1/h then wc 
can write P(jr) = Ac 4 1)4 fle '‘V(.v 4 b) 
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1 + 

where A ==-- ^7 and B = 

1 - 


1 - 


lliercfare 


the Hankel operator a&MKiated with this plant is 
compact, because the corresponding impulse 
response is in iL,(0. x), (^cc Adamjan rf al , 
1971). 

For this example the conformal map between 
unit circle and right half plane will l>e taken as 


T^S ^ 1 


and s - 


This puts the weight in the form H'(r) - p{ 2 ) - 
with p„=(l 4 fJ/2 and /?, = (1 - 

f\. )/2. In this case wc have (/(r)- p:Jp(z) (sec 
Appendix A). The method we arc using here 
docs not depend on the conformal map chosen 
However the above choice for the ci>nformaI 
map makes W'(z) a polynomial, and simplifies 
the compulations of the Appendix A. 

A natural choice for f){s) is rh^(.v)/(T^.A 4 1), 
where rhf is a finite dimensional approximation 
of the inner part of the plant As an approximate 
inverse of the outer pan wc choose the proper 
function 

- , r,,.Y 4 1 

/v;(.v)- ^ ^, 

/,,T,,.V 4 1 

where r,. >0 is very small (we discuss later how 
small this should be). 

Now we check under which conditions the 
finite dimensional controller 


:;U) = ( 


' . i 


is sufx^plimal. Recall the equation (h), from 
which we have 

^ 7 +, ^ 

where A i A/R, and ~ Wd/f{. I here fore, if 
the conditions 

(a) 3r,e//' 

fb) A'.e//' 


are satisfied, then Bf e //' Assuming e //*, 
then for (a) and (b) to hold It is necessary and 
sufficient to have 

4 ) (7) 

(see Appendix B), where u), is determined by 
the zeros of {p(z)p(z) ~ ) for z-(r^ t 

1)/(t.*.5 4 1). Simple computations give that 


UV - — with V = \ f - T-; 

T. V M ^ 


We will chcMise a approximation for the 

delay term and add a filter to this to lake into 
account the cfleet of (1 4 ); 


where 


.V 4 h 

: ’ 4 2ni,A 4 (oif ' rf) 

,V* 4 2ni,.Y 4 (W* 


and is a Padt^ approximation which is going 
to be defined txdow. fhe choice of r, 

<i#, \^2r^,r,,iii. makes ^ ) - (1 4 ) So. 

we need only to check il, say the first order, 
Padc^ approximation (I j/iu>./2)/(l * iho»./2) is 
actually equal to c^^'‘ Ibis dixs not in general 
hold, however when h is order of magnitude 0Ol 
(and IS less than 0.1) then the difference is so 
small (less than 10 that we can fix the 

problem by changing the term (1 h4/2)/(l 4 

fiA/2) to 

I (*' •'.)' 


Here lor such small values of h and cu, wc have 
1 K and d, are less than 10 “V S(^ fH,/( jii>) can 
practically be seen to be equal to the first order 
Padc^ approximation of e'' In summary, we are 
going to use 

A h 

mj.\)h(s) 

\ 4 h 

in the controller, where m,j defined above is a 
first order approximation for the delay term 
Note that we need the exact values of K and d, 
to satisfy the condition iu) and {h) 

One other condition wc need to satisfy is 
]bV,||.' 1 Alter substitution of the terms wc 
see that 


I 1 \ 

^ ' m(,v) ^ 

P T, A 4 1 4 I 

I nif{\) rfi(5) 

■4 p .... 

f 1 4 1 

. 1 r ^ V I ^ 

M V + I / 


Define 


1 i4,T„.v 1 

R.(v): - 1 4 m(s), 

p r,A 4 I 


f)As} - A,(,»)/?,(*). 

Plot versus w, and chcKrsc small 

enough such that 

\f)Ai fO )\ « \^A\ (o){ for (M o;, 
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Tlfi 4 versus ri> 


u), is li) be dclined below. Consider the second 
term in the numerator of X^. Note that 




T.jw 1 
r„T..)ri» + 1 




as n) . 


So, n\f should approximate m ‘ reasonably well ' 
at least up to (rei|ueney tn, where 


ifi 

Then. \nA\f»)\ ' fi (whicli is Roing to be 
strictly smaller then 1 r„/^r |/<,(jr/i)| when 

lor • (>»,. We therefore assume that 
All these guarantee only the stability 

of Hf. 

At this point we should also check subop¬ 
timality. i.e. consider Kecall the 

expression 

I ,V. 


/■/, - 


I f A’ 


I + A'I 


where A', is as above and A' , can be computed as 




A'.(.v) 


T„.l 


m(A) 


m, 


m 




r,,v f I I ThT^.v 1 

I f m(v) 

|i T^.v 4 1 


Now, since at low fret|uencies |A',(jff>)| « 1 and 
l.t*,(i(i>)| « I. by sufticicntly small i,, and good 
approximation of /ri by m,, we have 


for low frequencies. It is also not difficult to sec 
that at high frequencies 

|fl,(jffOI ' ft 


because 


I 




^ 11 

'ITius, recapping, chmising sufficiently small 
(for gomi performance at low frequencies) and 
approximating m(in>) by up to the 


f i(i S versus nr 

2iu 

frequency range near , also satisfy- 

^ *% ^ ft 

ing the interpolation condition (7) posed by 
stability, we have suboptimalily 

We remark about a trade-off now. For good 
performance we need to use small ; however, 
this increases the frequency band on which m 
should be approximated well, which h>rces us lo 
use higher order approximations if the delay h is 
not small ent)Ligh 

Let us look at a specific design example by 
ch(H)sing - 200, r^, - 100, - 0.0.*S. h - 0Ol. 

f,, ~0.0I, and ^-0.0207 I hesc make tn, ~ 
and /i = 0.2 (see Appendix A) The 
values for J, and K can be lompiited by equating 
the magnitude and phase of e’"' in the 
magnitude and phase of mj(jff), ) We lirul that 
A'- (I 4 5.530 X 10 ”) ' and 2.705 X 10 " 
After substitution of all the terms in ( , and 
simplifications the above method leads to the 
controller given by 


(V(A')- ^-7.5| 


M200 4 .v)( lOtlv + 2.07) 

X (KKK 4 l)(v 4 0.025)' 
(0>1,K 4 .v)(2IK).v 4 l)(v 4 5 35) 


^ X (,v 4 0.03 )(.s 4 0.02)/ 

The magnitude plots of R^, /),. and A i are given 
in Figs 4, 5, 0 respectively; we observe the 
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for ihe plant PJ\ ( Hun is true by ihi* assumption 
that > IjW ( / and P, can b€ taken in such a 
way that It vanishes only at those poiius where m 
has essential singularities on the txiundaiy.) 
Moreover, the corresponding optimal //* 
controllers arc related as follows: 

A finite dimensional suh<iptimal controller for 
the plant P can be found bv approximating 

i\,JPP) 


Fu. 7 Nvquisl pKii (or /X\ 

Stability from these plots (note also that there is 
no unstable pole-zero cancellation in the 
controller and the plant) We can also check 
stability from the Nyquisi plot for this controller 
and plant, Pig. 7. Ft>r the performance bound 
see the magnitude plot of H, in Fig H. We have 
\\Bf II, “ ().20K. so the deviation from the optimal 
performance is about 4^r If better performance 
IS desired (i.c ft < then t)nc sh<mld 

decrease the value of ami refine the 
approximation of the delay term accordingly (if 
necessary). 

Remark. For plants with invertible outer parts 
we have seen in Section 4 (hat there is a ditficuliv 
m our method. Nevertheless, we can overcome 
this difficultV in the fiillowing wav Assume that 
the outer part p, id the plant P is invertible and 
continuous on (he boundary, and lurlherniore 
suppose that the inner part m has finitely many 
essential singularities on Ihe unit circle Jl) 
Then, there exists a rational outer transler 
function /’ such that P,m, and hence are 
continuous on dD One can construct this 
function by simply dchning P, - III-: - c,). 
where C,s arc precisely the essential singularities 
of ni on 3f) Since P, is outer the optimal 
performance yi(F) corresponding to the plant P 
IS the same as the optimal performance ^liP^P) 


H ' 


i 



Fk. H lft,()oOi versus w 



(AP)^^i\{pP)P, 

where Ihe structure of i APP) i^ in Fig 3, 
with P^P, taking place of p,. In Sections 5 and 6 
of this paper we diseussed the problem 
corres|xmding to (his sitiiatiim wiierc the plant is 
continuous, e g /\ P, and the ci>niroller is in the 
form of C APrP) hi surnmatv, for plants with 
continuous invertible outer parts a sulsoptimal 
finite dimensional controller can fx* found by 
introducing a rational outer function f*. which 
makes PJ* continuous on the unit circle, and by 
treating PJ\, as the outer part 


7 ( ()N( I t!l)|N(. Kl MARKS 
In this pa|XM we have considered the one 
block //' sensiliNiiy minimization problem in the 
SISO case have t>biamed the structure of all 
Ihe sulsoptimal //' controllers for systems with 
rational weights and stable ar bid ary distributed 
plants, having invertible outer parts Fiotn this 
structure we have identified the infinite and finite 
dimensional parts of the optimal controller as 

ff)ll0WS 



VV'(:: )W(;: 




f/U) 

m(r)(i(z) 


P.,'(z), 


Although WL- have made the observation that 
IS finite dimensional and can be obtained from 
the 2fi-equations o( the singular system, Foias et 
ai (l^HH). we could not find an explicit lormula 
for f/(r) in case of arbitrary weights W, because 
of the complexity ol the equations So. there is 
more wink to be done in this direction. 

In the first part of our discussion on this 
structure (Section 4) we have assumed a first 
order weight and proper rational and stable P ,,' 
We computed (y(z) as ^z/W{z). Fhen we have 
studied under which conditions the finite 
dimensional controller 


^/W{z)W(z 7 
.. 



1 + mf{z)CHz) 


f'diz) 


IS suboptimal where is a ralional function 
approximating m We have iJcrivcd that when C) 
IS used in the closed Irajp. then the sensitivity 
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becomes* 


1 X 

Bf - B.^, -W — 

' ^ I + X X 


(H) 


where X - A^JR with - nif ~ m and R - 
G ^ m(JW(z)W(z ^and is the 

optimal sensitivity. The above formula (H) is 
true even if the weight is higher order rational 
function, hut the expressi(»n for (/'(z) (which is 
Ci|ual to ^iz/W(z) if the weight is a first order 
polynomial) is more C4)mplica(ed 

One of the main arguments of this paper is 
that m, should he designed by comparing R with 
A^. We have seen that there is a difficulty in the 
case of plants whose outer parts are invertible. 
That is we cannot have 

uniformly on the imaginary axis if the inner part 
of the plant m has essential singularities on the 
boundary Nevertheless, as we have explained in 
the Remark at the end of the previous section, 
we can get around this problem by IcKiking at the 
finite dimensional controllers for stable plants 
with iontinuous transfer functions, whose outer 
parts need not he rational In (hat case we need 
to invert the outer part approximately, because 
it will have /eios at the points where the inner 
part has essential singularities. This issue, of 
approximately inverting the outer part of the 
plant, have been aildressed in Sections ^ and b 
BUvSically, when the plant transfer function P is 
continuous on the unit circle, it is possible to 
write /f; similar to (H) |sce equation (b)| We have 
seen that having a profx'r “approximate inverse” 
lor the outer part, which have zeros on the 
boundary, helps solving the problem we have 
encountered in the case where outer part was 
invertible 

As discussed iii Sections and b at “high” and 
“low” frequencies the magnitude id the sen- 
silivity function obtained in this method can be 
made arbitrarily close to (or less than) the 
optimal performance p we were not able to 
obtain a light bound on the deviation from the 
optimal performance in the “transition range” 
where rolls-off to zero, in order to 

obtain such a bound we need to study the 
behavior of G, W', m, P and the approximating 
functions Pf and /’„/ in this frequency band. 

Hounds on the deviation from the optimal 
fHrrformance depend afso on the approximation 
bounds. On the other hand approximation to 
infinite dimensional systems is itself of inde¬ 
pendent interest. At this point w'c want to give 
an idea about how' large the class of systems 
considered in Section i c. stable (in the H' 


sense) plants with continuous transfer functions, 
and the approximation problem related to these 
systems. We believe that the main restriction 
here is the stability. The other condition, 
continuity of the transfer function, is required 
for the existence of the uniform (in the H" 
sense) approximations. Because if a distributed 
system has a discontinuity then it is not pnissible 
to approximate it uniformly by a finite 
dimensional system, see a discussion in Gu et al. 
(1989). Moreover, in order to obtain certain 
sfiecific bounds in the approximation method 
used, one may need to make more restricting 
assumptions than continuity In this paper we 
did not address these issues [see for example Gu 
et ai (1989) and Partington ei al. (1988) and 
their references for detailed discussions). When 
we have illustrated our approach by considering 
an example in Section b, wc have only used the 
classical Pade approximation. Other types of 
approximation schemes, might lead to a better 
f)crformance while keeping the same order. 
However, the bottom line is that, in order to hnd 
suboptimal controllers, no matter which ap¬ 
proximation method IS used, one should lake 
into account the structure of opiimal/suboplimal 
controllers given above. 

Finally, we want to close our discussion with 
an important open problem related to the 
structure ohiamed m Proposition 2. Given p 
characterize the set of all u ( H . ||n||, - 1, such 
that the transfer lunction 

G, 

1 ^ m( /’„ 

in (.^a) IS tinilc dimensional, and hnd the lowest 
possible dimension 
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APfM NDIX A 

Optimal sensitivity for R'(*’) - /»(*') /i,, ♦ p, : 

We have seen that computaium uf the optimal \ensiiivii\ 
reduces to finding a non/ern setiur H , such that tl 

llial IS. in our case, 

((Pn > Pi / M/’n + p, f ' I M /)h, (I (all 

But w'c also have the following 


c^imum coniixilfer \\» Yvniia paninietrtiation, wt eml 

u|) w'lih 




'I 




where C»f; I|i*'//>(:.*) Tbe cynnputal4om» are sliaightfoi 
ward but hh> lengths to piexm here 

a '* 

When fh(.i I =■ ^ ^ ** *^* P from the rqiialnm 


/i(u ^ tan ' V tan ’ v 4 2 tan ' (ii», M 

where 

' . / 1 M 

w and \ \; 4 ^ - 

V r 


this IS obiaiiK'd by writing the et|ualion (a^) explicitlv and 
transforming the data from the unit iiiele to right hall plane 

i.‘ 1 

T» t I 

ctmvidered in Section b when i\., b ami h aie fixed 
ami heme p ‘itt found by using the afxive lonnula 


using the iransfortnatnin 


la the esamfile 


APPI NDIX B 

PrtHif id ( un iifion l7| 

Recall the expression 


Th, .rh ,(J ) Afj(jii ,. (ii2 a) 

rOy, h..(0M (a? b) 

and 

n h, |l))( I mClmfO)) (a; s) 

for si»mc consianis u , drul h, ((b Pulling ihese 

expressions m (al) we see that (.i!) is equivalent to 


Y.t.v) 


1 

p t^.s i I 


f,,r.,v r,.j I 

^ rh (O » li 

‘.,V ^ ‘ ^ 


I I r,. I I 

1 ♦ mii) 

p f., ' M 


-».,(») fh(sl 

1,1..* * I 


and delmilions 


' n.n,. 


PiPn 

1 J > I n 

I.i7) 

P.i /'« 

Recall that by Sarason s iheorem n lyl / iVi, 

p(7 )*b , In our ease we then have 

l-'Pu ■* Pl)^>, I-’ ) Pl"l 

Si!i pU) - :pt^ p,. >.(.') (/ ^ (p;. ■» p, n b’'p,>Pi • 

1), andii 1 " ( n i* ^ /7i(())u,| Replacing b( .M Irom (uG 


h,.ii ) 


f)(: ]u^/p,, 4 rm( <■ )u 
A(;) 


( I ^ a) 


m ), and arranging terms wl: get 


l tm(7(:p„P rpl-l", , 


On Ihc other hand from equation (a'^) we obtain that 


/f, (VI I ♦ mpv I, 

p r,. I t I 

/>,Ia) X{s\BJO 

AIs 4» (rom the equations fa^ a). (a4) arul (a^) ApfH lulix A it 
IS t asv In si e ih.'il 

^ 1 

m( III# ) I (bl) 

M )f/#, ♦ i 

Moicovci. 4 j(u, and p/;, are the only punts whetc W,,(i .l 
vanishes in the closed right hall plane Ihcrclore lor the 
slabifiiy of V, we need 

) b (h2) 

I'sing (bl) and re arranging icims wr gel that (h2) is 
equivalent to having 

I Df H ) fhi)ur f) 0, 

m ( ) f#j, ) / 

o? 

d\fi\(iy I fhfpu )(1 4 ) (bt) 

If IS also routine to cheek that 


pf f»,)u, a OifTtf (1 ,)u , (I 

Pu 

pfn^fu. a- (Xyrnia ,}u , ^ (I 
P(. ‘ ■ 

where rx, and a> - ff( ’ arc the rmiis of /(:) 0 on the unit 

circle So, wc must have 

pf a, )fli ;fn(a.) -■ p( a )ti, m(rt JI I a5) 

in order to have a nonzero vector b,, satisfying A^Ji^, 1). 
Solving the equations, after tedious computations, one gels 
that p„ii ,/u, “ p Putting this result in (a4). and solving for 
from -- W ~ and ihen solving for the 




f „ V 

T. ' 1 


hiDi, 


(W) 


S41, Since 4)07, and po, arc the only |xunis in Ihc cUuw’d 
right half plane that makes /fJG 0, condition i% alvi 
sufficient for the stability of A', 

Now let ,s look al , 




1,1 1 1 
^ 1 1 


rnfiH ^ (rh^f i) m(i )) 


I 


I ',.v 

M 7 1 


fh{s) 


Frrrm this expression, and the arguments used lor A', we 
see that the stability of A'. alsxi is equivalent to fbl) 
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//^-optimal Control with an //^-constraint: 
The State Feedback Case* 


MARIO A ROTEA+ and PRAMOD P KNARCiONhKARt 

A stale-space approach soh^es the problem of fimitnf* amonft all state 
feedback controllers that minimize an H'^performance measure one that 
also satisfies an H^-norm bound. 

Key Wordi-" Linear opiimal control, muliurbjcciivc i>piiiiii?a(ioiv. robnsi umtiol, Mute lrr4lhiiii.:W 


Ahstrmci-’ In this pujx'r wt; amNulcr a mixcti optimal 

control problem It is assumed that the plant as well as the 
feedback controller arc liniie dimensional and linear 
iimc invananl, aitd that the plant state is available loi 
fecdhack More specifically, amon^ all the state leedback 
controllers that minimi/c ihe //' norm ol a closed linrp 
iranslcr matrix, we pivc necessary and suffuicnt conditions 
lor the exisicnec of a ctinfioller that also satisfies a 
prcscnfK'd //‘-norni Inuind on some other cloved linip 
transfer matrix When these conililions are met, the Miiution 
to the alxive prtrbleni is also a ijlohal solution to the 
eonlrained optinu/ation problem ol rninirni/in^ an // norm 
performance measure subjeci to an //^ norm consiraint Wc 
also give state spaee formulae (or computing the solutions 
Some casilv checkable siifficieru conditions for the existence 
ol soluliors are given finally wc give an example in sshieh 
all solutions to ihe eonvirained optirni/aiiori protdem are 
neeessartlv dynamic, i e there is no statu gam solution even 
though plant slate is available for feedback 


1 INIRODl (MION AND PKOHI I M 
fORMUl A flON 

lin (ONiKoi problem addressed in this paper 
conc:ern,s ihe hnite-dimensional linear lime- 
invarianl feedback system depicted in Fig 1 
The signals k, and k. denote exogenous inputs 
while r, and T; denote controlled (i.c regulated) 
signals. The signals u and v denote the control 
input and the measured t)ulpul, respectively. The 
transfer matrices of the plant and the controller 
arc denoted by C and K, respectively. It is also 
assumed that both G and K arc real-rational and 

* Received 7 Nosemfx'r rcvistuJ HI May IMSMi. 

received in final form 2^ May 1<W(I Hie ongmal version ol 
ihts paper was noi presented ai any IFA(^ mccling Tins 
paper was rccx)mmcndcd for puhliuilion m revised form by 
A.vmx:iuic Ediior H. Kimura under the dirccuon of tUliio’' H 
Kwakernaak 

i ( enter for Control SkxcfK'es and Dynamical Sy^stemv. 
University ol Minnesota. Minneapolis. MN U S A 

Now with the School of Acrrmaulics and Astronauucs, 
Purdue University, West (.afayette, IN 47^17. U S A 

I Department of F-Icclrical Engineering and C'omputcr 
Science. The University of Michigan. Ann Arbor. MI 
4KUW 2122, U S.A Author to whom all corrcsp^mtlence 
should be addretkfard 


projKf transfer matrices Finally, for given a 
real-ralional and pro[Kr controller K, wc let 
Ti(A) and 7:1 K) denote Ihe closed liMip transfer 
matrices from k, to and Kv to respectively 
When there is no possibility of confusioru the 
depetndenee of 7] and /\ on K will be omitted 
In this paper we assume that the stale of the 
geneiali/ed plant G is available for feedback. To 
be more precise let a stale-space description of 
(/ be given by 

lii 

- Ax c 4 B.w. I (I la) 

df 

- (\x 4 f)o4 (Fib) 

( ;jt 4 AFm (1. Ic) 

V - V (1 Id) 

where all the malriccs m (11) arc real matrices 
of compatible dimensions. Although no explicit 
frequency dependent weights were introduced, it 
IS assumed (hat all weighting functions have been 
absorbed m the gcnerali/cd plant G, Note that 
there arc no feedthrough terms (rtvm the 
exogenous signals w to the conirolled signals z. 
Although It IS possible to include these Icrrns, wc 
have chosen not to include them m order to keep 
the presentation as simple as possible. 

A given controller K is called admLssthle {for 
the plant G) if K is real-rational proper, and the 
minimal reali/.ation of K internally stabilizes the 
sialc-spacc realization (1.1) of G, Ixi II.II 2 and 
||.||., denote the usual //' and //' norms, 
re.spcctivcly. TTic two problems considered in 
this paper are defined as follows: 

Problem A: Minimal H^morm subject to an 
IC-norm cofistraint. For the plant G defined in 
(I.l), find an admissible controller K that 
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I Ihe synthesis Iramcwork 


ilchicves 

ini (II /,(^')||.; K admissible and || 1\( A.' )||, ^ 1}. 

t*rohlem li: Simulfanetfus optimal 

iOfUrol. J or the plant (i defined in (1.1) find an 
admissible controller K that achieves 

inf {|| /i(A)||.i; K admissible ) 
and such that || ^ )ll. * I 

Note that while Problem A represents a 
constrained opt i mi/a I ion problem, fVoblem B is 
to find (il It exists) a solution to the 
unconstrained problem of minimi/in^', an // - 
performance measure that also satisfies an 
//'-norm Ixujnd I'he key point is that a solution 
to Problem H is also a solution to Problem A but 
the converse need ruU be true 

Recently Problem A has received a ^reai deal 
of attention, mainly because it represents a 
problem of optimal nominal performance with 
robust stiibilily |see, lor example, [iernslein and 
Haddad (1‘^^K^)), Mustala and (ilover (IMHH), 
Doyle rr al (l‘lK^Mi)| Indeed, il we consider that 
a stable (possibly nonlinear) perlurhalion A is 
connectcii from lo h’> (see Ki^. 1). then the 
small gam theorem ensures siabilitv of the 
perturbed system if the nominal sysiem (A ~O) 
is internally stable aiul 11/^1. ' I. provided that 
the induced operator norm of A is less than or 
equal to one. Among all the admissible 
controllers K that provide n)bust stability. 
Problem A is to tind a controller that minimi/es 
the variance t»f the output Zi (with A ^ 0) when 
K', IS zero mean unit variance white noise 

('urrently, no analytic solution to Problem A 
is known Some attempts have been made lo 
solve “modified” versions of this optimi/ation 
problem. Mustafa and (ilover (1^88) and (ilover 
and Mustafa (ld8M) have considered the special 
ease in which /), -/>> and 

hence J\ - T- (see Pig. I). f or this case, they 
have solved the problem of maximi/ing an 
entropv functional subject lo an /Y'-norm 
constraint. Phis problem formulation is related 
to Problem A in that the (negative of the) 
entropy of a transfer matrix is an upper bound 
for its //‘ norm Bernstein and Haddad (IM8^) 


have considered the case of one exogeneous 
signal. In our setting, this means /?, “ B 2 , They 
have also considered the minimization of an 
upper bound (“auxiliary co.st”, as defined by 
ihem) for \\Ti \\2 subject lo an f/"-norm 
constraint on T^. Using a Lagrange multiplier 
technique, and under the assumption that the 
order of the controller is specified, they have 
derived necessary conditions for optimality. Sec 
also Bernstein ei ai (1989) for more recent work 
on this approach and Mustafa (1989) for an 
explicit connection between the entropy and the 
auxiliary cost for the special case 7, ~ r.. 
Finally, Doyle et ai (19S9b) have considered a 
similar problem with one controlled output, i.e. 
(’, ~ (\ and /7, ~ /L. They have derived 
necessary conditions and sufficient conditions for 
this modified problem to have a solution As 
shown in Doyle et ai (19H9b), there may be a 
gap between these conditions. Il is important lo 
note that these papers address the more general 
and interesting situation of output feedback. 

Problem B has nol been considered before. 
Our objective in this paper is twofold. Firstly, 
we want to parametrize the set of all solutions 
for the (unconstrained) //^-optimal control 
problem ini (H7,(A)||i: A admissible) Secondly, 
wc want to lind necessary and sufficient 
conditions for (he existence of a solution to 
Problem EL Since a solution lo Problem li is also 
a solution lo Problem A. these conditions are 
sufficient for Problem A lo have a solution 
While it may seem that the solvability of 
Problem B is a very strong sufticieni condition 
for the solvability of Problem A, il will be seen 
that if im//) and xnyH^ arc linearly independent, 
then Problem B and fVoblem A become 
equivalent. 

It IS important to note that the problems 
considered in this paper can also be approached 
with the aid of convex nonlinear programming; 
see, for example, Boyd e( ai (1988). Since our 
results are analytical, they complement the 
numerical optimization approach taken by Eioyd 
et ai (1988) and related papers. 

A brief summary of our results and the 
organization of the paper is as follows. In 
Section 2 we give a paramelri/alion of all 
//‘-optimal stale feedback controllers This 
parametri/ation is obtained in terms of a free 
transfer matrix in RH\ F'urthermore, any closed 
li>op transfer matrix is affine in this free 
parameter. Using this parametrization along 
with the recent solution lo the standard 
problem given in Glover and Doyle (1988) and 
Doyle et ai (1989a), Section 3 gives necessary 
and sufheient conditions for the existence of 
st^lulions to E^roblcm B (cf. Theorem 2). These 
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conditions involve two algebraic Riccali equa-^ 
cions (AREs) and a coupling aindition Tlic first 
ARE reflects the fact that there must exist an 
admissible (state-feedback) controller such that 
The second ARE and the coupling 
condition arise due to the requirement of the //*' 
optimization. Since a solution to Problem B is 
also a solution to Problem A, these conditions 
arc sufficient for Problem A to have a solution 
(cf. Corollary 1). When these conditions are 
satisfied, a “dynamic^ state-feedback coniroller 
that solves Problem B (and Problem A) is given 
Finally, in Section 4, wc consider the special case 
in which imfli and ini/i. are linearly mdetxnd- 
ent. In this case wc show that Problem A has a 
solution if and only if there exists an admissible 
controller such that ||7;|1, < 1. Thus, under the 
mild condition of linear independence ol imff, 
and im/? 2 . one gets a complete solution to 
Problem A. In this section wc also show (by 
example) that there arc situations in which any 
solution to cither Problem A or Problem B must 
necessarily be dynamic. This is m signiticani 
contrast to the fact that in either // or //' 
optimal control problems, when stales are 
available for feedback, the controller can be 
chosen to be a memory less gam (see, for 
example Kalman (19(>(l) and Khargonekar rr al. 
(1988)] This example appears to indicate that 
the mixed H'lH' problems are likely to be much 
more complicated than standard // and //‘ 
problems Finally in Section 5 the conclusions ol 
this work arc given. 

The notation is fairly standard. Ihc identity 
matrix is denoted by / [or a constant matrix M. 
let \mM and kerAf denote its range and null 
space, respectively. Ihe sfx^ctral radius o\ M is 
denoted by p(M). The iranspose of M is 
denoted by M'. \x\ M* denote the Moore 
F^enrose inverse of M if M - wc shall define 
Af^; = 0. The orthogonal cximplcmeni of a 
subspace S c R** is denoted by S Packed matrix 
notation is u.sed to represent state-space 
realizations, i.e. 


A 

B 

c 

- 


For a transfer matrix O', wc define O as 
G •aH complex The spaces 

W' and denote the Hardy spaces of matrix¬ 
valued functions that are square iniegrable on 
the imaginary axis with analytic extensions into 
the right and left half plane, respectively. The 
Hardy space //" amsisls of matrix-valued 
functions that are bounded on the imaginary axis 
with analytic extension into the right half plane. 
The norms in these spaces are defined in the 


usual way: 

/1 r 

IIGII2: “ Y 1 ^ I i f > <Of ju)) d(i> 

{|(/|U : = sup o{(f'(j(tOl. (o :- max singular value) 

When H is used as a prefix, it denotes real 
rational. Given real matrices A. R - H\ and 
Q-Q\ will say that the algebraic Riccati 
equation (ARE) AW + XA 4 XRX 4 ^ (t ad- 

mits the (unique) slabili/ing solution X, d X, is 
real and symmetric, .V, satisfies the ARF:, and 
A 4 KX, has eigenvalues in the ofxn left half 
plane A similar definition is used for the 
aniisiabilizmg solution with the obvious 
modifications 

In the rest of the (laper. the following standard 
assumptions tm ihe plant (> are made 

(i) (/I, W,’ IS siahih/ahle (1 2a) 

(ii) /), and both have lull column rank (I 2b) 
(lii) l or each tu r R and for k 1. 2 

A \wl /G 

' /1 "I., i 


has full column rank 

Note that assumption (! 2a) ensuics that the 
SCI of admissible conirollcrs is noivemply while 
assumptions (1 2b, c) are siandard and giiaianlee 
that the IXJR problem corresponding to the 
quadratic cost has an admissible solution. 

Without loss of generality we further assume 
that 

(IV) /;;|(\ />,i -|ii /) :i.2d) 

In fact, as is well known, a preliminary feedback 
transformation will enforce I his Iasi equation 

? PAKAMI IKI/AIION Ol Al l /COPIIMAI 
(ON l kOI l .l NS 

In this section we parametrize the set of all 
admissible unconstrained //"-optimal state- 
feedback controllers for the interconnection of 
Fig. 1. The development is earned out using a 
frequency domain approach. More specifically, 
the YJBK paramcirization of all stabilizing 
compensators is used to solve this problem (see 
for example Vidyasagar, I9K4). The final 
formula for Ihc solution to this problem is given 
in .stale-space (cf. Theorem 1). 

Consider the bkKk diagram of Fog 1, where 
the plant G is as in (1.1) It is a classical fact that 
(under assumptions (1.2a-c)| there exists an 
admissible controller that minimizes H7,||^. One 
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such admissible controller is K„ - f, where the 
constant real matrix f is computed according to 

f -(D\D,) (2.1a) 

and the constant matrix A', is the unique 
stabilizing solution of the (LOR) ARE 

A X ^ XA (Die , ^ B\Xy(D\r),) ' 

B\X)^ C\Cy^ {). (2.1b) 

Perhaps, it is less well known that (2 1) is not 
the only admissible controller that minimizes 
WTyWi. Our first result (Theorem 1) gives a 
complete parametrization of all solutions to this 
optimization problem With reference to the 
realization of the plant (J given in (1.1) and with 
f given by (2.1), define 

M ,(2 2 ) 

Ar^A ^ B,F\ (2 3) 

W),/- ; *-1.2, (2.4) 

The matrix fl, is the orthogonal projection onto 
(imH|)^ Note that A^ is a stability matrix. 
Define the set of transfer matrices; 


the well known formulae in terms of an 
**obscrver-based’' stabilizing compensalor. 

Lemnw 1. Consider the feedback system of Fig. 
I, where G is given by (1.1). Then, a given 
controller K i.s admissible if and only if there 
exists Q e RH" such that K equals the transfer 
matrix from y to u in (2.6). 

Proof. First, note that a given controller K is 
admissible for G if and only if K is admissible for 
Gy^ .-U! ~ A) ^By. With f given by (2.1), 
define the Rt!^ matrices 




/ 



iV;=/V, M I ^ NF, 
X -F, Y ~l, A :-F, V : = / 
Then, it is straightforward to verify that 

(y .= lSlM ’/V 


Y 

X 

M 

X 


1 0 

- N 

M 

N 

Y 


() / 


A:- (C^ c RH^:{) - Wn,(AY ■ A,), W ^ RH ) 

(2.5) 

Theorem 1. Consider the feedback system of 
Fig. 1, with the plant G given by (l.l). Let S be 
defined by (2,5). Ixt K denote an admissible 
controller and /, the corres|X)nding closed loop 
transfer matrix from w, to Then. K minimizes 
||7i||;* if and only if K equals the transfer matrix 
from y to u in 



.•1, 

0 

B, 

0 

”7” 

/ 

/ 

/ 

0 


(2 6 ) 

for some Q e. S. 

Note that if imWi-R** (n:-state dimension) 
then n,«() and (2.7) reduces to the single 
state-feedback controller A",, - F. On the other 
hand, if imfli is a proper subspacc of R" then 
(2.6) generates a family of controllers para¬ 
metrized by W. This extra freedom can be used 
to satisfy some additional constraints. 

The next lemma will be useful for establishing 
'Fheorem 1. It provides state-space formulae for 
the YJBK parametrization of all admissible 
controllers. The formulae given below are more 
appropriate for our setting (state-feedback) than 


These equations provide a (doubly) coprinie 
factorization over W//‘ for 0',,, It now follows 
(.see, for example, Vidyasagar, I9H4) that K is 
admissible for (f ,, if and only if there exists 
(J e RH^ such that 

K - (A' ^ MQHY f ;VC) ' 

- F 4 C(/ + AC) 

which is of the form (2 6). O.E.I) 


Proi}f of Theorem 1. From l.cmma 1 and after 
some standard algebraic manipulations, it 
follows that the set of all admissible closed loop 
transfer matrices Irom w, to z, (i.c those that 
arc generated by admissible controllers) can be 
parametri/ed by the formula 

7,:-A, y IfQV,, (J^RH\ (2.7) 


Ar \ R\ 

1 

[. — 


B. 

, t 

B,; 



► 1 . - 

1 ' 

()\ 

' 



where A^ and C,^ arc defined in (2.3) and (2.4), 
respectively. 

It is now standard to show (using some simple 
algebra and (2.1)) that - 7)J/>, - C, C, and 
that t/,A, e /7"'. LJsing these properties, we 
conclude from (2.9) that if () e RH" then 

\\T\\l=\\SA\l^\\U,QV\\l 

(/V illi 
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It is now dear that e RH" miniintres \\r^\\^ if 
and only if Q satisfies 

C^V^i = 0 (2 8) 

To complete the proof we must show that 
QeRH" satisfies (2.8) if and only if ^65 
Qearly, if QeS then Q e RfV and saitisfies 
(2,8). The converse is as follows. Let Q e RH^ 
be given and suppi>se that it satisfies (2,8). 
Define 1 V:=^(a/~v 4^) V Note that W e RH\ 
for Af is a stability matrix Moreover, from (2,2) 
and (2.8), it follows that 

Wn, = QUI - A, ) ^ 1^) Wai,(v/ - A,)^ Q. 

Therefore. Q e S Q i: D. 


We conclude this section with a stale-space 
representation for the controller of Theorem 1 
that will be useful for establishing the mam 
result of this paper (Theorem 2). Let VL f: RH ' 
be given by 


Then it is easy to show that Q ~ lVTl,(v/ - /l^) 
is given by 


/I. RJhA, 

C\ . 


Substituting this realization of (.> in (2 6), and 
after deleting unobservable modes, the control¬ 
ler K of I'heorem I is given by 

>1a -4. - /fJl.ALC;, (2 %) 


/I, I - 

c; /• ^ f H/f.lIi 


( 2 %) 


^ mi: siMiii r ANious // ///■ pkohi i.m 
I n this section we solve the simultaneous 
H^/H’ optimization problem (Problem B) 
defined in Section 1 The development is carried 
out using Theorem 1 along with the recent 
solution to the standard //"-optimization prob¬ 
lem given in Glover and Doyle (1988) and Doyle 
et al. (1989a). For the sake of completeness, a 
slightly modified statement (suitable for our 
purposes) of the main result of Glover and 
Doyle (1988) has been included in a separate 
appendix. 

Our first result in this section gives necessary 
and sufficient conditions for the existence of 
solutions to Problem B. Consider the plant G 
given by (1.1) and let Hi denote the projection 
matrix defined in (2.2). Define also 

V2=n,B,. (3.1) 

Note that F; = 0 if and only if imfl^ ^ imfl,. The 


following algebraic Rkxait equations (for X and 
Y) will play an impitiiani role in stating our 
conditions for the existence of solutions to 
Problem B: 


A'X - fl.fl'OA' 

+ C" 

JC': * 0 



(.1.2) 

YA', + A, Y+ Y(C\fC:f )Y + 





(.V3) 

where F, A,, and C], are tletined 

in ( 

2 1). (2..V) 


and (2.4), respectively 


Theorem 2. Consider the feedback system of 
Fig I, with the plant G given by ILL), llien 
there exists an admissible amiroller K that 
solves Problem B if and only if the following 
conditions hold: 


(i) The ARt (3 2) admits the stabilizing 

stilution A ;, and A';. (3.5a) 

(ii) The ARF (3.3) admits the slabili/ing 

solution VV (3 5b) 

(iii) p(>;a >)<‘i (3.5c) 


Moreover, when lhc.se conditions arc met, one 
solution to Problem H is given by 


where 



A,X 

H - F 



(3.6a) 


A f (J 1)B,H f 1B,T -I (/ - i:)/f,//;A,, 

(3.6h) 


1-H- B\X,. 

Z;:-(/ K.A'.v) (3.fK) 

and t\ A, arc defined in (2.1) and (2.3), 
respectively 

It should be noted that, under assumption 
(I 2d), condition (3 5a) is equivalent to the 
existence of an admissible controller K such that 
II7^11,1 (Doyle et al., 1989a). I’he other two 
conditions, namely (3.5b, c), reflect the fact that 
one of these admissible controllers must also 
minimizx* H7'|||2 As it will become clear from the 
proof of Theorem 2. when imW;cim//i, 
Problem B has a solution if and only if condition 
(3,5b) holds. In this case, the constant gain F 
defined in (2.1) is a solution to Problem B. 

Since a solution to Problem B is also a 
solution to Problem A. Theorem 2 may l)c used 
to produce a sufficient aindition under which 
Problem A can be siilvcd. It is obvious that 
Problem A makes sense only if condition (3.5a) 
holds. In other word.s, if (3.5a) is not satisfied 
then, there is no slate-feedback controller that 
internally stabilizes the plant G and yields 
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H7ilU<l. An immediate consequence of 
ITicorcrn 2 is the following. 

Corollary 1. C onsider the feedback system of 
Fig. I, with the plant O given by (11). Suppose 
that ctmditions (3.5) hold. Then the controller 
given by (3.6) is an admissible controller that 
solves Problem A. Furthermore, 

inf (H7 'j 1|^:K admissible and ||72l|. 1} 

“ inf {llTJLv/C admissible}. 

We conclude this section with a number of 
intermediate results that will lead to a prmd of 
Theorem 2. In the light of rheorem I, solving 
Problem B reduces to that of finding a controller 
of the form (2.7) such that irT|U ' I. Let f . 
and (' 2 ^ be defined by (2.1), (2.3) and (2 4), 
respectively. An easy calculation shows that 
when the controller given in rheorern 1 is 
connected to the plant (i, the closed Imip 
transfer matrix from to z> equals 

f f/. WV,, W € RH' (free), (3.Ka) 

where 

0 0.1 

VV.-II,«: (3.Hh) 

From (3.Hb) we observe that if imW, ciimAf, 
then V; = 0. and I) - A, for all W e /?//*’. 
rherefore, in this particular case, we can not 
exploit the transfer matrix W to reduce ITLII,. In 
other words, for all W c RH it folUiws that 
7> - /;(/’ ), where F is the constant gain given in 
(2,1). 1he folh)W'ing lemma gives necessary and 
sufticient conditions loi the existence of W f 
RH' such that irr||.' I and it will become 
useful for establishing rheorem 2. 


Lemma 2. Consider the transfer matrix I\ given 
in (3.K). Assume that Vj / 0. Then, there exists 
W e RH' such that H7;||,‘ I if and only if 
conditions (3.5) hold. In this case, a transfer 
matrix W € RH' such that H7;i|, < I is given by 


W 


. 


Z:R:V: 


(3. lO) 


where Aft :-- A ^ R^H, and /7, 1 and Z, arc 
defined in (3.6c). 


Proof. First wc factor the non-zero constant 
matrix as Vi-MoM,, where is a full 
column rank matrix and M, satisfies - /. 
(Note that this factorization always exists.) Now 
it is easy to sec that the closed knip transfer 
matrix I] given in (3.H) equals the transfer 
matrix from w. to in the following diagram: 



(3.11) 


Note that the full column rank property of Mo 
guarantees that the existence of W e RH‘ such 
that H7:||. < I IS equivalent to the existence of 
( eRH' such that W'fW. < 1. 

Next, wc show that conditions (3.5) arc 
necessary and sufticient for the existence of such 
a transfer matrix ( First note that since the 
open loop transfer matrix (from i' to r) in 
(3.11) is identically zero, and since Af. is a 
stability matrix, if is obvious that a given 
controller ( is admissible for P if and only if 
( eRH\ Wc claim that the auxiliary plant P 
defined in (3.11) satisfies all the assumptions of 
Theorem A.7 (see the Appendix). This claim 
will be verified later. 

Now, applying the result of I'heorem A.7 to 
the auxiliary plant P and after some algebra, one 
concludes fhal there exists C ^ RH' such that 
II/ill* < 1 if and only if the following conditions 
arc met: 


(a) The ARL (3 2) admits the stabilizing 

solution A';, and A'.r-O [Here we have 
used assumption (i.2d) | 

(b) The ARH (3 3) admits the stabilizing 

solution > 2 . and V. "■() [Here we have used 
the identity - VI V .\ 

(c) pOVA'.)" ! 

I'hc equivalence between the condition (b) 
above and (3.5b) is obtained by observing that 
the stability of Af implies that any symmetric 
solution to the AR1“ (3.3) is piisiiivc semidefin- 
itc. Wc must also show' that when the above 
conditions are met there is a choice of ( not only 
in RH' hut also in RH'. This immediately 
follows from the construction of the controller 
given in Theorem A.7. In fact, from (A.8a), wc 
observe that C' can be chosen to be strictly 
proper. 

Finally, assuming that conditions (3.5) hold, 
the formula for W given in (3.10) follows from 
(A.8) (to obtain a formula for C), and solving 
the linear equation indicated in (3.11) for the 
transfer matrix W’. In this step we have used the 
fact that there always exist a choice of M, and 
such that V 2 = A7,'Af,7 (where M,; denotes a left 
inverse of Mo). 
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To complete the prtxif, we must verify (hat the 
auxiliary plant P in (3.11) satisfies all the 
assumptions of Theorem A 7 Clearly, ( A 1) 
follows from the stability property of 
Assumption (A.2) follows from (1.2d) and the 
identity Finally, using (1.2c) and (he 

identity 

{Ay- ja>/ B ,1 ^ ^ “ jt»>/ fill! / 01 

[ CV Avll (\ /)J1f /J’ 

we conclude that (A.3) is satisfied, llie fact that 
assumption (A.4) holds is a consequence of the 
nonsingularity of Ay and the full row rank 
property of M, O t D 

Proof of Theorem 2. We consider two cases. 

Case 1. Suppose that imfl;, im/fIn this 
case (cf. (3.1)) Combining the results of 

Theorem 1 and Lemma 2 it is clear that among 
the admissible controllers that minimize ir/,||; 
there exists one such that || /'>||, < I if and only if 
conditions (3.5) hold Suppose that these 
conditions hold and let W he given by (3.10). 
Define 

A, Aft 4 (/ - 

c;, ;-// f 

Using these equations and the fact that 

Z:= W^Mi [cf. (3.fK')|, It follows from (2 11) that 
a solution to Problem H is given by (3 b) 

Case 2. Suppose that im/f c im/f. In this 
case Li and V'j are both zero [cf (3 1)). 

Therefore, from (3 Ka), we conclude that 
Problem B has a solution if and onlv if 

l|.V:IL - I. (3.12) 

where the transfer matrix 5, is defined in (3 Kb), 
We claim that (3 12) and (3.3b) arc equivalent. 
In fact, since At is a stability matrix, from 

Lemma 4 in Doyle et al. (IMK^a) it follows that 
(3.12) is satisfied if and only if the ARL 

YA 'y -f A, Y ^ F(C )y \ - 0. (3.13) 

admits the stabilizing .solution The claim is 
finally established by observing that 
implies that the ARLs (3.3) and (3.13) are the 
same. Next, wc show that conditions (3.5a) and 
(3.5c) are necessary for Problem B to have a 
solution. 

Suppose that Problem B has a solution, then 
(3.12) holds. From (3.Ka) it follows that the 
admissible controller F defined m (2.1) yields the 
closed lot^p transfer matrix 7^-(F)™.ST Hence, 
from (3.12) and item FL4 in Doyle e( al. 
(1989a), we conclude that condition (3.5a) must 
hold. 

The necessity of condition (3.5c) will be 


proved untjer the icchnical assumption that the 
pair (C%,A) is observable. (Even if this is not 
the case, (he result is still true, and can be 
obtained by factoring the unobservable subspacc 
out.) Suppose that Problem B has a solution, 
then condiiionli (3.5a, b) are satisfied. It is ciisy 
to show (using the observability of the pair 
(C' 2 . -4)1 that the stabilizing solution to the ARE 

(3.2) satisfies >0. Define V, From 

(3.2) it follows that Y, satisfies 

AY, 4 >\/t 4 >,( :c\v; 4 8,H: 

(A 4 YA X.y 

^ Y:^{A i(H,Hy H,H\)\\)Y, (3 14) 

Hence, is (he (unique) anti-stabilizing 

solution to the ARl: (3.14) Wc now show that if 
T denotes any real symmcinc solution to the 
ARE (3 3) then 

y, - Y (315) 

Indeed, using a '‘completion of squares' 
argumeni, it follows that any solution Y ol (3.3) 
satisfies the quadralic mairix mequaliiN 

v4y 4 YA 4 Yc:(\ Y 4 Hji: /uw; 

- (/T, 4 / > ) (f(; 4 FV)- 0. 

Hence, from Ran and Vieugdenhil (I9HH), il 
follows that inequality (3 15) must hold. 

Note that the pair (('i/.i4,) is observable. 
Ihis follows fri'in the observability of (( .,/t) 
and assumption (1.2d) Since (3 5h) holds wc 
conclude from Willems (1971) that the anti' 
stabilizing solution to the ARl: (3 3), say Y , 
exists and 

y (3. Hi) 

where Y> denotes the stiibili/.ing solution to the 
ARL (3.3) ( (imbinmg (3 15) and (3.1b) we 
obtain that y, - V' ' V'l, which implies (hat 
’ > Yy rherefore, condition (3 5c) is 
satisfied 

To complete the priMif we must show that 
when conditions (3 5) hold, (he controller K in 
(3.6) solves Problem B. Ihis is immediate since 
V'j -O implies that X - f) [cf. (3.6c)|. Ibus 
(3.ba) reduces to 

^ -4 4 (/#,«; «,/i;)A ;i 0 , 

Since F is an admissible controller, the result 
follows from (3 12) and (he fad ihat /^(F) = A; 

O.L D 

4 sm lAI ( ASI S 

In this section wc will focus on Problem A. 
Corollary 1 tells us that if conditions (3.5) hold. 
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then there is a .solution to the unconstrained 
problem inf (||7’,(/C111;. :/C admissible) thai also 
solves Problem A. Therefore, one might be 
tempted to conclude that these conditions arc 
tCK) restrictive. We claim that this is not the case. 
In this section we show that if imfl, n imfl^ 
then conditions (3.5b, c) hold. In fact, under this 
geometric condition, a much stronger result is 
true As before, let II,and 

(4.1) 


Lemma 3. Consider the feedback system of Fig. 
1, with the plant G given by (1.1). Assume that 
im/f , n imfl^ ~ denote two 

(arbitrary) constant state-feedback matrices for 
the plant G. Then the dynamic siatc-feedhack 
controller 


_ AI AIA SAf ^ 

" ^1 F,(/ A) f f^A 

where 


(4.2a) 


A,; -A t (/ A)/f,7, t A«,F,. (4.2h) 

A t /I,/;. A - (4.2c) 


achieves the following closed loop transfer 
matrices: 7,(A ) /,(/,) and 7;,(A) ” /;(/'.>). 

Moreover, K is admissible if and only if both h\ 
and are admissible 


Proof, Note that Afl,-(), since 11, is the 
orthogonal projection onto (im/^,)'. Next wc 
show that A/fi- rt:. It is easy to sec that 
imfl, n imW.. - 0 implies that kerV\ ~ kerTf i. 
Since VlV. and /fiW> arc the orthogonal 
projections onto (kerF>) and (kerff.) 
respectively, and since orlhogoruil projections 
are unique, wc conclude that 

v: 

Tlicrcforc. 

(Actually, A is a projection onto imW;.) 

Let the controller K be given by (4.2) Let i 
and ^ denote the stales of (/ and A respectively 
C onsider the interconnection of f ig. I and define 
new coordinates and according to 
x„ (I - A)a^ 5 and - At $ It is easy to 
verify that the transformation from (x, c) to 
(i:„, invertible. Using the fact that AH, 0 
and a trivial compulation shows that 

the closed loop equation for the block diagram 
of Fig. 1 is given by 

f fl.n, 
dr 


d7 


(A ^ ^ 


z, = (C, F DiFi)x„ ^ (C\ 4 D,F 2 )^« 

^2 - (Cz ^ + iCz ^ 

which completes the proof. O.E.D. 

IvCmma 3 tells us that whenever the two 
subspaces imH, and imH^ are independent, there 
exists a dynamic state-feedback controller that 
simultaneously achieves closed Icxip transfer 
matrices 7, and 7^, provided there exist constant 
stale feedback matrices F^ and 7s such that 
7', = 7,(7',) and 72=7>(72)' The connection 
between I.emma 3 and Problem A is given by 
the following lemma. 

Lemma 4. C onsider the feedback system of Fig. 
1, with the plant G given by (11) Suppose that 
im/7, n im/i 2 = (I Then F^roblem A is stilvable if 
and only if there exists an admissible controller 
K such that |172(A)|L I In this case, a solution 
to Problem A i.s given by (4.2) with 7, = 7 and 
Fy - H, where 7 and H arc defined in (2.1) and 
(3.6c), respectively. 

Proof The necessity immediately follows from 
the dclinition of FVoblem A. The sufficiency part 
is as follows. First, note that the existence of an 
admissible controller K such that H /^A )!!. < 1 
implies that condition (-3.5a) holds. In this case, 
the constant matrix // in (3 .Ik) is an admissible 
controller such that ||7;(//)||. ^ 1 (See Doyle vt 
u/., Note also that the constant matrix 7 

in (2.1) is an admissible controller that 
minimizes || 7, ||;. C'hi>osing 7,: - 7 and 7 . “//. 
the result follows from Lemma 3. O.L I) 

It is also interesting to establish a connection 
between Lemma 4 and C orollary 1. Suppose that 
imH, n imTf^ - b We will show that conditions 
(3.5b, c) are automatically satisfied Recall from 
the proof of Ixrnma 3 that under this geometric 
condition, B\H. Hence, the ARH (3.3) 

reduces to 

>'a; 4 A,y'^ F(C ;^(\,)V'-f). (4.3) 

which has the unique stabilizing solution - 0. 
(Recall that A, is a stability matrix ) Thus, 
conditions (3.5b, c) hold and from Lorollary 1 
we conclude that Problem A has a solution if 
and only if condition (3.5a) holds In this case, a 
trivial computation shows that the controllers of 
Corollary 1 €ind Lemma 4 are the same. 

We conclude this section with an example, 
C3ur objective in this example is to show that 
although Problem A need not have a unique 
solution, there arc situations in which any 
solution must necessarily be “dynamic ”. With 
reference to Fig. 1, let G be given by [note that 
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G satisfies Assumptions (1.2)| 


G- 


- 1 !] 


1 

(1 

0 

0 -ij: 

i 

11 

1 J 

1 


|0 01 

V2 0 


(4.4) 


First, note that the ARF (3 2) admits the 
stabilizing solution 




1 0.5 

0 5 0 5 


which IS positive definite. Thus, the set of 
admissible controllers K such that |r/,j|.- 1 is 
non-empty Since irn/^, n irnW) - 0. l.ernma 4 
may be used to solve Problem A. From (2.1) it 
follows that F - fO 0] This is obvious since 
z, ~ u and the plant (/ is stable. Next, we 
compute the gain H:~-H\X^ In ihis case we 
obtain // “ - (0.5 0 5). Finally, from (4,2) it 
follows that a solution to Problem A is given by 


K 


1 

0 


I 


1 


.:l4J’. 


I 


0.5 -0.5 105 0.5 


which obvioush has McMillan degree equal to 
two, Wc now show that in this example any 
other solution to Problem A must be dynamic 
First, note that 

inf (II/,(A,')|1.: admissible and 


(Problem A). This problem is well motivated 
Vince it mtHlclv a problem of optimal nominal 
performance with robust stability. Previous 
authors have only considered the minimization 
of an upper bound for the design objective 
In this sense, the results of this work constitute 
the first results on this problem 
From ljL*mma ^ it follows that if the iwo 
subspaces imB, and iml#> arc independent, then 
one can always find a dynamic state feedback 
controller that simultaneously achieves given 
closed loop transfer matrices 7, and I; provided 
they can be separately achieved using siiitk: 
statedeedback controllers The simplest case for 
which the condition id inde|K‘ndence of imW, 
and is not satisfied is when /#, - By Recall 
from the prtmf of rheorem 2 that in this case 
Problem B has a solution if and only if 
||7;(F)||.< 1, where /* denotes the LOR gain 
defined in (2 1) Tlicrcfore Pri>bleni B does not 
help much in solving Problem A. In this sense, 
further research on Problem A for the case 
fl, - /f. should be most useful 
l‘he example m Section 4 illustrates ihal. even 
though the plant stale is available for feedback, 
Problems A and B need nol have a static 
solution Lhis is in significant contrast to the 
classical results m the I.OK theory (Kiilmun, 
IW)) and the recent results in //' control 
theory (Khargonckar rr al,, IMHH) which show 
that these iiplimal control probltMUs always have 
a static slale-lccdback siilution. (his may have 
some implications in the outpuldeedback case. 
For instance, it might turn out lhal in the 
output-feedback case the dimension of optimal 
controllcrsi m mixed // ///' problems exceeds 
the plant dimension 


|!7;(A)|i.- U-O. 

Using some simple algebra it is easily seen that 
the unique stale feedback ‘gam ' that achieves 
this optimal performance is f - |() (1). From 
(4.4) it follows that H 7T7 )||L " \/2. Thus wc 
conclude lhal for this particular example any 
solution to Problem A must be necessarily 
dynamic 

S ( ()N( 1 l SIONS 

For the state-feedback case wc have com¬ 
pletely solved a mixed // ///’ control problem 
(Problem H). Necessary and sufficient conditions 
for the existence of solutions to Problem B were 
given m terms of solutions to certain AREs. A 
closed form expression for a ,M>lution was also 
provided, A solution to Problem (when it 
exists) alst) solves the constrained optimal 
control problem of minimizing an //" perfor¬ 
mance measure subject to an //' con.straint 
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APPf NDIX 

State-^pace formulae for the oandanl H’ problem 

The result given in this up^Kmdix provides a solution to the 
standard //‘-optimal control problem, and is a slight 
miMliriCHlion of Itieorern I m (ilover and Doyle (19K8) 
C'oiiKidcr the feedback .system shown m I ig 2. where fnilh 
the plant /' and the controller ( are real ratuirial and projK'i 
Let / (( ) denole the closi'd loop transfer matrix from n to 
Assume that /' has the Inllowing realisation 




Fici 2 Feedback system, 


(ivj For each w e R 


has full row rank. 

Now , dehne the matrices 

A, -A - //.//'(f , A, ^A - 

In the result given f>clow we will make use of the following 
algebraic Riccati equations for X and Y, respectively. 

A\X > XA^ I X{B^B\ B^fi\)X + ( ',(/ - D.DifC, - 0 

(A 5) 

A.Y V VA;. f Yic \(\ C ,(\)Y ^ a,(/ - ^ 

(A 6) 

The next result is a slightly mrKlificd version of Theorem I 
in Glover and Doyle (I9K8). 

Theorem A 7 C onsider the feedback system of Fig 2 Then 
there exists an admissible coniroller ( such that ||7'((')||*, < 1 
if and only if the following conditions are satislied: 

(i) The ARF (A 5) admits the stabilizing solution .V,, 
and A'. ' 0 

(li) Ilie ARF (A 6) admits the .stabilizing solution V', 
and V' * 0 

(III) p(V;A'J- I 


along with the assumptions Moreover, when these conditions hold one such a coniroller 

(i) (A, Hj) siahilizabic and (( ,. A) detectable (A I) 

(II) /f;/), ' / and /),/>;. / (A 2) A,, + (fl, ^ i I - Z,/.,1 

(til) F^ir each lu f H ^ ^ p t (I r 


A pii/ /f I 

n, 


has full column rank 


(A3) 


where 


I , ■ { Y,C'\ C - -{B.X, ^ n\(\), 

A, Z,-M/ ■ K.A'.) (A.8b) 
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^'-Optimal Control of Multivariable Systems 
with Output Norm Constraints* 

J S McDONALDt and J B PhARSONt^ 

The control problem Ls considered for ((enerai rational plants, 

possibly subject to f ‘-norm constraints on some outputs, and a procedure 
given for the construction of optimal or near optimal rational 
comperusators. 


Kty ( iintrul system syniKtsis. lincui opluiiiil control, iiuiliivttniiblc control Itntvii 

programming. 


Abtlracf—In this paper, wc consider the C optimal control 
problem for general niiional plants It is .shown thai lor 
plants with no poles or zeros on the unit circle an optimal 
compensator exists and that the resulting closed (iKip iransfei 
function is polynomial whenever (here arc at least as many 
controls as regulated outputs and at least as many 
measurements as cxogcneoiis inputs Pxacily or approxim¬ 
ately optimal ralional compt'nsaiors can he obtained by 
solving a sequence of liniic linear programs for the 
coeffiaents of a polynomial cloved loop transfer function No 
assumptions on plant poles or zeros arc required \o obtain at 
least approximately optimal comtKnsaiors It is shown that 
cunsrrairtcd problems in which a set of outputs is rcgulaicd 
subject to -norm constraints on another set of outputs can 
be solved using a slight modificaiion of (he same algorithm 

Notation 

Let m and n be positive integers fhen we define 

real normed linear space of all m x n matrices 
H each of whose* entries is a right-sided, absolutely 
summable real sequence - *»);.„ The 

norm i.s defined: 

max V V jA/ ((c)| 

.-I 

The real normed linear space of all m > n mainces 
H each of whose entries is a nghi-sided, magnitude 
bounded real sequence ft,) lire 

norm is dehned: 

m 

11/^11, "" X sup 

,I ^ * n. 'I ‘ * 

The subspace of consisting of all elements 
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cath of whose entries converges to /eio. that is 

!»• C., //„(*)>• 11 

Vi. (1. .ml.M (1. ,fi|| 

l.et m and n Ih* as afxivc and let hi' a complex viiriabk 
Then we define 

/). 0 The o|H'n iirul closed, ies|x?ctisely. unit disk in the 
complex plane 

T( ) The f transform ( iiven a matrix H ))*-o 

of right sided real sequences 

JiH) X '/<*)-’* 

« u 

normed linear sjiacc of all m x n matrices 
H such (hill H Ti/i) for some sequence 
b * Thi- norm is defined ||A/||^ 

Ibe subspace of consisting of all rlemcnis 

each of whose entries is a real-rational function of 
z (T.nines arc precisely those with all poles 
ouKide I) I 

Wc will often drop the m and n in the atnivc notations when 
the dimension is either unim|>orianl or dear from the 
csinicxi Because the ./ tninsbirm is an invertible mapping 
on all the above scquciue spaces, we can amKiale sequences 
and their 7-lrans(orms as pairs For such a pair, we write a 
halted varialdc to denote the sequence and an unhatted 
variable to denote the corresponding 7 transform 

Now lei X be a real normed linear space. Ici ,S r A' be a 
subspacc of X. and let ji * lu* a Isnurtded linear furu.'tiofial on 
X Then we define 

HX The closed unit ball of X , fiX {i r A” |U || ^ I} 
(x, X*) Ihc value of the bounded linear functionul x* at 
the fioini X f X 

X* 1he space of all Niunded linear funclumalx on X, 

alMi called ibe dual space of X A* is a compkle 
real normed linear space with the norm defined 

sup I(i.x')|. 

S' The (rightJ annihilator of 5c A, 5' {x*e 

A* (r. 1 •) >^ () Vx f .V) Thus .V ' is a subuftace of 
A* 

\S The (left) annihilator of 5rA*; \S;a=^(xc 

A (x. X' > - 0 Vi • t 5} Thus ' 5 is a subspace of 
A 
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I INTROIMiC IION 

In rifis pafxrr, we consider the problem of 
minimizing the maximum magnitude of a set of 
regulated outputs of a linear discrete time system 
excited by bounded amplitude disturbance sig¬ 
nals, using a linear shift invariant discrete-time 
compensator, I his is equivalent to minimization 
of the /t-norm of a closed loop transfer matrix of 
the form, given a transfer matrix H f: . 

4> U K 

where K takes values in some feasible set //. The 
required compensator is constructed from K. 
The feasible set depends on two given transfer 
matrices U and V in laking 

{K c 'MA : A satisfying K - (JQV ) corres- 

(Kinds to minimi/ing over all stabilizing compen¬ 
sators with rational transfer matrices, while 
laking .7 - .V,,, : - {A' (: A : 3Q c A satisfying K ” 
corresponds to allowing stabilizing 
compensators with transfer matrices in the 
quotient field of zt f r<im a practical standpoint, 
the former version of the problem is most useful 
since it considers only (mile dimensional 
compensators, while the latter allows the 
com|Knsalor to be possibly mtimie dimensi<»nal. 
However, because of the properties of A as the 
dual of a norrned linear space, (he latter problem 
has been the standard one studied 

In Dahleh and Pearson (IMH7), the problem 
with .7 Sy was considered under several 
assumptions on LI and that U has lull row 
rank, V has lull column rank, neither (I nor V 
have transmission zeros on the unit circle, all the 
zeros of (/ and V in 1) are simple, and H and V' 
have no common zeros in f) I’he rank 
assumption on LI and corresponds to requiring 
that the ofxui loop system have at least as many 
inde(K’ndenl control inputs as outputs to be 
regulated and at least as many independent 
measured outputs as disturbance inputs, while 
the zeros of f/ and T arise from the poles and 
zeros of the open loop system It was shown that 
a A',, c exists which minimizes ||^|| , and that, 
in fact, any such A,, must be in S so that the 
problem has a solution when .7 " Moreover 
for the minimizing A,,. ^>0 -// AO is a 
piilynomial which can be constructed from the 
solution of a sufticienlly large finite linear 
program forniulatcd in a dual space. This linear 
pmgram is equivalent to the problem with the 
feasible set restricted to meluJe only As such 
that ~ H - A is a polynomial of fixed degree 
at least equal to the degree of tl>„. 

In Dahleh and Pearson (U>KH), a particular 
problem in which (/ has dimensions 2 x 1 and 
has dimensions 1 x 2 was considered (that is. the 
above raink assumptions arc not satisfied). 


Similar assumptions were made on the zeros of 
U and V, enlrywise. It was shown once again 
that a minimizing K exists in but without the 
above rank assumptions it is unclear whether a 
minimizer exists in S. It was shown, however, 
that if there exists a A e such that <t> - H - K 
is polynomial, then a sequence of increasingly 
large finite linear programs can be formulated 
With the property that the minimum norms form 
a non-increasing sequence which converges to 
the infimal norm. Thus this gives a mcthcxl of 
finding approximate minimizers which are 
arbitrarily gcKid by solving a sufficiently large 
linear program, bach linear program cor¬ 
responds to restricting the feasible st!l to As such 
that 4> -- // " A is a polynomial of a fixed finite 
degree Again, these linear programs arc 
formulated in a dual space and the correspond¬ 
ing <l>v consirucled from their solutions. 

In this paper, wc have two main aims. First, 
we wish to give a method for computing 
implemcnlable compensators with optimal or at 
least close to optimal performance in the most 
general possible selling In this spirit, wc will 
lake .7 = *V in the formulation of oui standard 
problem and drop as many of ihe above 
assumptions on Li and V as possible Second, wc 
address the problem of minimizing the maximum 
magnitude oi a set of regulated outputs subject 
to constraints on the maximum miigniludc ol 
other outputs, I his corresponds to a “disk ' type 
constraint on the norm (d d> 

In Section 2 wc discuss briclly the (orriuilation 
of our standard problem and identity lour cases 
determined by the rank (i.c. row or column) ol 
the matrices ( ' and V' These cases are treared 
separately throughout Ihe paper and lead to 
significant diflcrenccs in the pro(XTlies of the 
problem 

In Section 3, wc use essentially the same 
approach as Dahleh ami Pearson (1*^87. 1988) to 
address existence, that is, wc cimsider the 
problem lirst with .7 - S, and then infer 
existence of a minimizer in .S if possible We will 
retain only Ihe assumption that T and have no 
unit circle zeros and show' that a minimizer exists 
in regardless of the ranks of Li and V’ In the 
case in which II has full row rank and V' has lull 
column rank, a mimmi/cT exists in S and 
corres|K)nds to a polynomial <1> This is the 
expected generalization of the results of Dahleh 
and Pearson The characterization of the feasible 
set in this general case is the main new result 
in this section and provides the key not only to 
proving existence but to computing minimizers. 

our priH)fs of existence of minimizers are 
somewhat more direct than those previously 
given. 
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In Section 4. we drop all assumptions on V 
and V and consider the compulation of exaci or 
approximate minimizers in 5. First we note that 
the characterization found in Section 3 of the 
feasible set extends in an obvious way to 
characterize S even when unit circle zeros arc 
present in U and/or V We show that when U 
has full row rank and V has full column rank, 
arbitrarily good approximate minimi/ers can 
always be found by solving finite linear 
programs, which again correspond to <l> being a 
polynomial of a fixed degree We formulate the 
linear program in terms of the coefficients of the 
polynomial <I>. Of course, when U and V have no 
unit circle zeros, a sufficiently large such 
program will yield a minimizing K, When LJ and 
V do not satisfy the rank assumptions, there may 
be no K eS which gives polynomial, so that 
the above pr(Kcdure cannot be used. We give a 
simple characterization of alt prviblems which 
have this difiiculty. 

Finally, in vSeclion S, we define a class of 
constrained problems as described above We do 
not consider the existence of minimi/ers for such 
problems, but we show that, provided the 
constrained problem is feasible, arbitrarily good 
approximate minimi/ers can he obtained as 
easily as for the unconstrained case by a slight 
moddicalinn of the same algorithm 

: PROHLI M tOKMlil A HON 

In the standard problem which wc will 
consider, we are given a discrete time system (f 
which is causal, finite dimensional linear and 
shift invariant (FDl.Sl) and hence is described 
hy a real-ralional transfer matrix C/(r) I'he 
system (I has two (vector) inputs and two 
(vector) outputs; k is a vector of exogeneous 
disturbance inputs, j is a vector of n, outputs 
which arc to be regulated, v is a vector of n, 
outputs which arc mcasurahlc, and u is a vector 
of control inputs. Fhe control input u is 
assumed Ir) the output of a causal I DLSI 
compensator ( whose input is the measured 
output y If wc partition the transfer matrix (V(z ) 
conformally with these inputs and outputs, we 
obtain the following equations to describe the 
closed loop system; 



u “ Cy. 


It IS well known that if the system G is 
admissible (Cheng and Pearson, 19H1). the scl of 
alt closed l(K)p transfer matrices <I> from w to z 
which may be achieved by choice of C, and 
which correspond to an internally stable 


closcd-kH>p system, may be described by the 
following parametrization (»ee c,g. Francis, 
1987): 

UQV (2.2) 

where 

H Gu ^ 

LJ:=^ G,.M 

V'’ ; r: 

Q t iA 

and - NM ‘ jVf \\ arc arbitrary right and 
left stable coprime laeionzalions of G*^ (i.c 
copnmc over Also, the following He/out 

identity is satisfied; 



The transfer matrices //. I’, and V' arc all in lit A 
and the transfer matrix is the free design 
parameter I he <l> c; corresponding to a 
particular {) may lx achieved by ehoiising the 
cornpensiitor transfer matrix C as follows: 

( ^ {Y MU)(2i Ni>) ' (2 

-(A' QN) ’(V QM) (2Ah) 

In this setting (he problem of minimi/alion of 
||f||. when wiHG is equivalent to the 
following minimum distance problem in JiA: 

kOPT) ini II// M 

k I S 

where S : - {A a )^A : 3{} ( .i^A satisfying K 
IJQV) We will somelirnes say, given a problem 
(OPT), that (OPI) IS the standard problem 
defined by //. U and V given above Also, given 
a system (/' and input and output weighting 
transfer matrices W., r JJA, the problem of 
minimizing ||VV, ♦fy. when the inputs are in a 
weighted hall : ■ (k c <' :3v ( PT satisfying 
X - VV^V) niay be put in the above form by 
taking H - W //'W;. U - WAJ\ and V' - V wJ 

Ihe only assumption which will be considered 
to hold generally throughout the paper is the 
following: 

Assumption 1. The transfer matrices (/ and V 
have full normal rank, (hat is. full rank for 
almost all z. 

Special cases 

Given the above assumption, the dimensions 
of the inputs and outputs of the standard system 
of (2.1) determine what kind of rank (i.c. full 
row rank or full column rank or both) that U and 
V have, and we can cla.ssify problems (OPT) by 
rank as follows. In the case n,, * n,, or at least as 




320 


J S. McDonald and J. B. Pl arson 


many control inputs as regulated outputs, U will 
be a ‘‘fat’' matrix with full row rank. Jf wc have 

or at least as many measured outputs as 
cxogcneous inputs. V will be a “skinny” matrix 
with full column rank. Intuitively, this combina¬ 
tion of dimensions is good from the point of view 
of dcvsigning compensators for the system, and 
the study of (OPI) turns out to be simpler in 
this case. Por this reason we will call this the 
good rank ca.se. If n^, * n,, U will be a skinny 
matrix with full column rank and we will say this 
U has had rank. Similarly, will result in a 

fat V with full row rank, and we will say this V 
has bad rank. Problems in which U and/or V 
have bad rank will he called bad rank problems. 

rhe various combinations of good and bad 
rank in U and V thus define four cases of 
(OPT) Note that for the //' problem, it is also 
these combinations ol ranks in and V which 
define the usual four cases of that problem (the 
one-block problem, the two cases of two-block 
problems, and the lour-blcKk problem). We will 
consider in detail just the two extreme cases m 
which either both (/ and V have good rank (the 
one-block profdem) or both have had rank (the 
four-block problem). I'he intermediate cases 
(two-block problems) have properties essentially 
like the latter, and wc will make comments in 
the sequel to indicate how they can be treated 

^ I Xl.Sl t N( I Ol A MINIMI/I K 
In this section,we consider the question; When 
does there exist K^i-S such that ||// 

Our approach is to make use of the 
following two theorems from Luenberger (l%Si), 
which ensure existence id solutions to mininuim 
distance problems set in the duals of normed 
linear spaces and idenlilv a useful property 
called alignment of such solutions when they 
exist. 

Deftnitiioi 1. Ciiven a real normed linear space X 
and Its dual X\ we say that an element v* e A * 
and an clement a c A' are aligned if ( i. a*)- 

IkII ik^ii- 

Theorem 1 l.et i be an element in a real 
normed linear space A and let d denote its 
dislunce from the subspace M rhen; 

d - mf IIV “ m|| - max (v. v'') 

;m.. U 1%./or 

where the maximum on the right is achieved for 
some arte M with ||anll ~ I If the mtimum on 
the left is achieved for some then 

X - mu is aligned with x*. 


Theorem 2. Let A/ be a subspace in a real 
normed linear space X. Ijci x*eX* and let d 
denote its distance from Then: 

d= mm m" = sup (a, 

nj’t M 4 e /J.V# 

where the minimum on the left is achieved for 
M>me m* e Af . If the supremum on the right is 
achieved for some x,, c M, then x *""mo is 
aligned with Xu- 

The following corollary to I heorem 2 follows 
easily using the fact that if a subspace A/ in a 
dual space is weak * -closed then Af - k Af |' 
(Rudin, 1^73, Thm 4.7) In fact, it is equivalent 
to Theorem 2 (except for the alignment 
condition) using the fact that for every subspace 
Af of a normed linear space X, M is 
weu/c^-closed in (Rudin, 1973, p. 91). 

Corollary 1 Lei A^ be a normed linear space. 
Let X * 6 X* and let M* be a subspace of X*. If 
M* is KrrA‘-dosed, ihen there exists an clemenl 
niu c A/‘ such that; 

niu ~ inf m' 

Since the space ;y?/4 is not complete and hence 
cannot be a dual space, the question of existence 
of a minirni/er for {OPT) cannot be resolved 
directly using these results Instead wc consider 
the related minimum distance problem in ; 

(OPT): int ||// A!!, u, 

Ki s, 

where A,; - (A c / ‘ : 3^^ c A satisfying K = 

We will use the facts (laienherger, l%9) 
that (i ll,.,,)* -w, when wc define linear 
functional evaluation as tolli^ws, given (I 
and H c 

tu r) > 

/■/) : - X X ^ f»„(*;)//„(A ) 

I 1 ,r I A II 

and that - Cli.r, with a similar definition 

of functional cvaluaiion. 

(OPT]) is the problem which was considered 
in Diihleh and Pearson (1987, 1988). It is also 
clearly cquivalcnl to (OPT) with the feasible set 
enlarged from just S to all of S^, since 
and arc isometrically isomorphic under 

the J-iransform. Our approach will be to use 
Theorem 2 to establish brst the existence of a 
minimizcr for (OP7]) (which correspiinds to a 
point in A.d The alignment condition of 
Theorem 1 wall then allow us to conclude in 
certain cases that the :?-transform of this 
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mininiizer lies, in fact, in S and hence is a 
minimizer for (OPT). 

Wc will see that the results of Dahich and 
Pearson (1987, 1988) concerning existence 

extend to the general case in the expected way; 
in the good rank case, we will he able to 
establish existence of a mininn/er for (OPT) 
assuming no zeros of U and V’ are on the unit 
circle while in the bad rank cxisc. wc will need a 
similar assumption and will only ht* able to 
establish existence of a minimizer for {()Pi\) As 
has been shown by aiunterexample in V'idya- 
sagar (1987) we cannot hope to establish existence 
in general without precluding unit circle zeros 


The good rank case 

In this case. U has full row rank - ri, and V' 
has full column rank - n,. Before proceeding, 
we establish some notation. For simplicity, we 
replace the dimensions n, and with m and n, 
resf)ectively. We will need lo consider Srnilh- 
McMillan form decompositions (MacFariiinc and 
Karcanias, 1976) of U and given by 

(/- Lf MrRi 

(3.1) 

K- 

where Lii, Ri , l y. and Ry arc (polynomial) 
unimodular matrices and M, . arc rational 
matrices which have the familiar diagonal forms: 




0 • 


' 

1 

V',n(‘) ** 




My - 


VniZ) 

(I 


0 0 


Let denote the sci of all z f 1) which are 
zeros of either U or V' Then for each Jf y 
we can define a non-decreasing sequence of 
non-negative integers (z„) corresponding to 
the multiplicities with which the term {z ~ z„) 
appears on the diagonal of My.. That is; 



where the g,(z) have no poles or zeros at z = Zc,. 
Wc can define similarly a set of sequences Xv (z,,) 


for each A) ^ which airres|Kmd to the 
muliiplfcittcs of the on the diagonal of Mx A 
sequence sometimes referred lo as the 

sequence of siructural indices of a, tn IL 
Wc can aisr.> define m piilynomial row vectors 
of dimension m and n polynomial column 
vectors of dimension n as fi>llows 

aiz) « (/,< '),(i) i « 1. . . m 

(iXz)^{Rx'y{:) .n 

where subscript i indicates the itli row and 
superscript ; indiatles the /ih column Wc can 
now state the assumption wc will require and 
define a set of conditions which will be shown lo 
characterize the feasible set ,V) of {()P1\) 

Assumption 2. Neither U nor V have any 
transmission zeros on the unit circle, that is, 

Jy-y C />. 


Definition 2 (iivcn V and V as al>ove and 
Kc.A,„^„, we say K interpolates IJ (from the 
left) and V (from the nghi) if the lollowlng 
condition is satisfied; 

Given any zero z^, c llyy of (/ and/or V with 
structural indices 1( (a,) and (a,) in f' and V', 
respectively, wc have for all / ( (1. . . m) and 

; f {1.« (: 

(i| 

(o,X')'‘'(z.,) ==(l. * - (), . o,. 1, 

(ii) 

= - 0.a, 1. 

(iii) (H) 



x|o;''a;“ ' f). 

k - Oy . Off + I 

or; (b) 



where the argument of Oni ) and Oy{ ) is 
undcrstiKid to be Ai and superscript (/c ) indicates 
the kih derivative with respect to z. 

Note that this condition simplifies greatly in 
the case of a zero Ai which is not common lo IJ 
and V: if it is a zero only of U, for example, we 
have l\ (Ad j and (iii) arc 

trivially satisfied for all i and /. The following 
theorem shows that this condition characterizes 
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.V| in terms of its image in A under (he 
3r-transform. 


Theorem 3. Given Assumption 2, V and V as 
above, and KeA, there exists Q a A satisfying 
K " IJQV if and only if A' interpolates tJ and V. 

We defer the prcuif of the theorem until we have 
established the following two lemmas 


Lemma I, Given Assumpti(*n 2, U and V as 
above, and KaA,,,.,, there exists Q€A„,,„ 
satisfying K ~ IJQV if and only if for all 

z„ e Jin'- ' f ('.} ‘>"^1 / c (1. - . . , MI we 

have: 

0,: fZn) + Ov (z„) - 1. 


0 : 


k (1^ 


= 2 ( j(£rAC)'"(z„)/f'* "(2.,) 


+ X ( Ja'* ''(2.,)(A'/f)'''(2,d 

/ () » ' 

k ify Oy I i L . L „ / 

/ . II r-G i ' r f 

= X "(zn) 

1 -U * ^ 

+ (*)«'* "(2.,KA/f^fz,,) 

/ (I t 

ikiik - I-. ,,, 

+ 1 i, (, , 

/. f I / (I • I / ^ r / 


Proof, Wt* i:an clearly lacloi M,f and Mi ol (3.2) 
into forms: 

Af/; - Mi My Mi-^ 

where - diag |( A, );” ij and My - diag 

|(^v;)I' i| ‘**“e diagonal matrices containing 
exactly the zeros in 1) ol Af^ and My, 
res[>ectively, and A/, . My are m A with right 
and left inverses, respectively, in A. Hence: 

3C? A satisfying K - UQV 

n 

fr A saiisfving K = i.f ,My QMyRy 

■ (I 

C) M. ^.y^KRy'My^ e /I 

Hut this last holds it and only if an arbitrary 
entry of O is in A, i.c if and only if: 


for I. J arbitrary I o show' that this is equivalent 
to the condition in the lemma, first suppose (*) 
holds rhen n,K7^, - A, (),^ where K and () 
arc both analytic in /). I hus the conditions in 
the lemma hold (('hurchill and Brown, 1984, p 
152). Conversely, if the conditions in the lemma 
hold, it can be shown that wc can write 
oiiKlif ^ ky ky k,, where K^t A. Hence ()„- 
k,f € A and ( * ) holds □ 

Lemma 2. Given non-ncgativc integers o, . ru . 
and k Of 4 - I, A' e A, [x>lynomiHl row 
and column vectors a and fi. lespectivelv, and 


Proof. I'his follows straightforwardly, if some¬ 
what tediously, by manipulating the expansion: 

(rtA/f)'*'- V V ( ^ |( ^ )rt''’A'' '7f'" '' 

/ < ( /• ( t • r 

and using the fact that a, /i, and K are all in 

A LJ 

Proof of f heorem V Using l emma 1. we see 
that to prove the itieoiem we can eqmvalcnilv 

establish lor all r- (1./. ioid 

/ f (1.'O’ 

(i), (ii), and (lii) of Definition 2 hold 
(a,A/f,)'‘’(2„) = fl. ^ 

k Of fz,,) ^ Oi (zj 1. 

(); 1 his follows immediately by applying 
Ixmrna 2 in the appropriate form. 

(<z): Let z,,e ^ be arbitrary. If wc establish 
that (i) holds for arbitrary i and (ii) holds for 
arbitrary y. (in) follows by applying Lemma 2 
Considering (i) first, let i be arbitrary and argue 
inductively on k. For k “0 wc have: 

(1^ (a,Kfl,){Zo) (n,A)(zH)/^iAM.). 

V/ c {1. n) 

i^(a,K)(z,ARi '(m)) n 
z>(a,AKzn)-b 

since Ry' is unimodular. Now suppose 
(n, A)''‘(z<,) 0 for 0*./ 'z A - 1. Then we have 
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for all / : 

0= (Q,/f/!,)'*'( A,) 

= i ( *)('»."(A,) 

+ 1 (*)(a,A:)''’(A,W‘ '“(Jo) 

since the summation on the right is zero. Thus 
we have: 

Hence, (i) holds. The argument to establish (li) 
is similar. □ 

We should note that while Ix'mma I provides 
a notationally simpler set of conditions cquiv- 
alenl to that of Theorem .T the latter provides a 
smaller number of conditions on K. It will he 
clear from the next section that this will lead to 
fewer constraint equations in a linear program 
which gives an approximate minirnizer for 
(OPT) and hence more efficient compulation. In 
any event, it is clear that the feasible set .S, of 
(OPJ]) can be characterized equivalently: 
.S| = [k e interpolates U and V'} ~ (A,' e 

salishes the conditions of Lemma 1). 
The following results exploit the form of .V, to 
establish existence first of a minirnizer for 
iOri]) and then for (OPT) 

Theorem 4 Given Assumption 2, the problem 
{()Pl\) has a minirnizer A,, 

Proof, for ease of notation we will give the 
prcKif only for the case that all Z(,6 Z/ v are real 
and indicate how to generalize to the complex 
case in a straightforward way. We will show that 
there exists a subspace M of such that 

- Sy. Then .V, is weuA:’-closed and the result 
follows by C orollary 1. We will use the second 
characterization of .V, given above, which 
imposes a condition on A for each i, j, k, and z,, 

C orrespondingly, we define for each condition a 
sequence as follows: 


Let M denote the linear span of all the a 

subspace of r" Then it is immediate that 
AY‘ = .S, For (he complex zeros case, wc can 
treat the conjugate zeros in pairs to obtain twt> 
similar sequences. 0 

Theorem 5 Given A.ssumption 2, the problem 
{OPT) has a miniini/er A,, Moreover 
H - A„ is a polynomial transfer matrix. 

Proof. Vo establish this we will consider the 
problem (OPl]) to he fH^sed in the primal spact? 

and use the fact that ►V, , which lies in 
general m is in fact exactly the M given in 
the prtHif of riieorcm 4 and hence lies in rji, „„ 
We will use the alignment condition of nieorcm 
1 to show first that for any mimmizer k^ of 
(OPTy), tbn has at least one row which is 
ixilynomial Next we show that, given any 
minimi/er o( {OPl]) for which / rows of the 
corresponding <l> arc polynomial (wheir /* m), 
there exists another minimr/er for which at least 
/ f 1 rows ol the corresponding <I> are polyno¬ 
mial Hence there is at least one mmimizei kyy 
for which all rows of «I>f, arc fxilynomial For 
such a A„. A,, is clearly rational and hence a 
minirnizer for (OPT). 

First, then, suppose A„ is any minimi/er for 
(OPTy) and G,, is any maximizer tor the dual 
problem maxr,,/n; (//. Hy Theorem I. (ji, 
and 4>„ arc aligned. II (/„ is the zero functional, 
then ^4y - U and A^ - // is a minirnizer for (OPl ) 
for which is a polynomial If (i,* is non zero, 
then there is a row, say Ihc /ih, such that 
max^ IKamJIk d Since (Vnecl,,,. there exists N 
such that rriax^ l|G*i,,J|, for each / and 

all A '/V It then follows easily from the 
alignment of and Cn that 4&(*,,(A ) - 0 for each 
j when A > N and hence the r-th row of is a 
polynomial. 

Next, suppose I < m and k,y is any minirnizer 
for (OPTy) such that / rows (say the first /) of 
arc polynomial. Partition after the /ih row mi 
that: 


X M. 

(Wo - S X aHq-p)f}J{p-l)\z‘>Y^>{z„). 

p r (I y J fl 

li is easily verified (hat the abt)ve sequence lies 
in since every ZhE /). Also, given k e 


r . 1 , \ / I I 


X 


i i a!{q-p)ftJ{p~f)UT^(z.,)\ kjl) 



and amsider the problem: 

inf |!(W, A',,-) /ill, 

HfX; 

Where .5^:= {k t (k„,^ kf \'t 

.V,}. Clearly if k„ is any minimi/er for (his 
problem. \kli {k,n: + k,y]' is a minirnizer for 
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{()in\). Moreover, applying Lemma 1, we see 
thal f .V> if and only if for all , 

/ r {1. . , m } and y e (1. . , , n} we have: 

k -i), , , Of/(lit) ^ Ov,{Zu) " I 

where af denotes the last m - I entries of nr, 
Thus il is easily shown ((/. primf of Theorem 4) 
that .Sj IS in r" and the same argument given 
above applies to establish the cxisierue of a 
mimmi/xr /?„ such thal H, has at least 

one polynomial row. f lencc |/Cni (4/J„|')'^ 
is a minimi/er for (f>/^7i) with at least / f 1 
l^olynomial rows. [ 1 

The had rank ( a,\c 

In this case, LI has full column rank - n^^ and V 
has full row rank - n, We will need the 
following assumption: 

A\samf}ti(»n 3. I here exist ;i,, rows of (/ and n„ 
columns of V which are linearly indcfK'rulenl for 
all z on the unii circle 

Note that this is slightly stronger than 
requiring that II and V have no transmission 
zeros on the unit circle. Under this assumption, 
(I and V can be written in the following form 
wjtlumt loss of generality (possibly requiring the 
interchange of inputs and/or outputs); 


l-(V' V\) 

where II has dimensions x n,, and is invertible 
and V has dimensions n, x//, and is invertible 
Moreover. and V' have no zeros on the unit 
circle. 1 hus K - U(J\ can be written: 

and (7 and \ deline a good rank sub-problem of 
the overall problem satisfying Assumption 2. 
Also, we can detine polynomial coprime 
factorizations as follows 


Using these definitions we state the following 
result characleri/ing the feasible set S^ for this 
case 

Iheorem b. Given U and V' as above. Assump¬ 
tion 3. and K e A, there exists Q c A satisfying 
K - IIQV if and only if: 

(•)( .% 

^ A 71 A 77 


(ii) 

(iii) k interpolates 0 and V 

Proof, f ): If K - UQV then certainly K = 
UQV. Now» U and V have gcx)d rank and ,satisfy 
As,sumption 2 so that \{ Q ^ A then, by Theorem 
X (lii) holds. Also, 0 and V arc invertible so 
thal Q^ LJ 'kV ^ and hence: 

R21 ^ = U2O 'k 

((Jand Kn^U^QV^) 

^iljlJ ^kv LJ^Cr^Ka 

Using the polynomial coprime factorizations 
(3.3). we obtain (i) and (ii). 

( <= ): Since 0 and V arc invertible, there always 
exists a unique Q 0 ‘ solving k - U 

(JV. Since LI and V have good rank and satisfy 
Assumption 2, Theorem 3 holds and (iii)^ 
Q e A. Also: 

(\\):^K, 2 ^ kv Oqv\ 

((I) and (, J):» - LM'l 'A,. - U.QV. 

so thal A “ UQV. 

Remark I. If conditions ( 1 ) and ( 11 ) of Theorem 
6 are salished, it is straightforward to verify that 
also: 



This remark will prove useful in the next section 
The following theorem uses the ahnive charac¬ 
terization of 5, to establish existence of a 
minimizcr for (()PI\). 

Thei)rem 7 Given (/ and V as ab<ivc and 
Assumption 3, the problem (OPl]) has a 
minimizcr A',, 

Proof. For each of the conditions (i), (ii) and 
(iii) of Theorem b define a subspace of all 
K ^ which satisfy the corresponding 

condition; for condition (i), and so on. Then 
.Vi - A',,) n ,V,„, n We will show^ that each of 
these subspaccs and hence A| is wraA•-closed, 
and the result follows. First note that S^,„) can be 
handled exactly as A, was in TTieorem 4, by 
constructing a sequence corresponding to each 
condition in Lemma 1. The only difference is 
that only A' will be required to interpolate 0 and 
V so that the sequences wall have the following 
form, where the partitioning is conformal with 
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our usual partition of K: 



!)■ 


The annihilator M ^ of (he linear span M of these 
sequences will be equal to and hence is 
»veaA:*<losed. 

Considering now 5,,,, and letting 7': = 
(-Nf, Dy] for notational convenience, define a 
bounded linear operator „ 

as follows, given K e : 

Then S,i, = .V(F), where ,^( ) denotes the null 
space. Now define a bounded linear operator G': 

as follows, given de 

r" 

» n, ■ n*, 

(Gd')i,(fc) = X 2 TUl-k)a„,(l) 

/-O m * I 

/ ~ 1.n. 

7 =^ I. n. 

k = (). 1_ 


Then F-G*. the adjoint of G', since, for all 


0 e f 


(I 

in. ) ■ n. 


and K ^ : 


, ] f.. 1 k i) 


1. i (I 


n, ri, n„ 


Z I V d„„(/) 

1 ; I / ,.»(! 

S i t„,u-k)k„(k] 

\ k n 

- {a, hK) 


Thus 5(,,= .V(G*) is K'ra/c*-closed by Rudin 
(1973, Thm 4.12). U is clear by a similar 
argument that .S(„, is also kta/c*- closed. Li 


In cases where only one of U and V has bad 
rank, say V, Assumption 3 is unchanged and wc 
partition V = {V Vi 2 \ where V has dimensions 
riy X riy and is invertible and K = [K Ky.]- Then 
U and V define a good rank sub-problem 
satisfying Assumption 2. and the conditions of 
Tlieorem 6 are modified; (i) disappears, (li) is 
unchanged, and (iii) becomes interpolates U 
and V*\ Finally, existence of a minimizer can 
still only be established for (OPT^). 


4 TRUNCATED PROBLEMS 
In this section, we consider the problem of 
computing minimizers for (OPT) when they are 
known to exist or otherwise at least computing 


%25 

approximate minimizers which are arbitrarily 
giKxJ (i.e whose distance from H can be made 
arbitrarily close to the intimal distance Wc 
will again amsidcr the gmKl rank and bad rank 
cases separatefv, but first we will discuss the 
characterization of (OPT) as an mtiniur liiu'ai 
program and define, given a problem (OPT), a 
class of related problems which we will call 
(runcaied prohiefus which are equivalent io finttr 
linear programs and which can Ik^ used in many 
cases to obtain exact or approxiiujitc minimizers 
for (OPl) Wc will characterize exactly when 
this approach can be applied. We will also note 
that the assumptions required on unit circle 
zeros of U and V in the last seciion can lu* 
dropjx'd when we consider the problem (OPT) 
directly 

Lmear proji^rants and irum aKd problems 

In the prcvuHis section, we characterized the 
feasible set Vj of (()PI\) tor the giKnl rank ease 
in Lemma i and I heorem 3 and for the bad rank 
case m rheorem i\ The following modilicd 
versions of these results characlcri/c flu feasible 
set \ of (OPT) and do not require the 
Assumptions 2 or 3 Ihe notation is as 
established in the Iasi scciion lor then respective 
cases and the proofs are omiiied as they arc 
easily obtained by modifying Ihc |>mh>Is of Ihe 
corresponding results 

Lvmrfui 3 (i'nmd rank) (iivcn K e JtA, there 
exists t ./L4 satisfying K “ d and luily if 

for all Zyf: J) s , / ( {I, . , n ] and / c 

(1, . , /!,,) we have: 

(a,Kli,y^^(z,)-(), 

k , o,+ ihUu) 1 

Theorem K [Hood rank) (iiven Kf there 
exists Q <F ,T^A satisfying K * T’QV if and only if 
K intcrfxilaies U and L 

Theorem 9 [Had rank) (riven Kt J'?/L (here 
exists Q r JkA satisfying K ■ UQV if and only if 
conditions (i). (ii) and (in) of rheorem b arc 
satisfied 

Recalling that the closed loop transfer 
function <1^ ~// K (so that K H and 

using the definition of the /I-norm, (OPT) can 
be written: 

mf max X X 

It f I 1A Ml 

subject to; 

// <l> c .V 

In both the giMHl and bad rank eases, the 
requirement // - <1* f .S can be interpreted as a 
set of linear equality constraints on as follows 
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In the g(K>d rank case, we can use Lemma 3 
above and define a set of sequences 
corresponding to each condition as we did in the 
proof of Tlicorcni 4 Tlien we sec that H - e S 
if and only if for each such sequence: 

/'o- 

This clearly defines a finite sei of linear equality 
constraints on 4>. llie condition of f'heorem 8 
that K interpolate U and V can be similarly 
interpreted to yield a smaller but equivalent set 
of constraints (i.e. the conditions of Lemma 3 
contain linear dependencies not present in the 
conditions of Definition 2 for interpolation). 

In the bad rank case, condition (iii) defines a 
similar finite set of linear equality constraints on 
4I> (cf. proof of rheorem 7). (x)ndilion (i) is 
clearly satisfied if and only if; 

A =0, I. 2_ 

which again defines a set of linear equality 

constraints on but in this case an infinite 
number. Condition (ii) defines a similar infinite 
set of constraints 

With these observations and the use of a 
standard linear programming technique for 
handling the objective function (see, eg. 
C’hvittal, 1^83) we see that (OPl ) is equivalent 
to the following linear program in the impulse 
rcsfKinsc coefficients of the cUvsed loop 

system and the auxiliary variables 

and A: 

(Ln mfA 

subject to; 

(*:) * 1 % {k ) ^„{k ) (=1 . n, 

^;(k)A„(k)-'{) /-I.«„ 

A = 0, 1_ 

S t i<i>,;(*) + ‘i>,v(^)i' A /-I. 

y,. I 

ll - 0) e A 

Because {LP) has an infinite number of 
variables and (at least in the had rank case) 
constraints, it cannot he solved directly using 
general linear programming techniques. Instead 
of (OPT), then, we study the following family of 
related finite dimensional problems which we 
call truncated problems, and which are indexed 
by the non-negative integer b 

(OP7,): min |1// 

where : - {K S:H - K is a polynomial of 
degreeWith this restriction on the degree 
of {OPTf^) is equivalent to the 


following linear program; 

(LPf,): min A 

subject to: 

<l>;(A)-*,;rA) = 4>,,(A) < = i. n, 

«i>,;(A). 4 ),;(A)=-o /=i.n. 

A = 0. d 

S i (A)+ <*».;(*))'-A ,= 1. 

/ 1 A - M 

H - 

For any b, (IJ\) has a finite number of variables 
and, in the good rank case, a finite number of 
constraints. In the bad rank case there remain in 
general an infinite number of constraints but we 
will see that in all cases of interesi these are 
equivalent to a finite set so that each (TTa) that 
wc wish to solve is a finite linear program. 

Of course, the problem (OP/'O always has a 
bounded objective function but ihe set may 
be empty for a given problem (OP'f ) and a 
given b. In this case p,s is not defined. In order 
to address this problem, wc stale the following 
condition. 

(ondition 2 There exists b* such that \s. is 
non-empty or, equivalently, such that (OPT) has 
a feasible ptiiril for which ~ // K is a 
polynomial of degree cV. 

If (and only if) this condition is satisfied wc 
can define a monolonicallv increasing integer 
sequence n for which, In taking ^^(O) * 

(V. the corresponding sequence of problems 
(OPI\^,y) will have well defined inlimal norms 
The sequence will clearly be 

monoionically non-increasing and. moreover, 
the following theorem will establish that; 

lim p,,^,, - 

Theorem 9. (iiven C ondition 2, can be 

made arbitrarily small by taking b sufficiently 
large 

Proff/. (liven C ondition 2. there exists AC,v ^ 
and wc can write for any K c S: 

\\H- K\\,^\\{H-~ - K\\, 

-||cI),.^-(Av'- /v,.)|Li 

where is a |>olynomial of degreer*)*. 

Moreover, K c S is and only if {K - AC-y.) e S so 

that: 

inf ||A/ - A:||., = inf 

Thus there is a K'~ UQ'V for which “ 
^ li*^ approximates arbitrarily closely Alst), 
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the set of polynomials is dense in dftA and U and 
V arc in A so that AC' can be approximated 
arbitrarily closely by approximating Q' 
sufficiently closely with a polynomial Q^,. Finally, 
since U and V can be taken to be polynomial 
(Dahleh and Pearson, 1987), we have that 
UQ^V is a ptMynomial whose norm 
is arbitrarily close to Thus by taking d to be 
the degree of we have the result, G 

With this theorem we know that whenever 
Condition 2 is satisfied, a prtKcdure for finding 
arbitrarily gmid approximate minimi/crs is to 
simply formulate and solve a sequence of 
problems (LP^) for increasingly large (V If we 
choose d tcK) small, the problem will be 
infeasible and must be increased but the 
existence of d* ensures that a feasible problem 
will eventually be obtained in this way In the 
following we examine conditions under which 
Condition 2 is satisfied and summari/e the 
application of this solution procedure m the 
good rank and bad rank cases separately 


7he j^ood rank ease 

If Assumption 2 is satisfied (no unii circle 
zeros of U or V^), (Ondilion 2 is clearly satisfied 
since by rheorem 5 we can lake (V lo he the 
degree of // where A',, is a mmimi/er Un 
{OPT) The following lemma establishes that 
even when Assumption 2 Is not satisfied. 
Condition 2 still is, 

Lemma 4. Ciiven U and V' wiih good rank, there 
exists d* such rhal is non-empty 


programs a>rrcsponding to an mertasing se¬ 
quence of ds. It is possible lo estimate rV in 
order lo aid in formulating this sequentT, but in 
practice simply mcreasing A until a feasible 
program is obtained is usually satisfactory By 
ITieorem 9, the correstHmding converge lo 
from above At present, we have no mcthiHi 
which allows A lo bt' selected a pnon such that 
^ is less than a given f When no unit 
circle K’ros are present, however, the exact 
minimizer corresponds to a polynomial and 
hence can be found by Siilving ilJ\) for a 
suiiably chosen A Fhis A may be estimated using 
a generalization of the lK>und given m Dahleh 
and Pearson (1987) but again, in practice, simply 
incTcaMng A until the degree of the minimi/ing <l> 
slops increasing is usually saiisfactiuy. 

The had rank ease 

Wc have seen in the good rank case that 
Condition 2 always holds. I’his is not so in the 
bad rank case Ihe lollowmg theorem charac- 
teri/cs (or bad nink problems exactly when il is 
satisfied (Here // is parliiioned as A was in 
rheorem h ) 


iheorem 10 (iiven // and V' with bad rank, 
( ondilion 2 is satislicd il and only if the iiansler 
matrices 7) n and /,/i defined 


Tru-i 



11-. 


i n 

arc both polynomials, 




-V. 

/>V 


Proof. Recalling the Smith- McMillan form 
decompositions (3.1) of U and V'. consider the 
related problem {OPl') defined by //';- 
ir - MrRt . and V ^ fhen 

Tf - Ry ~ I and the condition of Lemma ^ 
becomes, for each ^ v )- » r 

{1, . . . . fi,}. and / t: {1, . . . . ; 

(A ')*"'(Zo) I) A: ^ 0. . . . n, (rj (U (zO 1- 

For each i and j let be a scalar polynomial 

such that A',: ~satisfies the above for 
each z,, (such a polynomial always exists) llicn 
there exists a Q' e d^A such lhai <t>' » //' - 
U'Q'V‘ and hence A ^ is a feasible point 

of {OPT) for which - 77 - A - Rv ts a 
polynomial. Let A* be the degree of Tlien 

□ 

Recall that {L7\) is a finite linear program for 
any A in the good rank case. Then the situation 
is as follows. By Lemma 4. it is always possible 
to formulate a sequence of feasible finite linear 


/Voo/ ( ~> ) If ( ondiUon 2 is satisfied. {07*T) 
has a feasible point A lor which 4> ' H A is a 
polynomial A must satisfy conditions (i) and (ii) 
of Theorem b and hence the condition of 
Remark 1 .Since the matrices | Ny T), \ and 
I - Nl Diy arc polynomial, so are 7] ff and //a 
(). Recall that the matrices | /V, D, ] and 
| ->V' />')' arc left (right) [xilynomial eoprime 
faclonzalums of (IJI '{V V.) There exist 
associated right (left) polynomial coprime 
factorizations ITU ‘ - N, J)t^^ (L Dy'Ny) 

and the following He/out identities can be 
constructed: 

/ Ki/fh \ ^ 

'~/V, 7)f>nNrr XfJ 

/ />V ^\ \/Xy Ny . 

'v. Xyly-Yy l)y I 


where all the blocks are polynomial Define 
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and note that Bi' and By' arc both polynomial. 
Now consider a problem (OPT') defined by 
taking H' B„HBy, W = B„U. and V - VBy. 
Then It is straightforward to show that U' and 
y have the following forms; 

V ('') V-ti" 0 , 

where O' and V' are square and full rank. AIho, 
parlitioning as usual, the following blt)cks of H': 

are polynomials since Zi/// and 7^,^ are. 

Now fr, Cr. and V' define a gcwid rank 
problem which, by Lemma 4, has a feasible 
point for which - //' - K' is polynomial and 
hence there exists (J e JHA such that -//' 
~ il'QV'. I’hcn clearly: 


is a feasible point (OPI ') for which c|>'~- 
//' K' is given by: 




and is hence polynomial, f inally, then, K - 
- UQV\s.y feasible point of (0/"7) for 
which <I> “ H UQV - fl,'^'Wv ' is polynomial. 

[,1 

Now suppose that {OTl) satisfies the 
condition of the theorem and hence Condition 2 
is satisfied Then for (*) r (V ihe constraint 
equations of (/./’J ct)rres|X)nding to condition 
(i) of Theorem fi arc equivalent lo the following 
finite set, where A, degree (\ -N, /)/ |): 

[|.) - 

k .(V 


and similarly for condition (ii). The set of 
constraint equations corresponding to condition 
(iii) is also finite so that {Ll\) is a finite linear 
program for each d ? d*. 

Ihe situation in the bad rank case is then as 
follows. Recalling the results of Section 3, we 
have only established the existence of a 
minimizing K for (On\) in the bad rank case, 
not for (OPT), In particular, there need not 
exist a minimizing K for (OPT) for which the 
corresponding ^ is a polynomial Hence. (OPT) 
cannot in general be solved exactly by the 
solution of (IJ\0 for any finite iV However, 
when the conditions of I'hcorcm U) are satisfied, 
it is possible lo formulate a sequence of feasible 
finite linear programs corrcspimding to an 
increasing sequence of ('^s It is possible, as in the 
good rank case, to estimate d* to aid in the 


formulation of this sequence if desired. As 
Theorem 9 shows, the solution of such a 
sequence of problems yields a corresponding 
sequence of which converge from above lo 
Again as in the grKxJ rank case, we have no 
method which allows d lo be selected a priori 
such that l/i, ^,^1 is less than a given e. 

. f'inally, we remark on the case when only U or 
V say V, has bad rank and recall that in this case 
we partition V - \V V^l\ The conditions in 
Theorem 10 then reduce lo requiring the matrix: 

IJl 

to be polynomial and, provided it is, the 
preceding discussion applies to the approximate 
solution of such problems as well. 

S CONSI RAINI I) PROni PMS 

Given any standard problem [say (OPT) 
defined by //, LI, and V'j. two index sets and 

.7' which partition (1.n.} and which have 

n, and n, dements, respectively, where n, 
and a set of positive real numbers {d,^ . we 
can define an associated coristraineJ O oplimiza- 
lion problem In this section we observe lhal the 
compulation of approximate minimizers for 
almost all such problems which have a 
non-empfy feasible set and for which (OPT) 
satisfies C ondition 2 can be handled using a very 
minor modification of the method given in the 
last section for solving {OPT) itself. That is, 
arbitrarily good approximate minimi/ers can be 
found bv solving a sequence of finite linear 
programs 

lo state the constrained problem associated 
with (OPT) assume without loss of generality 

that .7, - {I.fi, } and = (ri. 4 I, . , n ,) 

and define a weighting matrix W, : = 
diag((i7, / 1 Also define the following 
partitions: 



where //, has ri, rows, //, has n, rows, and so on. 
ITien the constrained problem is: 

(OPTO mf ||7/. ~7.ll, 

A V, 

where .Sr . - (K e :3Q e JIA satisfying K = 
UQV and - A., )||, ^ 1}. This problem 

corresponds to minimizing the maximum f"- 
norm of a set of regulated outputs indexed by 
subject to the constraint that the Z*-norms of the 
consiramed outputs indexed by .f, are bounded 
by the corresponding d,. 

Whereas the feasible set S of (OPT) is always 
non-empty (since always O^S) need not be 
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and hence may not be well defined. We can 
describe when *SV is non-empty in terms of the 
infima] norm fUf of an asstxiatcd standard 
problem defined by : = VV H ,, and 

VV = ^ Clearly ^SV ^0 if and only if 1. In 
order to apply the approach of the last section to 
computing approximate solutions lu feasible 

problems (OPTC), we define truncated con¬ 
strained problems exactly as we did for 

unconstrained: 

(OPTC,). inf , 

X # •'s 

where {K € S( . H - K is polynomial of 

degree d}. 

If (OPT) satisfies Condition 2 and also • 1, 
it can be shown using essentially the ideas of the 
proof of Theorem 9 that (OPfC ,0 has a feasible 
point for sufficiently large d and moreover that 
the sequence of infimal norms U( a for an 
increasing sequence of has as its limit 

Finally, wc observe that when (()PT(\^) has a 
feasible point it is equivalent to the hallowing 
finite linear program 

(LJ\): min A 

subject to: 

- <i>„(A) -- 4>„(A) I - I.n, 

4»,;(A).r'O / 1. 

A = (I. d 

V V 4- (h 11 »l - ) 1 f 1/ 

S E 1*,:(0 + 4)„(A)|': (/, ,f I 

H - f ,S„ 

where .Sa is the feasible set of (O/^/.v) 

It is interesting to note that while such 
constrained problems are known to be difficult 
when other norms such as the // -norm are 
considered (Ting and FViolla, J98H), they are 
handled extremely simply when using the 
v4-norm. In fact, the complexity of is no 

greater than that of the corresponding uncon¬ 
strained problem. 

t. C ONC I liSION 

In this paper, wc have extended the results of 
Dahich and Pearson (19K7, 1988) concerning 
existence of minimizers for ^'-optimal control 
problems to a broader class of plants and 
provided more direct proofs The only assump¬ 
tion required is to preclude open liKip poles or 
zeros on the unit circle. A class of truncated 


prt>blcms corrrsp^>nding to polynomial clos^cd 
IcHip transfer mainccs and which arc ei|iiivalcnt 
to finite linear programs is defined Necessary 
and sufficient cturdiiions arc given (or when a 
sequence ol such problems can be: solved to 
obtain either exact or approximate nunimizcrs. 
While wc have at present no method for 
determining m general the si/c of approximatiiin 
error introduced by this priKcdure, this problem 
has fx'en addressed in a spi'cial case in (Siaffuns, 
I9SH)) In that pajx*i\ the Ncalai mixed sensitivity 
problem studied in Dahleh and Pearson (198H) is 
ctmsidcied and a privcedurc is given for 

determining the approxnnaiion error as closely 
as desired In addition, a minimi/er tor which 
the cIo.vcd loop iransfer matrix is rational (i.e 
non-|X)lynomial) is found lor ihc same problem 
We have also observed that problems 
incor[x>raling norm coristrairiis on some outputs 
while regulating others can be Siilvcd at least 
approximate!) using only a sliglit modilicalii>n of 
Ihe method for solving uiuonstrained problems 
The simphcilv of constrained problems is a 
pro|X‘rly ol Ihc / ‘norm which sets il apart from 
the //*-norm and other norms fiequcnily used 
for control system design 
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Minimal Structure in the Block Decoupling 
Problem with Stability* 

C. COMMAULTt§. J. M. DIONt and J A TORR|;St| 

New feedback invariants permit characterization of the simplest block 
decoupled system achievable for a given linear system using linear 
stabilizing control laws. 

Key Woftb— Decoupling; lability, muliivunahlc amirol 'tystems. nanslri luncbon niuilyviv, algchi uc 
-s\fiiiem theory. 


AbftracI—In this paper wc consider the block dec\>upling 
problem with stability. We charactcrue the minimal 
McMillan degree achievable for the block decoupled sysiem 
For this, wc introduce a new list of integers which arc 
feedback invariant 'Dicse integers arc related in a simple 
way to the minimal numlx-r of unstable and mfiniie zeros ol 
the bliKk decoupled system 

I INTRODIKTION 

In Till recent years a great deal of interest has 
been devoted to the structural leatures of 
decoupling problems. Various lists of integers 
strongly related with the deep structure of the 
system have been introduced. These integers 
have been successfully used for characterizing 
both the existence of specific decoupling control 
laws and the simplest achievable structure for 
the decoupled system. 

In particular: 

In Descusse and Dion (1982), the classical 
static state feedback decoupling problem is 
revisited. The .solvability condition of Falb and 
Wolovich (1967) can be expressed as follows: the 
system infinite structure is given by the infinite 
structure of the transfer matrix rows. 

In Commault et al. (I9H6), the essential orders 
characterizing the minimal infinite structure of 
the decoupled system are presented for the 
general row by row decoupling problem. 

In Descusse e( al. (1988), structural conditions 
are given for the solvability of the row by row 
decoupling problem by static slate feedback 
(with possible singular input transformation) 
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In Dion and Commault (I9KK), the dynamic 
stale feedback decoupling problcni is coiv 
sidered. 'Die minimal inlinitc and unstable 
structure ol the decoupled system is 
charatlcn/cd 

In Haulus and lleyman (1983). necessary and 
suflIicTcnl cofuliiions lor solving bliKk decoupling 
problems with stability are given. In l>u>n e( aJ. 
(199(1), the minimal infinite structure of the 
block decoupled system is characlen/ed 

in this paper, we consider the bliK'k 
decoupling problem with stability We eharac* 
teri/e the minimal McMillan degree achievable 
for the block decoupled system mcorpvnaling 
stability requirements. I oi this wc introduce a 
new list of integers which are feedback invariiinl. 
Moreover we give the minimal infinite and 
unstable slriiciure of the fth block t)f the 
decoupled system. This structure is easily 
obtained by comparing the un.stablc and infinite 
slruciure of the original system transfer matrix 
(stabiii/ed il necessary by an adequate sialic 
slate feedback) and the one o( the transfer 
matrix obtained by removing the /Ih row block. 

The paper is organized as follows In Section 2 
the block decoupling problem with stability is 
formulated, and some notations and pre¬ 
liminaries are also given. Iwo useful technical 
results concerning Mermitc forms are staled 
Section 3 IS devoted to the study of a new list 
of integers which is invariani by stability 

preserving sialic stage feedback In Section 4 wc 
prove that the minimal McMillan degree 
achievable for the decoupled system with 
stability is v the sum of the ri, 

In Section 5 an illustrative example exhibits 
the main features ol the proposed approach 

2 PROBI r M FORMULATION AND 
PRr LIMINARII S 

Notafion 

R(.v) be the field of rational functions and 
R\s] the ring of polynomials A rational function 
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f{s)==^n(s)/dt\) is said lo be proper (rcsp. 
strictly proper) if deg (d(r)) deg (n( v)) (resp. 
deg (^(i)) > deg (/i(.v))) where deg (n(v )) denotes 
the polynomial degree of n(v) The function 
f(s) - n(s)/d(s} will be called a proper rational 
stable function if it is proper and if all the r(K)ts 
of d{s) are stable. The stability domain under 
consideration is any region in the complex plane 
symctrically located with resj^ect to the real axis 
and including at least one point of the real axis 

Denote by R^,(,v) the ring of proper rational 
functions and the set of proper rational 

p y m transfer matrices. The units (invertible 
elements) of the ring R"’"'*'( v) are called bicausal 
matrices and are characterized by the property 
that //(.v) is a bicausal matrix if and only if 

det (lim W(.v) j / 0 

I'he set of proper rational stable functions, 
denoted R^^fO. i?' itn huclidean domain with 
degree function y(/(.v)) ^ y,(/(.v)) f y.f/Ty)). 
where yi(/(.s)) is the infinite zero order of /(v) 
and y>(/(.v)) is the number of unslahle zeros of 
f(x) counted with their multiplicity (Hung and 
Anderson, ( allicr and Desoer, I^^H2). 

1’he set of p x m matrices with entries in 
R,„(.v) will be denoted by H'l,Ihe units of 
R,m^''Tv) arc called bicausal bistable matrices 
and are characterized by the property that /ri v) 
is bicausal-bistabic if and only if det is a 
unit of R,m(v). 

Problem formulation 

Introduce now the block decoupling problem 
with stability. 

We will consider now the slable block 
decoupling problem. In order (o avoid trivialities 
we will require the compensated system to be 
just as ‘‘output controllable ’ as the origin system is. 

We will say that the proper precompensator 
(’(.v) is admixsihlv if 

rank r(.v)(’(.v) - rank 7 ( v). 

This admissibility condition is equivalent to the 
preservation of the f ' controlled output 
trajectories (see Brocken and Mesarovic, l%5). 

Let 7 (*v) be a p x m proper rational matrix, 
partitioned in row-blocks relatively lo a given list 
of positive integers (pi,, .pj. such that 

k 

E Pf - pf Ihc following way; 

Us) 

ns) 

wiih 7;(,v)e R{: ''*'(.v)ror/ - 1. k. 

The sysStem with transfer matrix T(s) is said to 


be block decoupled relatively to the partition 
{p,} if there exist positive integers mi. .... 

satisfying E m, =m, such that T{s) has the 

j«I 

block diagonal form: 

Tu(5‘) (I 


TkkU) J 

-diag(7,,(^). U(s)) 

with 7,(5) 6 R'y'"to for 1 = 1_ k. 

This means that each above defined input 
block influences only one output block. If one 
wants this influence to be effective the 7i,(5) 
must be non-null for each i, in this case the 
system is called nondegencrale. 

We will consider here the decoupling problem 
with stability, i.c the compensated decoupled 
system is stable and no internal pole zero 
cancellation occurs. 

In order to (block) decouple a given system 

X - /ix f nu u e R"' 

-r e: R". 

y=-"C’x yeR^' 

T{s) == C {si ~ A) 

we will use a combined compensator of ihe form; 
u ~ Fx 4 C'(.v)p 

where x is the stale of a minimal realization of 
(I). f eR""", and Cl.v) is a proper slable 
precomfUMisalor not necessarily square. 

this is a quite general form of compensation. 
Both parts of the control law arc necessary 
because: 

— if one uses pure prccompensalion F - t) and if 
(S) is unstable, unstable pole zero cancella¬ 
tions will occur between ('(.s ) and 7 (,v). 

- Conditions for static or dynamic state 
feedback decoupling are very restrictive. 
(Dcscusse et al. 19H8; Dion and Commault, 
mH). 

On the other hand Hautus and Heymann 
(1983) proved that (21) is decouplable by 
precompensation if and only if: 

k 

rang 7 (.v) == ^ rang 7;(,r). 

I- \ 

Because of stability requirements C(5) will 
necessarily be slable. 

The stable bkKk decoupling problem can be 
formulated as follows: 

Lei 7'(.v) be a pxm proper rational matrix 
partitioned in row-blocks relatively lo 
(p,. . . . ,/?*) Is it possible to exhibit an 
admissible combined compensator such that the 
compensated system is block decoupled, non 
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degenerate, stable with no unstable pule zero 
cancellations? 

As shown in the following lemma, there is no 
loss of generality in assuming that the system is 
stable. 

Lemma 1. Consider the system 1 and the closed 
loop system 2 ^ where F is any slate feedback 
such that A 4 BF has stable eigenvalues. The 
above defined stable block decoupling problem 
is si:)lvablc by combined compensation if and 
only if stable block decoupling by pure 
precompensation is achievable on 2 ^. 

Proof. Sufficiency: clearly a pure precompensa¬ 
tion on 2 f IS a combined compensation on 2 . 

Necessity: Let u = FiJi 4 be a combined 

stabilizing block decoupling compensator on 2 
Then u - (F^ - F)xC {s)v is a combined 
stabilizing block decoupling compensator on 2 / 
which is equivalent to the pure block deciiuplmg 
precompensalor B,(s)C(s) where 

BAs) = [l ~ {F,- F){sl - A - BF) ^B\ ’ 
-[/■ff/'i-FKA/- /t-fl/i) '/f| 
acting on 2 / . 

/F(v) is then bicausal and bistable. Both ( (v) 
and (v) are stable fl,(A)( (.v) is therefore 

a stable block decoupling pure precompensator 
acting on 2 ^ . T 

In the sequel, we will then assume that the 
system under consideration is stable. We look 
for stable block decoupling pure precom¬ 
pensators. 

In this paper we tV>cus our attention on the 
simplest achievable decoupled systems with 
stability. More precisely we will give the minimal 
McMillan degree and the minimal inlinite and 
unstable structure achievable for (he decoupled 
system ensuring the stability ot the compensated 
system 

Prelirrunanes 

In what follows we use the symbtM 
to denote the McMillan degree of a iranster 
matrix r(y). By McMillan degree we mean the 
polynomial degrees sum of the denominators m 
the classical Smilh-McMillan form over R(a] of 
the transfer matrix 7(.v) (Kailath, I9M0) 

In the sequel, we will need Smith McMillan 
forms of proper rational transfer matrices over 
the Euclidean ring of proper stable rational 
functions R^,e(v). Let us introduce such fac¬ 
torizations, which were studied in VT^rghese 
(1978) and Vardulakis and Karcanias (1983). 

Defininon L Ixt r(.v) be a p x m rational matrix 
of rank r, a Smith-McMillan factorization of 
T{s) over Rp,(i ) is a factorization of the form: 
r(5)--=flo(v)A(A)fl,;,(5) 

where i^nd 8 , 2(0 bicaiisal- bistahlc 


matrices and 


A(.v) 


A(jr) 0 
0 (I 


where A(a ) ^ diag K 

with 

^tid J,(a) 




n,{^s) and d^s) are copnmc m R^,(.v) (i.c\ 

V'dA) have no a>mmon unstable zeros and n,(A ) 
or dAs) in bicausal) rdv), a>prime 

polynomials which have no stable rtxus and 
.T - v 4 a IS an arbitrary stable polyiumiial 
Eurihcrmore r,(A) divides tind 

divides V'A' ) I he integers f, (rcsp> /^) arc 
decrciLsingly (resp increasingly) ordered. 

Consider the rational iransfer matrix, the 
stability Ixung considered in the usual sense: 


1 

1 ■ 

A i 1 

1 

.V - 

1 

1 

A' ^ 5 

1 

yy-j 


it can be shown that it has two infinite zeros of 
orders ( 1 , 2 ). two unstable pides at a 3, 7 and 
one unstable zero at v ^ 1 . The Smith McMillan 
form of / (a ) ovei R,.,! ') is: 


A(V) ' 


1/.TT 

0 


0 

( a - 1 )/ji ’ 

(a 3)(,v ' 7)/;r' 


where d|(v) ^ I and ^.'(a) is bicausal 
which exhibits the above given unstable and 
infinite structure of / ( v ) 


Thrcfrem 1 1x1 / (v) be a p x ni rational matrix, 
riien there exist Smith McMillan factorizations 
of 7 (v) over R^.,(a) Moreover A(a ) is uniquely 
defined modulo - v 4 u. a stable polynomial, 
and IS called the Smilh- McMillan form of / (a ) 
over R^,.(s) Ihe unstable zeros (resp. jiolcs) ot 
7(a) arc the roots of f,(.v) (resp V^^')) ihc 
infinite zero (resp pole) orders of / (a ) are given 
by 7 ~ deg(r3.s)) (resp. t, dcg(V^(v))). 

Let d(7(v)) denote the sum of number of 
zeros at infinity plus number of unstable zeros 
plus number of poles at infinity plus number of 
unstable poles, multiplicities included; 

d{ns))^y(f. + t,). ( 2 , 1 ) 


For a proper stable rational matrix, which has 
no unstable and inhniie poles (v^i(a )*=1 and 

0. for / - 1, . . A:) d(7(A)) - f. In this 

»I 

case the Smith McMillan factorization of 7‘(a) 
over R^„(v) coincides with the usual Smith 
factorization over the ring of proper stable 
rational functions. 
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Recall now the Hcrmitc form over the 

ring of proper rational stable functions 

Theorem 2 (Morse, 1975) l,et T{x) be a r x m 
proper rational stable matrix of rank r. T(s) can 
be factorized in T(s) -^ H(x)B(s), where H{s)e 
and B{s) is a bicausal-bistable matrix 
(unit of R;;'''"(.v)) and H{x)^\H(x)(S\, with 
H{x)eW;As). 

tijn” 


hjn’'} 

where n = v f a is an arbitrary stable polynomial 
of degree one and 



n,f<n, with n, positive integers and y,, 
polynomials, possessing no stable zeros, H{s) 
is called a liermite form of 7 (,v) over 

His) is nonunique, and is defined up to units 
of R,„(.s) Uniqueness of //(.y) may be obtained 
by adding some conditions (Morse, 1975). 

Wc will give now two technical lemmas 
concerning the flcrmile forms over R,„(U 

Since li{s) is a bicausaUbistable matrix, the 
infinite and unstable zeros of //(a) are those of 
/’(a). Let nr* denote the maximal infinite zero 
order of H{s) and let q be the number of 
different finite unstable zeros z,. . . . 2 ,, of //(.y) 

and denote by o, the maximal order of the finite 

zero 2 ,, Define n : a, f o ., we have; 

Lemma 2. Let 7 (a) be a r x m proper rational 
stable matrix of rank r and //(a) be a Hcrmitc 
form of 7(a) over R,.,(y) With the above 
notations the McMillan degree of each entry of 
H(s) is less than or equal to n. 

Proof. Note that the zero orders of //(a) are the 
same as those of //(v) and the pole orders of 
H '(a) are the same as the zero orders of //(.v). 

The maximal p<ilc order of a rational matrix al 
any given pt>inl Is an upper bound for the 
maximal pole orders of all entries at the same 
point. Then n is an upper bound for the infinite 
plus unstable zero orders of A/ '(a) and in 
particular n is an upper bound for the infinite 
plus unstable zero orders of the diagonal 
elements of 7/(a), i.e. n, rsn. 

Therefore the McMillan degree n^, of h,f{s) is 
lower than or equal to n. due to the known 
Hcrmitc form profKrty n,. V 

Lemma 3. Let /’(a) be a r x m proper rational 
stable matrix of rank r. Factorize T{s) as 
follows: T{s)- H(s)B(s), where /7(a)- 

[/7(a) 0) is a Hermite form of 7 (a) over 
as in 'Fheorem 2. With the previous notations we 


have the following: 

d(Tix)) = d(H(s))=i,n.. 

,..u I 

Proof. First, observe that the infinite and 
unstable zero structure of 7 (a ) is equal to that of 
77(a), since fl(A) is a bicausal-bistable matrix. 

d(7'(A))=:d(/7(A))-J(/7 (a)). (2.2) 

Let 

7’(j)= fi,(i)|A(.v) Olfljli), 

A(j) = diag (f,(j)/;r^i. 

be a Smith-McMillan form over R^m('), t'^f y) has 
no common factors with (/, y ~ 1, , . . , r), 
then: 

d(H(s)) ~ rf(det A(a)). 

There exists a Smith-McMillan factorization 
of /7 (a) over R,m(a). /7(v) - 7^;(a) A fy l/L^lA), 
with A'(.f) = A(a). such that; 

det //(a) h,(A) del (A(a ))/).(') 

with />i(A). b;(s) bicausal-bistable rational 

functions, which implies that: 

d(del //(.y)) - J(det A(a)| 
the last expression allows us to write: 

^(/7(y)) - c7(del //(v)) 

and from the particular structure of /7(v) the 
result follows. 


.V Ft’I DHAt K INVARIAMS 
In this section wc will consider a p x m siriclly 
proper rational transfer matrix 7(a) of rank r, 
partitioned in row-blocks relatively to a given list 
of positive integers (p,.p^), such that 

k 

E Pi in the following way: 

I ' 1 


7'(.v) 




with 7;(a) e R{y'(A ) for / - 1 . k. 

Let 7 '(a) denote the matrix obtained from 
7(a) by removing its ith row-block, i c. 

7;(.v) 


7'(0 


7 ; ,(.v) 
TI 


LU) 

In what follows the following lemma (Dion et 
aL I WO) will be useful. 

Lemma 4. Let 7(a) be a p x m proper rational 
matrix partitioned in row-bIcKks relatively to 

A 

(pi. - . ^ - Pa), such that P, — P Let r, denote 

I - 1 

the rank of 7^(a). for / = I. k. 
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If 7 ( 5 ) is such that: 

4 

rank T(s) = r, 

I-1 

then 7(5) can be decomposed as: 

r(5) = (/(j)/f(j) 

where T{s) is a rxm full row rank proper 
rational matrix partitioned in row-blocks rela¬ 
tively to {r,>, t/(f) = diag(t;,(j). LU(s)), 

U,(s) is a Pi^Pi unimodular matrix and 

/ = diag(/,. 4). A = [q]; 4, i-s the r,xr, 

identity matrix. 

We wilJ dehne now a new list of integers n, 

/ = 1. k, and show that these integers arc 

feedback invariant. These invariants generalize 
the block deraupling invariants introduced in 
Dion et ai (1990), when intrcxiucing stability 
requirements. 

Definition 2. Let 7(5) be a p x m strictly proper 
stable rational matrix decomposed as in Lx-mma 
4 according to the output partition (Pw . . p*), 
i.c. 7 ( 5 )- lJ{s)lf{s) and let 7(.s) be factorized 
as: 

7(5) = [A?(5) 0lfl,(5) 

where R(s) is a r x r proper rational nonsirigular 
matrix and B,{s) is a bicausal-bistable matrix 
Consider '(.v) partitioned as follows: 

/? '(5) = |/?,(5), R,{s)^W^Xk). 

We v/ill define the stable block decoupling 
invariants, denoted n, ^,, of 7(.y) as the total 
number of infinite and unstable poles of W,(5) 
counted with their multiplicity. Since ^( 5 ) 
pos.sess no infinite and unstable zeros, one has: 

n, - d(R,is)) for / = 1. k 

k 

and we call v = J] n, the stable block 

decoupling degree of T{s). 

From the above definition v and n, are 
invariant under stability preserving static state 
feedback on a minimal realization of 7 (a). This 
comes from the fact that 7(a) being stable, such 
feedbacks are equivalent to bicausal-bisfablc 
precompcnsalors. 

We will prove later that the n, arc 
independent of the chosen factorization. 

The following lemma will be used later to 
provide us with a nice characterization of n^ ^,. 

l^mma 5. Let G(a) be a r x r full rank strictly 
proper stable rational matrix, partitioned in 
row-blocks relatively to (r|, . r*). Partition 

G“*(5), the inverse matrix of G(.i), in 
column-blocks relatively to (r,,,..,r*). Let 
G,(5) denote the fth column-block of G ’( 5 ), 
then: 

d(C,(5)) = 4 /(G(a)) - d(G'(A)) for ( = 1_ k 


where G‘(5) denotes the matrix obtained from 
C(5) by removing the ith row-bkKk. 

The lemma can be proved follow^tng cU>sely 
the proof of Ixmma 2 given in Dion et at. 
(1990). For this, II^(a) will he replaced by 
R^(5), i/*(.) will be replaced by d(.). Mumtu 
mutandis ihc result follows, using Ixmma 3 of 
the present paper, 

Iheorem 3. Let 7(a) be a p x m strictly proper 
stable rational matrix decomposed in row-bUKks 

A 

relatively to (p,. . . .p*), such that S p< ^ p- 

Ixi - where r« rank 7(a) and r, 

rank 7(0 f ct 7'*(a) be the matrix obtained from 
7(a) by removing the /th row-block, llien the 
stable hliK'k decoupling invariants of /'(a) 
satisfy: 

n,.,- d(T(s)) - diTis))^ 0(7(5)) 

lor / I. k 

where a( /i(.v)) denotes the sum of the degrees of 
a minimal [xilynomial basis for the left kernel of 
7(5) 

Proof Begin by decomposing 7'(a) as in Ixmmu 
4: 

ns) - V{s)it{s) (3.1) 

and denote 7(a) - |7?(a) 0 )W,(v) a Hermite 
factorization of f{s) over R,,,(a), where 7#,(a) is 
a bicausal- bistable matrix So. by definition: 

„ = t/(/j,(.v)) Ion = 1. ... 4 
where R,ls) denotes the ilh column block of 
R ^(a) 

From Ixmma !>: 

fi,,/-d(W(.v))- d(/7(v)) fori - 1- k 

by definition of d{Rls)) (sec expression 2 1) and 
since 77, (a) is a hicausal bistable matrix we have: 

n, ,r-diUs))- diPis)) Ion - 1. k. 

(3.2) 

In the next part, we prove that d(i(s))^ 
(/(7(a)) 4 (i(7(a)), which will be also true for 
7'(a). i.c. (/(r(A))-(/(7'(v)) 4 o(7'(a)). In this 
way, by Ihc row-block independence hypothesis 
(rank 7 (. 1 ) = J]r,) we will have o( 7(a)) - 
a(7(5)) == 0(7(5)), which proves the theorem. 

For this, observe that the right null space of 
7(a), denoted Ker 7(a), is equal to Ker 7(a ). In 
fact, Kcl 7(.v), is a sufispacc of Ker 7(.v) and 
dim (Ker 7(a)) - dim (Ker 7(v)) - m - r. 

Denote 0/?(7(a)) the sum of the degrees of a 
minimal polynomial basis for Ker 7(5), so wc 
have: 

a«(7(.v))-a«(t(.,)) (3.3) 

which is also true for 7'(.v), i.c. Of,(T'(s)) 
a„(f(s)). 

Now, dchne Z(7(.v)) as the number of finiie 
.stable zeros of 7(.r) counted with iheir 
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multiplicity. Since U(s) of (3.1) is unimodular, 
we can write; 

Z(7Xv))-Z(ni)). (3,4) 

Moreover, we have that the McMillan degree 
of f(x) is equal to the McMillan degree of /'(j), 
which allows us to write: 
a(r(s}) f dlT(s)) ^ /(r(.v)) ^ aAT(s)) 

- d(f(s)) + Z(f(v)) + a^Chs)) 
and from (3 3) and (3.4), we obtain; 

(;(T(.v))f ri(7(.v))- c/(nv)) 
and similarly: f;( /’'(.v)) + - d(V{s)). 

'Ihis combined with (3 2) lead us to: 
n, „ (i(7 ('v)) - d{'r(s)) 4 r/(7 (.s)) - o(7^(.v)) 

which ends the proof, since (j(T(.v))~ 
oiVis)) - o(7;(.v)), as noted above V 

Remark From this theorem it is clear that the 
do not depend on the chosen factorization in 
Definition 2. 

4 nil MINIMAI. Hl,0( K Dl (OUPl.INti PKOHliiM 
WMM si ahiih y 

In this section we look for the minimal 
McMillan degree achievable for decoupled 
system ensuring the stability of the compensated 
system. We will show that the stable block 
decoupling invariants defined in the 

previous section, represent such a minimal 

degree for the ith diagonal block of the 
decoupled system 

As shown in Lemma I, there is no loss of 
generality in assuming that the system is stable. 

Let us give a lower bound lor the McMillan 
degree of the decoupled system. 

I.emma 6. I.el / (v) be a p x n\ proper stable 
rational matrix of rank r, partitioned in 
row-blocks relatively to {p\, ,pk) and let 
r(\) be a rn x r proper stable admissible 
preciunpcnsator which block deciniples 7(v) 

with stability relatively to (p,, . , ) Fhe 

McMillan degree of the ith block of the 
comjHmsated system greater than or 

equal to n, , where 7'(.v)( ( v) = diag 
(/>,(v)./),(v)) 

The proof follows closely the priH)f for the 
case without stability requiremenls (see Dion et 
al (IWO). It was given by contradiction, 
assuming that there exists a block decoupling 
precompensator such that the McMillan degree 
of 7),(x) is lower than n, ^,, which leads to a 
nonproper or nonstabic precomprmsuitor. 

We are now ready to give the main result of 
this section: 

Theortm 4. Let 7 (5) bt' a p x rn proper stable 
rational matrix of rank r. partitioned in 
row-blocks relatively to (p,. . , p*). such that 


Ep, the system 7(5) can be block 

t 1 

decoupled relatively to (pi,. ,p*) by an 

admissible proper precompensator with stability, 
then the minimal McMillan degree achievable 
for the block decoupled system is v, the stable 
bl(Kk decoupling degree of 7 ( 5 ). In this case the 
ith diagonal block of Che decoupled system has 
McMillan degree n, 

When particularized to the row by row 
decoupling problem of surjective systems this 
result is given in Dion and Commault (19H8). 

Proof. By Ixmma 6 the minimal McMillan 
degree achievable for the decoupled system is 
greater than or equal to v. We will construct a 
blcKk decoupling stable precompensator and 
then wc will show that each bliKk of the 
decoupled system has McMillan degree n, 

First, decomjX)se 7(5) as in I.emma 4: 

7(5)- (y(v)/7(v) 

and consider a factorization of 7(5) over R;„(5) 
of the form: 

7(5)-|«(v) ()|/y,(5) 

where W,(5) is a bicausal bistable matrix and 
R(\) is a full rank proper stable rational matrix. 
A possible solution is to consider a Hermile 
form of I'{\) over R,,,(.v). 

Now denote R,{.\} the Mh column-block of 
R '(5) Define /),. the maximal infinite pole 
order of W,(.v) l et {/, denote the number of 
different unstable poles u,,. ... of /^,(5) and 
denote the maximal order of the pole for 

/-I. q, and / ~ 1. k Define the 

integers g, as follows: 

ki 1^,- ^ X li; I = L , A: 

; I 

and also deline 

(;,(,v): K,(,v) for ( = 1. . . A' (4.1) 

;r^- 

w'ilh /;,(5) - fl ( v “ u,/)'* for / - 1. ... A: and 

r I 

71 - V 4^ a is a stable monomial (/,(5) is a proper 
stable rational matrix 

Consider now a Hermite form [/./(.v) 0| of 
(jjis) over R,,,(v), where 7 denotes transposi¬ 
tion, one has; 

f;,(.v) = fl,(,v) for( = l. k (4.2) 

where fl,(5) is a bicairsal-bistable matrix and 
7 ,( 5 ) is a full rank proper stable rational matrix. 

We are now able to give the following stable 
compensator: 


(4,3) 
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where K(j) = /? '(j)diag(D,(i). IMs)) 

for/ = I. k 

;r*' 

and X(s) is any (m - r) x r proper stable 
rational matrix. Note that Kir) can be written as 
follows: 

= .n(^)); 

using (4.1), (4.2) one has. 

y;(,r) = (;.(.r)/.. '(.') = A(.v) 

then C(a ) is a proper stable compensator 

Recall ihat and p„ denote the maximal 
orders of the infinite and unstable poles of 
From (4,1) and using a Smith McMillan 
factorization of K,(a) over R^,(v) it follows that 
the maximal orders of the infinite (resp 
unstable) zeros of (i,(ji ) arc lower than or equal 
to (resp. /]„). 

/.,(i) is a Hermiic form; using Lemma 2 it 
follows that each entry of L,{\) has a 
denominator degree Umcr than or equal to g, It 
follow's that: 

D, \s)=^Us) . 

Then /) '(v) has no stable poles, so | has 
no stable zeros The McMillan degree 
of the nonsingular matrix />,(a) is then equal lo 
J(/),(a)) the sum of the infinite and unstable 
zeros counted with their multiplicity: 

From the definition 2 1 

(Hl)As))=^iHl), '(.v)) 

I'sing (4 1), (4.2) and the delimlion of we 
gel: 

ii(D, )) ^ di I.As) ) = iHPAs)) ■- n,,, 
pAs}' 

Therefore 

diag (/),(A) /.)| ( s)) - V 

Recall that 

7(.v)r(A)- FTv)/diag(/),(s). /)*(A)). 

Since ty(A) is unimodular and due to the 
particular structure of / we finally gel: 


dw(T(v)CXv))- V 

.S AN 11 I U.SIHATIVI I XAMPl t 


Consider the system: 



1 

0 

1 

(1 


(.V + 1)’ 


(< + 1) 

r(s) = 

0 

1 

1 

(1 - . 



(V + 1 )■ 

(V + 1)" 


1 

1 

(.»-!) .»+: 


A + 1 

A 4 1 

(a+1)' (.s+1)\. 

Let us 

factorize 

T(s) 

as fdllows: 7(sf 


( 7 f(j) 0 ]£f,(r) with; 




1 

0 


0 

I 

{X ^ 1 )* 


0 

(I 


and 

R As) 


1 1 A 1 

S ^ I 5 4 I (S 4 I)' 

(Ail)' 0 0 

0 (.V4l)- 0 

(3 4 1)^ -(A 41)" is ^ 

.V - I A I A I 


The system 7(-v) is not row by row 
decouplable by dynamic stale feedback» since 
m “ 4 • 2p - k 6 I, where k is the column 
rank at infinity of K *(.0 (Dion and Commaiili, 
19KK) Flowevcr. it is block decouplable by 
dynamic slate feedback with the output partition 
(2. I L since m 4 2r - k*, with m 4 (number of 
inputs), r - rank T(s) ^ 3 and the integer k* 2 
(the dimension of the maximal space spanned by 
the column blocks of R '(a) when a goes to 
infimiy) defined in C'omrnault et at (I Wl), 

Write R ‘(v) - |Wi(v). W*(')). according to the 
pariiiion (2. I) Ihe matrix /if|(A) has two infinite 
poles or orders (2.3) and one unstable pole at 
A ~ 1 Matrix RAs) bus one infinite (k>Ic of order 
2, and one unstable p<»le at .v-^ 1. So by 
definition the stable hli>ck decoupling invariants 
arc /I, “■ (} and n> 3, giving a stable bl(K'k 

decoupling degree v - M 
Since /(a ) is proper and stable, in this case 
r/(7(A)) IS the sum of the infinite and unstable 
zero orders of 7 (a), counted with their 
multiplicity /(a) has three infinite zeros of 
orders (1,2.3) and one unstable zero at i « I 
Ihe matrix /',(' ) has two infinite zeros of orders 
(2.2) and the matrix 7>(a) has tine infinite zero 
of order 1 In this example fi( /,(v)) o( 7>(a )) ^ 
0, then we have: 

n, r, - d( I (a )) - ri( /;>(a )) 7 - I 
r, ^ c/( / (x))" (7(7,(v)) " 7 4 


as stated in 'nieorem 3 

We will illustrate nt»w the conqHmsalor 
construction given in the prtKif of Theorem 4. 
For this consider ('7)(v ) ^ ((v - l )/(v 4 I)")/^,(a), 
as in (4 1). ( (insider now a left Mermitc form 
over R^„(a) of (/,(a): 

V I 


D',(v)- «,(v) 


T,(v) 

0 


(A 4 1 )*^ 
0 

- 1 
1 


1 1 

1 0 
0 0 


I 


0 


V - 1 

(aTT)' 

0 


1 







338 


C. CoMMAUi/r et at. 


the procedure is similar for /Vjl-v). 

Using (4.3) we gel the following compensator; 

nv) 


(•(.V) = fi, ’(.r) 


.A'(5) 


with 


ns)^\YAs), Y,{s)\; YXs)^B,{s) 


- 1 (J 


for <-1,2, where A'(.y) is any (m - r) xr piropcr 
slabic rational matrix. In this way we obtain: 

■(.V - 1) 

{) 

. . 1 

■ (.V - 1) 

Tv fT)’ 

0 

- 1 


Y(s) - 


Yts ) - 


I 

0 


I 0 


1 

0 


'Hie decoupled system is in this case: 

V - I 


ns)CU) 


s 4 I 
(74 1) 

0 

0 


(v 4 1 ) 

V I 

(74 1)' 

0 


0 

0 

.V - 1 

(.s 4 i j' 


whose McMillan degree is ccjual to the stable 
block decoupling degree v - n, 4 n. - 9, 
which represents the minimal McMillan degree 
achievable for the dect»mplcd system 


C ONC I USION 

In this pa|>er we showed the imptirtance of 
new feedback invariants lor characterizing the 
minimal structure achievable for block de> 
coupled systems with stability, Fhe following 
points can also be mentioned; 

From theorem 3, <i{T(\) ~ (l{r*(s)) repre¬ 
sents the minimal number of unstable and 
infinite zeros achievable for the <lh block of the 
decoupled system. In Dion et al. (l^>9()), the 
minimal inlimtc structure of the decoupled 
system IS characterized, then combining these 
two results the minimal unstable zero structure 
achievable for the decoupled system is obtained. 


In Commauli et ai (199(J) it is proven that a 
system can be block decoupled with stability by 
dynamic slate feedback if the number of inputs is 
sufficiently large. When this condition is met the 
minimal infinite and unstable structure is also 
given by <i(7(A)) - d(V(s)\. 

In Dion et at. (1991) the complete infinite and 
unstable minimal structure for the block 
decoupled system with stability is detailed. 
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Estimation of the Control Period for 
Self-tuners* 

MIROSLAV KARNYt 

A Bayesian estimation methodology is exploited for estimating the optimal 
control period leading to a well justified and feasible procedure for 
determining this key characteristic of self tuners 


Key Word* C ontrol pt'riod; siruclurc determination, sell adiuMinii; svsirmv, Bavtsian idcnldWation 


Abftnct— llie control period is a key tuning knoh ot all 
existing discrete-lime self-tiiners An algorithm lor its 
systematic data-hased choice is presented in (he paper h 
relies on the theory of Bayesian structure delerminaiion 
applied to a special class of control-rate dependent regression 
rntnlels The mmlcLs dcM:rihe the enure nunisurcd data 
history even if the inputs vary with another rate than that 
attributed to the idcntilicd model At the same iirnc. if the 
input signal changes with a specifu rate (he cories|^Muling 
model reduces to the standard SISO legrcssion 

Ihc proposed algorithm modifies, m accordance with the 
observed data, prior prohahilities assigneil u» the compared 
control pcniKls. In a single formula, it weights the average 
predictive ability of the nuHlcI, the inicrsampling iKhaviour 
of the output, the number (d unknown m«Hiel parameiers 
and the number of data; and, the unccnainiy of the 
parameters. Promising properties of ihe algoiiihrn aic 
illustrated by simulation results 

1 IN I KODUC'f lON 

CriNvt RSiONS continuous signals samffled data 
form inevitable parts of any dif^ilal controller 
manipulating a continuous-lime process Ihe 
two basic rales determine the conversions 
Sampling rare: the rate with which an A/[) 
convertor transforms the measured data into 
a digital form; and 

Control rate: the rate with which a feedback 
digital signal is fed into a D/A convertor. 
Assuming (as usual) thal both rales are 
constant, we speak about sampling and control 
period, respectively, llic adopted interpretation 
implies that the sampling period is always less or 
equal than the control period. 

Rcccivcd 12 June I9H^; revised IK December I Wit, 
received in final form 2M May IWI The original version of 
this paper was presented at the lllh IFAC W'orld C ongress 
on Automatic Control at the Service of Mankind which was 
held m Tallinn. Estonia, USSR during August lire 

published proceedings of this IF AC Meeting may be ordered 
from: Pergamon Press pic, Hcadingion Hill Hall. Oxford 
0X3 OBW, UK This paper was recommended for 
publication in revised form by AvMKnatc Editor P J 
Gawihrop under the direction of F:^dilor P ( Paris 

t Institute of Inroimaiion Thctiry and Auiomaiton. 
Czechoslovak Academy of Sciences. Pt^d vtKl^rcnskou vd^j 
4, IM2hHV, Prague 8. Czechoslovakia. 


The sampling perit^d determines the rate at 
which information is fed info the controller and 
It should be as shttri as possible. Its lower Ixiund 
IS determined by technical conditions 

The control period is a key user's knob lor 
Influencing the lu'haviour of any digital control¬ 
ler Its choice is addressed repeatedh: new rules 
and tools (or its tuning are proposenl and the 
impact on Ihe coiuroller performance studied 
Nevertheless, the rule of thuml> make from 7 
to 3(1 changes of input jH’r rise time <lominiilcs 
(at least in self-tuning conlrol) 

I'hc paper presents an algorithm which 
estimalcs Ihe proper contrtti ixMiod using data 
collecicd on the process it) lx* controlled. 

The solulion IS found under the assumption 
that only non zero sampling and consequently 
conlrol periods are feasible Ihe assumption is 
icchmcally sound and simplifles the mathematics 
used 

If the shoricsl sampling period is assigned Ihc 
value 1, ihcn the choice of the control period is 
equivalent it) the selection of an integer n which 
determines 
Control conditions 

iA, ) Inputs are consiantt within n 
(elementary) consecutive steps. 

{H,) A single reprcsenlanl only of each 
n-tupic of outputs measured within the 
conlrol period is used in the feedback 

Careful modelling is the crucial point of the 
solved problem ‘Ilic selected class of system 
mcxlels have to—in addition to the Control 
c4)nditions—respect: 

Estirnation conditions 

iAr) Inputs may change in any (elementary) 
step; 

t/xro-ofdcr holder is aiiiiumcd lor KimpliLily An 
extension to other cases is siraightlorward 
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(flj No data should be omitted for an 
efficient control-period estimation 

In the paper, control-rale dependent models 
meeting both pairs of conditions arc described in 
probabilistic terms. For comparison of their 
descriptive abilities, the theory of Bayesian 
structure determination (KSrny, 1983; Kirny 
and Kulhavy, 19HH; Fctcrka and Kjirny, 1979; 
Peierka, 1981) is adopted 

The case of regression modelv -which form a 
core of a wide class of self tuners is elaborated 
in detail. The offline version is treated here. 
1 he approach is also applicable in real lime if an 
increased computalional burden is acceptable. 

Ihe layout of the paper is as follows. After 
introducing basic notions (Section 2), a short 
discussion of control-rate determination under 
niisnuHlelling (Section 3) follows. 

Probabilistic modelling of the closed loop is 
recalled in Section 4. The introduced system 
model makes it possible to specify a proper class 
of conlrol-ralc dependent models in probabilistic 
terms (Seclidm 5, the main methodological 
result) Ihen Bayesian estimation and structure 
determination which arc basic tools for solving 
the formulated task are reviewed in Section b 

(onlrol-ralc dependenl regression models 
luKilling the rci|uirenicnts staled in Section 5 arc 
proposed in Section 7. Bayesian itlcniificalion is 
applied It) these models in Sections K and 9 (the 
mam practical rcsiill). Properties of the final 
algorithm arc illuslralcd by ii simulation example 
presented in Section 10. 

: NOMONS, NOI ATIONS AND ( ()NVI NHONS 

Subtleties t)f continuous lime rainlom pro 
cevses arc avoided by assuming that the 
controlled system works in discrete time (r). rhe 
lime scale is determined by the sampling period 
which has been assigned the value 1, 

Under the above agreement, the control 
period t)f a digital et)ntrullcr becomes an integer 
number n * 1 which restricts the rate of the 
input changes Hie input can be modified by 
measured data at most after each nth elementary 
sampling tmic instant. 

A set with a generic [H>inl x is ilenoled x* 
(U^ -(!}). 

A mapping / is often described by its value at 
a generic pxniH [/(a ) means/ ; ■]. 

A visuali/ation of causality is achieved m this 
way 

A single input w(,). single output y(.) 
stcx'hastic system is assumed. 

System input, system output and input output 
(data) pairs at a sampling moment r are denoted 
w(r). y(T) and d(r), respectively. 

The estimation phase is the time interval 


within which data are collected for estimation 
only. The time interval (T, 0) (-x <T<0) is 
assigned to it. 

The control phase is the lime interval within 
which adaptive control takes place. The lime 
interval [I, T| (7 < ^) is assigned to it. 

The following shorthand notation is used for 
lime-dependent sequences defined on a sub- 
interval [t, t| of the estimation and control 
phases (T < t 1 T ) 

According to the convention made, denotes 
the set 

Inpul“Output behaviour of a controlled 
system, on a time interval of interest T+l, 
> . . , 0, I, . . . , 7, is modelled by a sequence of 
causal, generally stochastic, mappings 
5(r):(£/‘^ u*(r)) = (y^^ m^*) —>*(t). 

e * is called system model. 

A controller is described by a sequence of 
causal, generally stochastic, mappings 

D* ^(r (2) 

e R'* is called the control strategy. Notice 
that the obligatory step of the transjHirt delay is 
attached to the controller. I'his convention is 
made m order to respect agreements applied in 
the majority of references cited here. 

The symbols denoting the system model and 
the control strategy arc further simplified 

,S - A', « -Ae'. 

The symbols pi ) and /)( j ). r(. j .). .\( | .) 
arc reserved for probability density functions 
(defined with respect to a suitable dominating 
measure) and conditional probability density 
functions, respectively. The term (conditional) 
probability density function is abbreviated to 
(c.)p.cl.f. The c.p.d.f.’s r(. | ), .s(. | ) are 

reserved for descriptions of the control strategy 
and of the system model, respectively, Other¬ 
wise p(.) or pi I .) are used. 

V^anous (c.)p.d.f.'s are distinguished by their 
arguments. 

V MISMODELLINC’. AND ( OIsrrRDL PERIOD 

Let ,V be a fixed system model and R„ be the 
optimal strategy defined as a minimizing 
argument 

R„ e Arg min .)f(R, .V) 

where ^(. , .) denotes a non-negative functional 
which introduces complete ordering on a set of 
admissible control strategics R*. 

l.x;l /?* denote a subset of admissible control 
strategies. Clearly, it holds 

min JfiR, S) min 5). (3) 

RtR* 
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R*„ is interpreted as the set of controllers with 
control jxrriod n. Inequality (3) and the 
ohservalion 

n, s n2^R*,c: /?*, 

imply: the smaller asntrol period, the better 
wntrol quality can be achieved. Tliis formal 
oijscrvation contradicts engineering experience. 

The contradiction is usually faced by judging 
whether much quality can he gained by 
shortening the control period. A more reahsitc 
setting should take into account a mismodelling 
influence. It means that the “true" system 
description need not belong to the set of models 
assumed. 

Ixl -S‘„ denote the system model u.sed for 
chotrsing the strategy R„eR’, i.e. having 
control period n. The optimal strategy W,.„ is 
selected within R* as a minimizing argument 
R„„ e Arg min Jf{R„. ,SJ 

lilt* performance of this strategy is to he 
judged according to the value of the functional 
V ). where .V,, # V, denotes the ‘‘true'* 
controlled system. 

C learly, the strategy can he outperformed 
hy a strategy related to a longer control period 
because the discrepancy of S,,) and 

.S’J increases for fast control 

4 INFORMATION NF.t IM I) FOR (OMROl 
OrSKiN UNDT R 0N( FRI MM Y 

It IS widely accepted that a complete ordering 
of admissible strategies-^ which is used for 
choosing the optimal strategy has to face both 
randomness of the contridled process and 
incompleteness of the system description 

It follows from the above inspection that such 
a complete ordering can rely only on an 
approximate description of the controlled 
system. 

Detailed discussion of the suitable thetiry is 
beyond the scojX‘ of this paper. We claim, 
however, that the control design based on 
general model of statistical decision making with 
a Bayesian view on incompletely known 
(random, uncertain) entities (De Cirooi, 1970) 
fulfils the requirements The mismodelling 
(approximation) aspects of Bayesian decision 
making can be understood from the paper 
(Harris and Heincl. 1979). 

For stochastic systems, the expected value ^\.\ 
of a non-negative loss function T(.) 

L:d^* = (i/Vy^")-,[(), xj (4) 

is taken as the strategy-ordering criterion, i.c. 

J({R.S)= ^^d')\ d'ed^r (5) 

The loss function (4) is formally defined on the 
union of the estimation and control phases for 
sake of notational simplicity Of course, the 
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strategy optimi/iiiion is performed for the 
ami ml phase only 

W'e restrict tvurselves to the conrmi>n ease 
when the expectation can he* expressed in terms 
of a prohttbihtv density function, Ijndcr this 
assumption, the closed lixip descnptM>n [given 
by ihe mappings (1), (2)) is sixcilied if for any 
generic data the c p.d I p{d ’) is given. 

Now, let us distinguish in pfdfM the piob> 
abilisiK description of the mapping*^ (I), [2). 

The following basic properties ot the condi' 
tional ex|X‘ciiition /( j | (Rao, 1987) will be 
used; 

for any conditions a, it holds 

j a \ /[ /], I a, b) j ri); {i\) 

if the condition in the amditional ex|X'etation is 
generated by observed random variables, the 
conditional expectation can be expressed as a 
function ol them 

Using Ihe pri>periy (6). the criterion (^) can be 
evaluatcvi for a given causal strategy (2) bv the 
backward iccursion 

W (J' ’) - /|/| M ‘.u(r)|| J’ 

T - /, / 1. 7 2, . (7) 

W Id' ) - lAti' ). HiR. S) M ill ’) 
Inspecting the iccursitm (7) with the second 
properly of ihe conditional expectation in mind, 
wc sec that a causal conliol slralegy has to 
sjxcily (and is specified by ) the colleclion of the 
c.p.d Is 

R - (/-(idr) I '):i/(T) r uMt), d’ ’ r 

r r (T, / I). (8) 

f rom Ihe nghl-hand side ol (7). it can also \yc 
seen that the system model and the slralegy 
description have lo specily Ihe c,p d f.\ 
/;( v( T), i7f, I I d' u( r)) for t ^ T f K . I 
I he de scnption of Ihe control strategy (8) and 
(he chain rule for c.p.d.f s imply that the system 
model IS given by the set ol c p.d f/s 

A - (vf v(T) !r/^ \i4{r)) ir i d^\ r( (T, 7 1( 

Using again the chain rule, we can verify that 
the closed loop description is indeed cornfHised 
of Ihe strategy and sysicm descriptions; 

/ 

p(d') " II v( v(r)lrT n(T))r(M(r) I rT ’), 

T '1*1 

( 10 ) 

Summary 1 A system model S given by (1) 
which fulfils the Estimation conditions A^, 

—which describes the controlled system for 
any causal strategy without any rcsitriclion on the 
control rate—has to specify the set of c.p.dd s 
(^) 

A causal strategy H is specified by the set of 
c.p.d.f/s (H). 
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S M()DEI.LING AND C ONTROL PERIOD 

The general syslcm mtMlcl derived in previous 
section describes fully the syslcm behaviour for 
any causal strategy. Thus, it fulfils Estimation 
conditions in the estimation phase, i.e. for r < 1. 

Modelling, the necessary prerequisite of any 
estimation, has to be adapted to the intended 
use of the rntxlel. For the aintrol-period 
estimation, we have to restrict the general 
system description (9) to be in a class which 
respects the Control conditions in the control 
phase, i.e. for t > 0. 

TTie evident difference of the conditions 
/C and Ar, B, is the main obstacle we shall try to 
overcome here. 

Dynamic programming is the most efficient 
conceptual procedure for the opiimi/ation under 
the cau.sality restriction (2). We shall exploit it 
for restricting the system models (9) to those 
which respect also the (ontrol conditions 

As a rule, the control horizon growing to 
infinity is assumed. Consequently we can 
(without substantial loss of generality) take T, / 
to be integer multiples of all inspected control 
periods. 

Let, for a specific control period n, n data 
pairs be grouped 

T'()l') -l.y((/c ~ \)n 4 l).y((^ ^ ])n 
4 2)_ y(kn)l 

Lrik)^[uiik " l)ri 4 1). u((k - \ )n 
42),. . ., w(/ffi)l 


ITie collection of all data on the time interval of 
interest reads 

{D(*))/:Vmi. lHk)^(Y(k), U{k)l 

Then, for the control design, the loss function 
(4) is approximately expressed in terms of the 
grouped data 

Lid^)^ (ID 


where L„ is a suitable loss function. 

llie optimal inputs are (by A,) required to be 
constant within the control period of the length 
n, i.e. 


I 


vik)^u(k) 


I 


iHkyi 


with some scalar M(fc) forming the system input 
under the control period n. 

Under general conditions, the optimal strategy 
is deterministic. The optimal inputs {m(A:)) are 
minimizing arguments of the dynamic program¬ 
ming equations. The equations are an analogy of 
the backward recursion for the expected loss 


function (7) 

r(D‘ ‘) - min ( D* u{k)l 

U{ki 

. 1 . <' 2 ; 

n n 

I (D^") - Uiy ^y 

Formula (12) exemplifies the need for £ 
syslcm model yielding the c.p.d.f. 

.i’(T(i(c) I ly \ u{k)) - .^^(/c) I ly \ U(k)). 

(13: 

Generally, the minimizing argument C(/c) = 
u{ky\ is a function of the data 
1/^1 = i/ ‘'"1. In order to respect the conditior 
(fl,), the vector sequence T* ‘ has to reduce tc 
a .scalar sequence V In terms of the c.p.d.f. 

(13) , we have to search for a system model for 
which—under the control period n —holds 
s(Y(k)\iy \ Uik))=s{Y(k)\Y^ ’.r/) 

^s{Yik)\y \y) 

= .v(y'(it)I u{k)) (14; 

with d(k) “ (y(k), u(k)). 

The restriction of the allowable system models 

(14) admits y{k) to be any function of data />V 
In the feedback, however, y(^) plays the role of 
a system output: a .scalar-valued function of the 
output ntuple measured within the Ath contro' 
period. Thus, it is reasonable to take y(A) as £■ 
simple deterministic function /(.) of V (A) only 

y(A)-/(r(A)). (IV 

Assuming that (14), (15) hold, we tind that 
over the entire design horizon 

r(D')= } (d^) A --- 1. 2_ T/n 

and that the optimal strategy fulfils the C ontro. 
conditions. 

Summary 2. Lhe system model (.s(y( r) | *. 

w(t))}^. | , , for which the equalities (14), (15; 
hold under any control strategy with contro 
period n fulfils both the Estimation and the 
Control conditions. 

f) SYSTEM MODEL. EST IMA I ION 
The key feature of self-timers is their ability tc: 
update the information about the system model 
throughout the control phase. Bayesian system 
identification supplies just the system model 
needed for the optimal control design sketched 
above. This fact is a decisive advantage which 
led us to adopt the Bayesian approach. 

I^t us briefly recall the Bayesian background 
needed in the sequel. The paper (Peterka, 1981) 
is a gcxHl reference for a detailed study. 

6.1. Bayesian identification 

In the Bayesian set-up, the c.p.d.f. p{d^) is 
assumed to be the marginal p.d.f. of the p d f. 
p(d^ 0) with an unknown (finite-dimensional) 
parameter 0 e 0*. 
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Using the chain rule for c.p.d.f s and the 
relation of joint and marginal p.d f.’s. we find 
that the needed p.d.f. can be expressed as 

p{d') f n rfufijld' '.0) 

xi(y(T) 1 u(t). d' '.e)/>(e)d0. 

The c.p d f 's (riyfr) | «(r). 0)),' 

form the parametrized system model which 
describes the system response at time r to the 
observed past process history if the parameter 
takes the value 0. 

The term “unknown" parameter means that 0 
characterizes the properties of the system model 
unknown to the controller. Thus, the probability 
of possible values of u(r) conditioned on the 
observed data ' and a parameter value H 
should not be influenced by 0. i.e. 

r(u(T)|d^ \©)-r(u(T)|rr ’). Ted//] 

(16) 


Under these so called natural conditions of 
control (Pclerka, 19K1) the data ohsc*rved up to 
lime T modify the expert's prior belief quaniihed 
by the p.d.f. p(0) to Ihc p.d (. 
according to the following form of the Hayes rule 


p(0|rf^)- 


/(0 I 


(17) 


/(0 !(y')P(H)(yB 


where the likelihood function /(0 ! d') is the 
product of the parametn/ed system models 
/ 

/(0jd')= I I i M(T), d' '.0) (IK) 

r 1 ♦ I 

for any / e (T, t]. 

Using again the chain rule, the relation 
between joint and marginal p.d.f. s as well as the 
natural conditions of control (16). wc find that 
the required system description (M) (Hayesian 
prediction) reads 

{.v(y(T)|M(T), d^ ') 

= I u(t), d' 0)/;(0 i d' ')d0 

Note that no point estimation of unknown 
parameter is needed for determining the 
required system model (9) 

6 .2. Structure determination 
The problem of structure determination arises 
when .several (1 < /V < *^) structurally differing 
descriptions {5(v(t) | u(r), '©llT i of a 
single controlled system are to be compared on a 
time interval. Individual members of the ilh 
structure arc generally distinguished by an 
unknown parameter '0 e '0* 

Let ne(l, 2. N) denote the pointer to 

the appropriate (best, true ) model structure 


and let the annpound parameter 0 he defined 
by 

0^ (/f, ’0."0) 

6 ({1.V). ‘e*_ 

Then the lotloving parameterized system mcHicI 
reflects the situation when we are uncertain 
about bi3th the appropriate model struilure n 
and the parameter **0 within it; 

.v(y(r)! u(T). ri* 0) 

-.v( v(r) j w(T). d^ \ n. '0.. "^0) 

\ 

= 11 aN v) T) I M( r). d' '0) 


f-Mrir) 

I w(r), 

-r 

«') 

if M 

- 1. 

'(v(U 1 

1 w(»), 

d' 

',0'’) 

if n 

- 2. 

Iriv(T) j 

M(r), 

d’ 

0") 

if n 

iV. 

oducl form of 

the 

ubovc 

formuhi. 

demotes I 

[he Kr 

OIK'I 

:kcr syi 

fnlH>l 



Note that this way of modelling is very flexible 
due to the possibility of [oimng models of a quite 
different nature 

Assuming prior belief to be assigned indc* 
pcndenily lo particular entries ol H, the Hayes 
rule spcH.iali/cs to 

pin. ‘0, , "0 I »/’) 


11 /N’0 I i/')/>('H) 

/('H i r/')/M/H)r/'H/>(/) 

f i J 

where the likelihood /(/0 j ri’) assigned lo an rth 
model slruclurc is defined by (IH) written for the 
/ih parametrized system model 

Hy inspecting this formula, it can he seen that 
the parameter '0 within (he rth slruclurc is 
idenlilied irrespectively of the other structures 
assumed 

Formally, no estimate of the proper structure 
IS needed when constructing Ihc system model. 
I'his IS deal from the imbedding of the structure 
estimation into the parameter eslimahon frame¬ 
work and Irom the conclusion of the previous 
Section Wc arc. however, often forced (usually 
because of computalional reasons) lo select a 
single structure al the end of the eslimation 
phase Then the paramcln/cd ithhJcI of the 
selected structure is identified within the control 
phase. 

In spite of the diversity of the paramclrization 
used, the identified submodels are quite 
comparable through the marginal posterior 
probability p(n \ J'). 

Summary 3. All information needed for .select¬ 
ing a single structure at the end of the eslimation 
phase (r~0) is contained in the marginal 
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posterior probability 

j /re 1 d'')pre)d’'e 

p(n I (f') = -- pin). 

L li'e I d")pi‘e)d‘epU) 

i - 1 J 

(19) 

7 (ONIKOr. RATI. DEPtNDtNT LINEAR 
NORMAL RE'ORLSSION MODEL 

Among linear inpul-output models, the 
ARM AX model is the most general description 
of a linear stochastic system. The majority of 
applied self-tuners rely, however, on a regres¬ 
sion model (often working on prefiltered data). 
Popularity of the regression models stems mainly 
from the fact that their identification leads to 
recursively computable least squares. For the 
same reason, wc search for control-rate depend¬ 
ent system descriptions within the class of 
regression models. 

Control strategies used in self-tuning are often 
based on an enforced separation of the 
identification and control synthesis (certainty 
equivalence). We restrict ourselves to this case, 
too. 

We shall interpret the searched control period 
n as the model structure. Then, according to 
Summary 3, the posterior probability pin | d") 
compresses all information needed for a prior 
choice of the control rale. In order to evaluate 
it, control-rale dependent parametrized system 
models have to be specified. 

I'he resulting system models (Bayesian predic¬ 
tions) should fulfil the conditions (14), (15) in 
Summary 2. For certainty-equivalent controllers, 
it is sufficient to ask validity of (14), (15) for the 
parametrized system models only. 

We claim that the following regres.sion model 
fulfils the discussed conditions and it is also 
technically sound. The output n tuples are 
modelled by 

L, I 

+ L "b',Uik - i) + V + £(*). (20) 

i - I 

The function (l.S) is defined by the formula 

y(A:) = - V Y,(k) = - y{(k -- l)n + /). (21) 

«,.i n.-\ 

The meaning of the other quantities is. %, 
are respective orders, "a, arc scalar 
autoregression coefficients; are vector 

regression coefficients; "c is a common absolute 
term; and {£(/c)} denotes white normal noise, 
i.e. the sequence of independent normally 
distributed sttxhastic variables with the zero 
expectation and the common precision matrix 


(inversion of the covariance matrix) 

"Q, "a/--h/-I (22) 

L n n J 

In Formula (22), / denotes unit matrix, '’Q and 
''o) arc positive scalars. 

Normality and whiteness of the noise imply 
that the required parametrized system model of 
the controlled system is specified. It reads 
.v(K(ik)| T* -', 

= ..v,,Mrr^'(*r^'. cQtr') 

where the normal c.p.d.f. >V of Y having an 
expectation M and a precision matrix Q/. takes 
the familiar form 

.UM, fi/ ‘) 

'“"I 'exp|-J(T-Af)'£2,.(y-Af)l. (2.1) 

Ztt 

The assumed precision matrix is defined by 
(22) The expectation—defined by Equation 
(20)—can be written in the compact form 

M^''rz^(krP 

with 

"z'(^) = U/'(^). U^ik - %). 

yik - I).y(/c - T). 11. 

.—X.. vj. 

The vectors "z, "'P have the dimension 

Vi -('7.,-f l)n-4 4 1 (24) 

The unknown model parameter is ”0 = 

Using a simple algebra, the introduced 
parameterized system model can be rewritten 
into the form 

.\iYik) I y* (y‘, "£ 2 , '■(.;) 




\Y^{k)Yik) 


-fik) 


r-irr v(^) vik) i' ~i ni 

4 \o ' (25) 

L"/vJ l/'z(fc)JL"z(/c)J r7vJJI ^ 

which will help us in describing its identification. 

The model adds no restriction on inputs and 
together with the strategy description specifies 
the joint p.d.f. of all data measured within the 
estimation phase. Thus, it meets the Estimation 
conditions. 

The direct inspection of the mixlel (25) verifies 
the identity 

5(y(*) I y* ', (7*. "0) = 5(y()t) |y*'‘, u\ "©). 
If the input change.s with the rate n then its 
influence on the output reduces to 

"1 X "bMk - i) 


where the scaiar coefficients "h, are defined 
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Thus, in the control phase, the 
Control conditions s(Y(k) j v* C*. "0) = 
u(*:), "0) are met! 

The following remarks should confirm that the 
model (25) is technically sound. 

The mean value y(k) (21) minimizes the 
quadratic form 

n n 

S ('^(*)-y(<£))'= X (•>'((*- l)n + «i-y(fc))-. 

1-1 f 1 

For the quadratic control design, this simple 
property makes y{k) preferable function of the 
output ntuple in kih control jx-nod: it produces 
a reasonable approximation of the quadratic lt>ss 
L by the quadratic loss adapted to the control 
period n (II). 

The mean has been invented by adopting the 
idea of piece-wise filtering (Karny ei al., 1988) 
which can be exploited further. 

The degenerate form of the coefficients al the 
inputs respects the basic need for converting the 
model into a single-input one in the control 
phase. Al the same time, the coefficients weight 
the individual inputs in the estimation phase 

The reduction (14) is achieved by assuming 
the common contribution of y* ‘ and {/* to the 
prediction of Tf/c )-entries. Inlersample be¬ 
haviour is modelled by a strong correlation of 
noise entries 

The chosen precision matrix has n 1 unit 
eigenvalues and one equal to ''w which 
corresponds to the eigenvector "I If 1 »''fu then 
there is a ridge on the paramclri/.ed system 
model (25) assigning high probabilities to 
F(A') = ^”1 (/i a real scalar). Ihe closer /i is to 
the higher the probability is. I his property 
is clearly necessary for a successful control with 
the control period n. 

Summary 4. For a given parameter "0 ~ 
rP, '"Q, "(ij), the parametri/ed system model 
(25) meets both the Hslimaiion and the Control 
conditions. 


K IDLNTIFIC ATION OF COM KOI KAT l: 

DEF’hNDrM KI (MI SSION MODI L 

The identification of the fixed-structure model 
is an intermediate step for structure determina¬ 
tion. We shall perform it for the regression 
models introduced in Section 7. 

Using the system model (25). the likelihcxid 
function (IK) at a time instant t - k{T)n - k{T) 
an integer number—reads (with superscript n 
suppressed) 


/ Q 

/(e|D*^^^)= - 

' 2jt ' 

xexp|-”y |a(A:(t))+ w ^ 


V{k{T)) 



(26) 


where (with r suppressed) 
V(k)=V{k - 1) + 


v(*)]f.f(*)] 

2(fc).liz(A)J 


T.(A) VI,(At)' 

K.v(A) VAk) 

In the block form of V'(.), V',( ) is a scalar. 'ITie 
.scalar A(.) is defined by 

n 


A(A) = A(A ■ 1) + 


(27) 


-y\kl (28) 


The scalar vlr), defining A(t) with the help of 
integer division counts the numl>er of data 
items 

v( T) v( T 1) 4 U A ( T ) v(T) ^ n. (29) 
All recursions start from zero initial conditions. 

ChcKising a self-reproducing prior p.d.f. (De 
CirtxM, 1970), Ihe constructed posterior p.d.f. 
exhibits the Siime functional form as the 
likeliluHHl function. Prior belief of the user is 
expressed by nonzero initial conditions V^(T/n), 
A(T/n), > (T/m) of the alxive recursions. 

Normalization of the function obtained to the 
p.d.f. has to he possible It is guaranteed if at 
the initial time in.stant T (cf, (24)) 

V(T/n ) * 0, A(T/n) > I), v(T/n) > n(m - 2). 

(30) 

rhe matrix inequality F >0 means that V' is 
|K)sitivc definite. 

Proposition 1. For a given control iXTicni n, 
lime T which is its integer multiple, the initial 
conditions (30) and under natural conditions of 
control (lb), the Bayesian estimate of the 
parameter 0 -(/^i2 , (u) specifying the regres¬ 
sion model (25) lakes the form 


.. (31) 

n), v(t), n] 

) (modified by the 


p(/^ Q. in I d\ n) 

/(BjO 

/|V'(v(r) n), A(v(r) 

The likelih(K)d function /(. 
prior pd f.) is given by fnirmula (2b). The 
normalizing factor reads 
^\V, A, V, n\^ V'(v, m)A" V/”"' " mi "y (32) 
The quantities V, A, v arc sufficient statistics 
for estimating P, il, u). They are specified by 
Equations (27), (28) and (29) and related to A, 
a, b, V' follows 


A v - V’ V W 


V 




(33) 


yj(v. n) = n' 


m 

n 

"r 

ml 
a - 

2 . 



2.J 


with r denoting Fluler function and volume 
of the unit ball in m-dimcnsional space. 

The formulae are formally valid for n-\ if 
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the factors depending on 6 “ a = 0 are set equal 
to 1. 

Proof, The proof adds to the formerly derived 
results just the evaluation of the integral of the 
likelihcKKl function (see Appendix). 


9 MAIN RESULT CON'IROL-RAIT: ESIIMATION 
With the preparation made, the Bayesian 
estimate of the control period is obtained by 
specializing the general structure-estimation 
formula (19) to the regression model assumed. 


Proposition 2. For T being an integer multiple 
of all competitive control periods n e 

(1,2,. N} and under natural conditions of 

control (16), the Bayesian estimate of the 
structure n pointing to the regression models 
(25) takes the form 
pin I d") 


= Kpin) 
= kp(n) 


.fyviv 


'A(v -r n), 

V, n| 

ipY/ 

A, V, n| 


V'(v. n) 

'■A"" '. 

.t _ / 


Y(v. n) 



'rv,i 

(I) 

(H) 

(iii) 

(iv) 


1/2 


where 


(34) 


the quantities V, A, A, v, a, h have been defined 
in connection with Proposition 1, however, 
their dependence on n is made explicit here; 
the statistics V,, A, A, a, h are related to the end 
of the estimation phase and their boldfaced 
versions to its beginning; 

K is a normalizing factor independent of n ; item 
p(n) is the p d f. (with respect to counting 
measure) describing prior user’s belief; 


VKv. n)-n - ^'a\r 



Proof. The proof is obtained by a straight¬ 
forward combination of Equations (17), (19), 
(31), (32) and (33), noticing that integral in the 
numerator of the ratio (19) can be written as the 
ratio of the integrals ./ evaluated at the end 
and the beginning of the estimation phase, 
respectively. □ 

The labelled factors in (34) correspond to the 
basic ingredients which modify the prior belief to 
the inspected control periods. Specifically, it is 
influenced by 

(i) the numlier of data available v, the 
‘aggregation” degree n and the number of 
estimated parameters "m (24); 

(ii) the intersampling dispersion reflected in A 
(the exponent is an increasing function of 

n); 

(iii) the ability to predict the output mean (v) 
reflected in the corresponding remainder of 


least squares A (the exponent is propor¬ 
tional to the number of data: it has the 
strongest discarding power); 

(iv) the uncertainty of the estimated parameters 
(the exponent is fixed: this “second-order” 
quantity decides among models with 
roughly same predictive potential). 

10 IMPLEMENTATION ASPECH^ 

Choice of the prior p.d.f/s p(n), pCO). 
Usually, not too much information is available 
when the control period is selected. Thus, it 
makes sense (at time T): 

—to select a uniform distribution over the 
compared periods 


—to choose = 0, U. = el, 0 < e « 1 which 
correspt)nds to a very flat distribution of the 
regression coefficients P\ 

—to respect the relation 0 < A « A = which is 
necessary for i\u>]« 1 (see Section 7); 

—to set v = n(m-2)-^e which guarantees a 
proper but flat distribution of Q. 

A specific prior knowledge can be introduced 
in the way outlined in (K^rny, 1984). 

Evaluation of p{n | (34). When program¬ 

ming this formula we have found it useful; to use 
its logarithmic version in order to prevent 
overflows; to apply the Stirling formula lor 
approximation of the f-function; to normalize 
rough data to a zero mean and a common 
dispersion—numerical problems arc avoided 
when compressing the data into the matrix V'; to 
exploit the regressor shifting structure when 
collecting the data into the matrix V in order to 
spare the computation time (K^rny, 1983); and 
to use LD (or Cholcski) factorization (Bierman, 
1977) of V for the efficient evaluating |K| and A 
Concerning the last item the key observations 
are: W V = F'F where F is a lower triangular 
matrix with positive diagonal terms 

Fx^F. .then 

= and 

I 2 

11 ILLUSTRATIVE EXAMPLE 
The proposed algorithm has been imple¬ 
mented and tested within a flexible experimental 
environment SIC [package for Simulation, 
Identification and adaptive Control of stochastic 
systems, (Kirny et al, 1985; Kulhavy. 1988)]. 
The LOG self-tuner used for cross-validation of 
the gained results is described in (K^rny et al., 
1985). For illustration, we present results of a 
single test. 
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CX)fmiOL PERIODS (box MARRS MAXIMUM LIKEl UHIOD PI'RKMiS ( boX MARKS MINIMUM lOSS, * INDW AIVS 

ESTIMATli) UNMAlllim) 


#1 

1 

2 3 

4 

s 

6 

n 

1 2 

3 

4 

5 

6 

In (i(n ji/* ,„)) 

-189 

[-1861 -210 

-286 


-493 


» [ tniTf ) 

1 (186 

9 619 

.5 260 

4 0.36 

ln(l(n 

-891 

-662 1-571) 

-.571 

- 6 H 5 



« [ 0 . 6 . 18 ] 

0 648 

2 520 

1 747 

1 504 








V 0 592 


0 745 

0 

0 871 


Estimation phase 
Simulated system. 


where 

x(r) is an unobserved inner variable, completely 
neg:lecled both in the estimation and control 
phases; 

^ 2(0 arc mutually independent xcro mean 
normal random variables with the common 
dispersion 0.1. 

Input signal. Zero mean while noise with 
dispersion 0.1 and independent of f t 

Estimated structure, prior data and tested 
periods. First order model ly - /« = 1 is assumed, 
i.e. the model order is underestimated. 

The control periods n e (1. 2, . . . , 6} are 
tested. The recommended initial values of 
statistics are used. 

Results of the estimation phase 

The posterior probabilities of the control 
periods are; p( 1 | d^\ == 0.0474, p{2 c/*' = 

0.0526 and zero otherwise; and /7(3 c/“ “ 

l.(KKK) and zero otherwise 
The detailed results can be seen from the 
Table 1 where logarithm of the likelihoods 
l{n I ^/t 4 i) = const. p(n \ d^^ ,) arc listed. 

The maximum a posteriori likelihood estimates 
(marked by boxes) are clearly optimal for a 
majority of loss functions which could be 
selected for a point estimate of n. 

Control phase and cross-validation 

Optimized criterion. 

Jf= lim f[L(d')l 
r 

2 yUf + uiTfuiT - ])A 

I 1 ^ 

5>\vrem, system model and tested periods. The 
same system model and the first order regression 
model are used in simulating the control phase. 
The control periods n = I, 2, . . . , 6 are tested. 

t Recall the ainvention made: the ncccswiry ,vtcp of ihc 
triinsport delay is included into the controller. 





Pnor mformaiUm, control strategy. Rather 
vague prior knowledge is used by the controller 
(zero prior mean of the unknown parameters, 
and a large diagonal covariance matrix). 
Certainty equivalence version of 1ST strategy 
(K^rny rt al., 1^85) with 20 iteration steps per 
the control period is applied. 

Results of control phase 

The achieved sample values of the loss 
function are summarized in the 1 able 2, where « 
indicates unstable closed loop and L(d^fl) 
denotes sample los.s in the interval (121,bOO) 
(start-up behaviour omitted) The achieved 
values illustrate the strength of the pro(x>scd 
estimation algorithm 

12 CONC l USIONS 

The paper presents an attempt to find 
well-founded algorithm for a dala-based choice 
of the control jicriod. The theory ol Bayesian 
structure determination proves to be natural 
candidate for solving this task. In addition to the 
widely known advantages (Pelerka, l^>Hl), Ihc 
Bayesian set-up can be connected with ap¬ 
proximation theory (Harris and Heinel, BW). 
This fact is of special importance in the solved 
problem because its non-trivial solution exists 
under mismodelling only. 

Within the Bayesian theory, the proposed 
algorithm simply compares posterior probabil¬ 
ities of alternative system descriptions. When 
searching for such alternalivc system descrip¬ 
tions, simple but important circumstances arc 
faced: learning data are collected and inputs arc 
changed with a rate which differs from the one 
searched for; and the found model structure has 
to reduce to SI SO system description when 
designing the controller with a fixed control rate. 

A subclass of regression models has been 
proposed which respects these cirsumslances. 
ITie subclass is by no means unique. The chosen 
version has been influenced by intention not to 
change the existing design of LOG self-tuners to 
which the discussed choice should serve. 

Up to now, a couple of various simulation 
cases have been tested with the following 
common features observed: 

(1) “dangerous” control rates have been recog¬ 
nized as a rule; 
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(2) maximum of the posterior p d.f. pin \it^) is 
attained nearby the reasonable control rate 
if such a control period exists ; and 

(3) an ovcrestimaiion of n has occured for long 
learning data sequences ("^^5(XK)) [forgetting 
in the manner of (Kiirn^ and Kulhavy, 1988) 
should be used). 

In summary, the results are encouraging in 
spite of evident incompleteness of the open-l(x)p 
based comparison. The prediction of closed Uk>p 
behaviour in the vein of (K^rny et al., 1990) 
.seems to be proper way for improvement of the 
proposed method. 
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APPENDIX INTBORATION IN PROPOSITION 1 

For compiciencss, the evaluation of (he integral 
X, V, n) needed m Proposition I is sketched. To spare 
the space, the substitutions and dchniiions of auxiliary 
quantities arc wntien within the string of equalities in 
norm-likc brackets || .||, new variable is called jr and a single 
integral sign is used (ai, Q arc non-negative scalars and P is 
m-dimensional real vector). 

Except a sequence of substitutions, the completion of 
squares of a quadratic form in P is used with the bkxrk 
decomposition of the positive definite matru 

JK v;,] 

I K J 


Moreover, the following dcfinilions of the Euler functions 
arc u.sed 


r|u|=^| jt" ’cxp('x)djc 


EiHiluation of I 
.9\V, A, V. fi)- 




A it) 


II 


dPdQdu) 


y. 


' V'f-' 


V , V Qnv 

o » 1; 6 » + 1; X - - to 

In 2 2 


-an)' '■(") V(fl|J y -a^ “ 'cxp[-‘y”|dA'dQ 

.^||x -yU|j-(2;T)' '■(") Vluin/. - fl|A“ "jy “dP 

Hr « A + (P • P)'v.(P - P), A » V, - 'v’„. 

pm.V, V„;ji - A ' -VI'-CP - P)ll 

-(2;t)' '■(") ”l1fl|r|fr- <j|A- '■A ■- 

X J (1 + jt'j) " lU 

~ ||H^ volume of the m - dimensional unit ball, 

.1 is transformed to polar coordinates with radius r|| 

-an)' '■(") V|fl|r|/.-«|A" "A |V'J 

X I r” '(I +r’) "dr 

-an)' "("J V|u|r|fc-<J1A" ''A 
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A Geometric Approach to Proportional-plus- 
derivative Feedback Using Quotient and 
Partitioned Subspaces* 

V L SYRMOSt and F. 1.. l.t.WlSt| 

A geometric theory to proportional-plus-dcrivatix>e feedback using quotient 
and partitioned suhspaces, as well as spectrum wisignahility techniques 
using nonsquare pencils, provides advantageous computational methods 
for singular at well at state-variable systems. 

Key Words—Singular systems, pinp^irtional pluN Ucnvaiivc feedhatk, gerHULMrit theory, 


Abstroct—In this paper a ne\^ characicri/ation of invariant 
suhspaces is presented, using the notions of partitioned and 
quotient suhspaces. This clussihcaiion is based on a feedback 
approach that exhibits the im()ortance of these subspaces lor 
the problem of proportional-plus denvinivc feedback It also 
provides the ability to dccomfH)se the closed-kxip system into 
two subsystems that completely characten/e the closi*d-lo«»p 
behavior, A feedback-free formulation is also considered 
which opens new horizons for the problem of general 
semistate feedback by utilizing nonsquare pencils for 
spectrum assignability. The importance of this technique 
arises fiom the fact that we deal with reduced order jKncih, 
therefore the computational methods are more stable In 
order to accomplish this, wc use two gcncrali/ed Lyapunov 
equations and exploit the generalized Hesscnlx*rg lorm 


1 INTRODUrnON 

Till- (I Assiric ATiON and characlcrization of 
invarianl subspaces has always been an impor¬ 
tant topic in control theory. In slate-variable 
systems (Basile and Marro, 1%9; Willems. 1981, 
1982; Wonham, 1979) these ideas constitute a 
powerful tool for the study of pure proportional 
feedback (Wonham, 1979). Later, matrix pencil 
characterizations for invariant subspaces were 
presented in the literature (Jaffe and Karcanias, 
1981). These characterizations bring together the 
matrix pencil (Gantmacher, 1959) and geometric 
theories for slate-variable systems. 


* Received 23 August 198^ revised 1 February n)9n, 
received in final form 9 April 1990 Ihc original version of 
this paper was not prc.sented at any IFAC meeting Itiis 
paper was recommended for publication in revised form by 
Associate Editor P. Dorato under the direction of Editor H. 
Kwakemaak. 

t Schex)! of Electrical Engineering, Georgia Institute of 
Technology, Atlanta. GA 30332, U.S A 

t Author to whom all corrc.spondcncc should be 
addressed. 


For singular systems (l.ewis, 1986; Ozgaldiran, 

1985) various approaches were used for the 
characterizations ftf invariant subspaces (Lxrwis, 
1986; Lewis and (T/galdiran, 1989; Lewis and 
Syrmos. 1989; Malabre, 1987; Oz(;aldiran, 1985, 

1986) . Moreover, an attractive theory for matrix 
pencil theory was presented (Karcanias and 
Kalogcropoiiios, 1987; Van Dooren, 1979, 
1981). rhese characterizalions led to a complete 
theory for the u.se of pure proiHtrtional 
feedback In Shayman and Zhou (1987) a 
classification of singular systems using constant 
ratio proportional-plus-dcrivaiivc feedback was 
presented. This approach, although it is an 
attractive one, is based on nongeneral 
proportional-plus-derivativc feedbacks and docs 
not present general geometric characterizations 
for the involved invariant subspaces. 

This paper aims to provide a complete 
feedback charaderizalion and classification of 
invariant subspaccs for singular systems, based 
on the notions of partitioned and quotient 
subspaces. The dehnition oi partitioned subspacc 
that is presented in this paper is closely related 
to the notions of quotient subspaces. Partitioned 
subspaces arc the primary lool for prornirtional- 
plus-derivative feedback. 

In Section 2 we introduce some geometric 
notions thal will be of great help. It is shown 
that a partitioned subspacc defines a class of 
quotient subspaccs. ITicsc quotient subspaccs 
define a set of induced maps thal carry the 
information of the original system and is called 
an induced partition. This class of subspaces 
satisfies certain properties with respect to the 
induced maps. ITie motivation for this approach 
comes from the matrix pencil theory, since these 
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maps constitute the idea for the definition of the 
induced pencils. I'hese pencils play a role of 
prime importance for the proportional-plus- 
derivative feedback characterization of these 
subspaces. 

The concept of a regular partition is also 
presented in this section, l^is notion is 
substantial, since it is the one that guarantees the 
closed-lcHip regularity of the system. It is 
noteworthy that we do not assume the regularity 
property for the open-loop system. 

Moreover, in this section an alternative 
approach, that is, a feedback-free description of 
the original system is presented. This formula¬ 
tion characterizes a new class of feedback-free 
induced partitions. These partitions also define a 
set of induced maps; moreover, these maps 
provide a feedback-free description of the 
system using the corresponding induced pencils. 
It is important to mention at this point that these 
pencils are nonsquare and invariant under the 
presence of H. Hie use of nonsquarc matrices 
constitutes a new concept in control theory even 
in the state-variable case. This advantage is 
discussed later in the paper. 

In Section 2 we study the closed-loop system 
restricted to a regular partitioned subspace. Our 
main interest here is to present a technique for 
pole placement using general proportional-plus- 
derivativc feedback. It is noteworthy that 
state-variable systems are not closed under the 
action of proportional-plus-derivative feedback. 
On the other hand, singular systems do not share 
this drawback. Consequently, a complete geo¬ 
metric theory can be presented for these kinds of 
feedbacks by exploiting the theory of singular 
systems. This will be accomplished by utilizing 
the geometric notions in Section 2. 

Using the results of the induced partitions we 
decompose the closed-loop system into two 
subsystems. Specifically, in one subsystem 
proportional feedback is used while in the other 
derivative feedback is used. During that 
decomposition our main concern focuses on the 
regularity of the closed-loop system and how it is 
preserved under this decomposition. Subseq¬ 
uently we present some ancillary results which 
guarantee that the closed-loop regularity for the 
original system is preserved under that decom¬ 
position for a class of constructed induced 
partitioned subspaccs. This latter will be called a 
well-defined induced partitic n. In other words a 
well-defined induced partition does not destroy 
the closed-loop regularity of the system. Once 
we decompose the closed-loop system, we use 
two generalized Lyapunov equations to find the 
feedback that assigns the desired poles of the 
two subsystems while guaranteeing the closed- 


loop regularity. The solution to this equation is 
based on the generalized Hessenberg form 
(Verhagen and Van Dooren, 1986), and exploits 
the use of unitary transformations. Finally we 
show that the gains that assign the poles for 
these two subsystems assign the same desired 
poles for the original closed-loop system. 

Under these concepts we proceed in Section 4 
to relate the spectrum assignability problem to 
feedback-free induced partitions. This section 
opens new horizons, not only in singular systems 
but also in state-variable systems for the 
confrontation of this problem using nonsquare 
matrices. Here we relate the geometric concepts 
of the feedback-free partitions and quotient 
subspaces. 

Initially in Section 4 we present some ancillary 
results that will help us in our exploration. We 
show that any nonsquare pencil restricted to a 
partition can be decomposed into two feedback- 
free induced pencils. Moreover we can find an 
equivalence relation between the closed-loop 
system pencil and the feedback-free induced 
pencils. This result immediately focu.ses our 
interest on the use of non.square pencils for the 
spectrum assignability problem. In light of these 
concepts we restrict the feedback-free to a 
regular partition and show how to construct a 
well-defined feedback-free induced partition. 
Specifically Theorem 13 reveals how a well- 
defined partition is related to a well-defined 
feedback-free partition in terms of the decom¬ 
posed subsystems. This result is of great 
importance since it constitutes the key for the 
regularity of the closed-loop system. 

Having guaranteed the closed-loop regularity 
of the system, we next discuss assigning the poles 
using the nonsquarc pencils. Ihis is accom¬ 
plished using the feedback-free generalized Lya¬ 
punov equations, We point out that the.se 
equations arc of reduced order. The solution of 
these equations is also based on the generalized 
Hessenberg form that exploits all of the above 
advantages. Moreover, in the feedback-free 
formulation they do not depend on B. Finally, 
we show how to reconstruct our original 
closed-loop system and how to select the 
feedback gains that assign the desired modes and 
guarantee the clOvSed-loop system regularity. For 
this procedure we provide an algorithm. 

2. SOME GEOMETRIC NOTIONS FOR QUOTIENT 
SUBSPACES 

In this section we present some geometric 
concepts for quotient subspaccs. As we shall sec 
in Section 3, these concepts will lead us to a 
complete theory for the use of proportional-plus- 
dcrivative feedback (PD) in singular systems. 
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Two closely related approaches lo the geometric 
characterization of these subspaces that exploit 
(he notions of quotient subspaces arc con¬ 
sidered. These two formulations arc presented in 
Theorem 1 and Lemma 4. First it is necessary to 
give some ancillary result.s that will help us in 
our attempt. 

Consider the generalized, or singular, linear 
dynamical system 

Ex^Ax^Bu (2.1) 

where x e and u e and E square and 
generally singular. 

We will call (2.1) regular, if 

A(j) = det(j£->t)^0. (2,2) 

Regularity is equivalent to the existence and 
uniqueness of the solution of x(r) given j( 0 ) 
and M(r). The roois of A(.v) arc called the finite 
(relative) eigenvalues of (E,A). These are 
simply the finite zeros of the pencil (sE - A). 
The (relative) spectrum of (£, A) is the union of 
the finite and infinite zeros of (sE - A). Wc 
denote by a(E, A) the finite spectrum of (£, A). 
The spectrum of a single matrix F we denote by 

(7(f). 

In this paper we do no( assume the property 
regularity [i.e. (2.2)] which is too restrictive. 

2.1. Quotient and partitioned suhspaces 

Define //c:as an (A, F, M)-ini}ari(mt 
subspace for (2.1) if it satisfies 

a:/c:F!/ -^ (2.3) 

These subspaces have been used in connection 
with proportional feedback by Lewis and 
Oz^aldiran (1989). 

Similarly, define .7 c: as an (F,A, :^)‘ 

invariant suhspace for (2.1) if it satisfies 

E^c:A!/^96. (2.4) 

These subspaccs have been used in connection 
with derivative feedback by Lewis and Syrmos 
(1991). 

Definition 1. A partition (.7, .T) of if' into two 
subspaces J a ^ is defined as 

A3 clE 5(2,5i 
£.7 eA,7 ^ J (2.6) 

r=.7©."J. (2.7) 

The subspaces y, 3 are recognized as 
(£, i4, S) and (A, E, 98)-invarianl subspaces 
respectively. We shall call S' an invariant- 
partitioned subspacc and denote it as ^ - 
3’Q3. The notion of partition has been also 


considered by Karcanias and Kalogcropoulos 
(1987) from a different point of view, namely 
from the structure of the restricted pencil in 
terms of its Kroncckcr invariants. It has l>ccn 
shown by Karcanias and Kalogcropoulos (1987) 
that every subspace # is an invariant-partilion if 
the pencil |a£ - AB\ restricted to If has no 
nonzero row minimal indices and B is full 
adumn rank. We point out that invariant 
subspaces are a special case of invariant* 
partitioned subspaces. Si>ecifically, consider that 
an (A, £, iiA)-invurian( [resp. (£. A^ iD)* 
invariant] subspaces can be recovered by 
Definition 1 if we set .7 - 0 (resp. 3 - ()). 

Definition 2. A partition (7, 3) is said lo be 
regular if it .satisfies two additional properties 

dim E3 - dim 3 (2.8) 

dim A .7 = dim .7 (2,9) 

Wc shall call a subspacc M c. :f E-regular if 
(2.8) holds for M and A-regulur if (2 9) holds for 

r 

Choosing 7 and S as bases for 3 and .7 
respectively, (2..S) and (2.6) arc equivalent 
respectively to 

AT^ ETE, - H(if (2 10) 

ES-^ASEs flfi\ (2 11) 

for some /v, G/. G’s- Wc have 7 c 
where t “ dim :7 , and S c where a ® 

dim .7 . Tlic.se arc the generalized Lyapunov or 
Sylvester equations. Another well-known defini¬ 
tion (Van Dooren, 19HI) is the following 

Definition 3. ,7 is an (£. Aj-deflating subspacc if 
dim (£7 4 A!/) - dim 7. (2.12) 


We introduce now the following, which 
extends this definition to the case where B 7^0. 

Definition 4. .7 is an {E, A, M)-deflating 
subspace if 

dim (£7 4 A 7 4 BM) - dim 7, (2.13) 

for some ■ 

Having made these definitions, we can start 
our exploration of the quotient subspaccs. In our 
approach wc will need lo extend some of the 
results in (Wonham, 1979) to the case of two 
maps acting simultaneously on a subspace. 

If 7 c X 6 7, define the equivalence class 
X = {y e f :x - y e .7) and the quotient space 



352 


V. L. Syrmos and F. L. Ltwis 


if /y ds the set of all x. llicn the canonical 
projection P ; f'/.y is defined by Px = x. Wc 

may also write jt as x ^ //. Sec Wonham (1979). 

In the next results, wc arc motivated by the 
fact that the equivalence of matrix pencils is 
defined in terms of two constant nonsingular 
maps, one acting on the domain and one acting 
on the codomain (l>ewis ei ai., 1989) je.g. 
QisE - A}P\. 'Fhesc ancillary results will give us 
the first light in our exploration. 


5 


f|4U 


s 




2 


x/s 


E r . 


^ r 


[Qr 

zfs 


Fk^ I. CommuLjitive diagram Jthowmg relalions in Tticorcm 
1 and cquatirms (2.18) and (2.19). 


Lemma 1. Let If c 'rf. and £, A ; I JT, with 
sE - A not necessarily regular. Define // = 
A!f E'f BMf tor some j^/, and let /V. Qr 
be the canonical projections —► i/.'/ and 

Qi‘/J.~^'Sjff, Lhen there exist unique maps 
Er. /Iv :<*/y— ^/y Jiuch that 

ErPr-QrL (2.14) 

ArPr-OrA. (2.15) 

Proof, Let .T be any complement of 1/// so that 
- y 0 ;/. Choose to be a basis for J. 

I'hen, if l-Ptf, ^ basis for f/y is 
where r - dim 5. Define Ef and A, by 

ih ^ Q f (2,16) 

A,l^QjAt,. (2.17) 

To show that Ej is well-defined, suppose 
X, Xj e ^f /y with x, ” jfj. Then x, “ x, 4 // and 
X 2 - Xi 4 .7 for some x, e .7, and Xi 4 V' = x^ 4 
y. or X| - x^ e y. 'Lhus QiE{X\ - x.) e Q,E./ c: 
CL,y = 0. Therefore QrEx, - C/Lx^. 

Now let X c y /y and x - t 4 .s with t e y, 
.vey. Then QrExQrE(f \ s). But QrL:fe 
C/y = (), therefore by (2.16) QrEx-QfEt~ 
Ejt “ E,Pi (t -4 .v) which verities (2,14). 

Similarly we can prove that A , is well-defined. 


be the canonical projections >^Vy. 

Pv: yyy, q, :y/.y e,: 

Then there exist unique maps £7, A j /M'l^f-^ 
y/y and £v /lv:y^y/.tsuch that 


£,/V = QrE 

(2.18) 

ArP, = Q,A 

(2.19) 

EsP. = QsP 

( 2 . 20 ) 

A,Ps = QsA. 

( 2 . 21 ) 

All these relations are given in 

the commutative 

diagrams of F igs 1 and 2. 

■ 


We note that XI f is isomorphic to X 
(y/y^.T) and f/.f is isomorphic to .7 
(,?/;/ y). I'he next step is to examine whether 

the subspaces y, :/ c # preserve their in¬ 
variance properties under the action of the 
induced maps (2.18-2.21) defined in Theorem I. 
The next two lemmas show that this is indeed 
the case. This is important because, as will be 
shown in Section 3, these subspaces preserve 
their invariance property under the action of the 
induced maps. This observation is the first hint 
toward our attempt to exploit this property for 
the spectrum assignability problem, which is 
discussed in the next section. 


The conditions for the existence of the 
induced maps £, and A^ in Lemma I arc 
surprisingly mild; indeed, they always exist since 
£y c: y and A .7 c. ,7. 

In our approach we seek an appropriate 
relation between partitioned subspaces and 
quotient subspaces. This relationship will be the 
most significant result that will inspire us to 
utilize the notions of quotient and partitioned 
subspaces. The following theorem exhibits this 
relationship and offers the first clue in our 
exploration. The proof o( the theorem follows 
easily by Lemma 1 . 

Theorem 1. Let X=XQX and £, y4:Sf->y, 
with sE - A not necessarily regular. Define 
y ^ A y 4 £y 4 and ' y = y 4 ej 4 

for some Now let Pj, By. Qr> Qs 


Lemma 2. Let f=y©:J and £ 7 , Qj be the 
canonical projections ►f/y and 

C7r:y-^y/y Then if is an (^ 7 . £ 7 . 39 , 7 )- 
invariant subspace, where Aj, Ej, are the 
induced maps as have been defined in Theorem 
L and 39 y = Q 


T|E|t, T|4|T 




[r, jo. 

X/T z/r 

Fig. 2. Commutative diagram showing relations in Thecnem 
1 and equations (2.20) and (2.21). 
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Proof Since J is an (A, £, J9>-invariant sub¬ 
space then the following are true 

AJ c: E^f J (2.22) 

QrAJ^QrE f -h Q^dB (2.23) 
A rPjS c ErPjS 4 ifl, (2 24) 

ArS^aEjS d^ dBj (2.25) 

since Py : t ^ Jf /,/^ .f. Note that (2.24) and 
(2.25) differ only in the basis representation of 

.T. ■ 

Lemma 3. Let = ."/© and f\, be the 
canonical projections Ps:!—►#/./ and 
ITien .y is an (Ls.Ay, 3fl^)- 
invahant subspace, where As, £s, are the 
induced maps as have been defined in Theorem 
1 and iiS/ - Qs^ ■ 

In terms of these conditions the gcneraii/cd 
Lyapunov equations for the induced maps can he 


written in the following form 

AjPrT^E.PJF, Hjdr (2.26) 

EsPsS = AsPsSFs - Hsds (2.27) 

Wc can also equivalently write (2.2h) and (2,27) 
in the following form 

Aff^FrfF, Hr(n (2.28) 

EsS„^AsS,,Fs Bsds (2.29) 

Observe that the.se two diflerent bases of ,/ and 
are related as follows 

7 ; - r,T (2 .^ 0 ) 

s,, = rsS, (131) 

where P, and /\ have full row rank t and o 

respectively. 

At this point we have to bring up some 


remarks for the generalized Lyapunov equations 
(2.10), (2.11) and (2.28), (2.29). Our interest in 
these equations arises from the fact that they will 
be the key for spectrum assignability with PD 
feedback. This becomes clear in the proof of 
Theorem 2, while in Section 3 it is evident. The 
first pair of equations (2.10), (2.11) imposes 
another condition, that is :/nj=i), which 
follows from the formulation of the problem 
That is, the solutions to (2.10) and (2.11) are 
coupled. On the contrary, in the second pair of 
equations, (2.28) and (2.29) this condition is not 
impo.sed. For this reason (2.10) and (2,11) will 
be called the coupled generalized Lyapunov 
equations, while (2.28) and (2.29) will be called 
the uncoupled generalized Lyapunov equations. 
These remarks close the first formulation of the 
notions for quotient and partitioned subspaccs. 
The second one is given in the sequel. 


2.2. A feedback-free approach for quotiem and 
partitioned suhspaces 

Let N be the left annihilator of B, and be 
the Moore-Penrose inverse of B such that 
B* B ^ /^. Then (2.1) can be wriitcn m 

NEi - NAx (2.32a) 

u(()=«^(£i - Aa). (2.32b) 

Therefore the solutions of (2 1) are charac- 
lerized by the solutions of (2 32a), since the 
solution w(/) to (2.32b) always exists. NVe call 
(2.32) a feedback-free description of (2.1) since 
the solutions of (2.32a) are independent of 
This formulation will be one of our interests in 
the paper and will be discussed in Section 4. In 
order to study the feedback-free description of 
(2.1), wc will need .some preliminary results 
which are presented in the .sequel. 

Define L~NF and M ^ NA, then wc can 
extend our results for the map a£ - A to the 
map sL - M as follows. Phis extension will later 
lead us to characterizations of feedback-frcc 
partitions which arc of great importance. 

Lemma 4. Let .f - ,'/0./ and L, 

Define ~ /-// 4 M'/\ and - L:!i 4 MJ. Ixi 
P\^ Civ be the canonical projections 

Pj ; T t/!/, 7\ ; T - /:T, C>i ■ '► VV', 

(),s Then there exist unique maps 

I f, T7.7 and Ls, 

such that 

L,V,-Q,L (2.33) 

(2.34) 

(2.3.*;) 

MsPs^QiM (2.36) 

These results correspond to the commutative 
diagrams in Fig 3. ■ 

At this point we note that for the maps L, M 

the equivalent invariance properties for ;/ and .7 
have been transformed to (Af. £)- and (/,, A#)* 
invariance respectively. These properties arc 
invariant under the action of the induced maps 
defined in I>emma 4, as is evident from the 
following results. The proof follows easily and 
therefore is omitted. 

Corollary 1. l^t 0 .7 and Pf, Qj be the 

canonical projections P, : If.H I and 
Then J is an (Af/, £/)-invariani 
subspace, where Af/, /./, are the induced maps 
as have been defined in Ixmma 4. ■ 

Corollary 2. Let ^ = 70.7 and /\, .7 be the 
canonical projections Ps —► HUif and .7: Y 

Yl§. Then ,7 is an (£.v. Afv)“invarianl subspacc, 
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r 

i'*r i-V- jw. 

Lr »4t I, » 

xis .► v/j> x/r .^ v/T 

f U( 3 ( ominulativc (Jia|f,ram showinji* rclalioris in Lemma 4 

where /.v, Ms, lire the induced maps as have 
been defined in Lemma 4. ■ 

In order to complete the relation between all 
these siibspaces we seek a well-defined map 
iV/ :://// -"♦ I 7 .V. The next lemma defines such a 
map. 

l.ernma 5. Ixl 1 " ,7 0,/ and Let 

also Qf, Q, be the canonical projections 

and Then 

‘tyi:/ is well-defined, that is 

OiN^NrQr (2-37) 

This relation is stiown in the commutative 
diagram in Fig. 4 

Proof. Let ./ be any complement ot 7 / 7 so that 
~ 7 © ,7 Lhoose [(,)' 1 to he a basis for J. 
7'hen if, i, - Pt,. a basis for :7/.7 is {r,,, where 
r - dim 7 , define N, by 

N,l = QjMt. (2.38) 

To show that Nf is well-defined, suppose 

i,. ij 6 J/:/ with VI - I'heri i, “ x , f .7 
and i > - A . f 7 for some v, e and . 1 , -f .7 ~ 
A i f 7. or A , ~ A , c 7. rhus C^//V(y, “ a .) e 
QiN9 c(.), 7 - 0. rtierelore C^^/Va i - 0//Vaj. 

Nr)w let X c 7/7 and a = t 4 v with r c 7, 

A t .7. Then (},/Va - (),A'fr 4 v). But (7/^7 6 
0,7 ~ (), therefore by (2 3S) (),/Va ^ (7, A//- 
/V’,7 - A/,0/(7 4 ,v) which verifies (2.37). ■ 

N 

z -V --* u 

i-Jr |g, 

z/s v/s 

Fi<i, 4. ( ommuliidvc Lliagr.im showinj; relations in 
Lemma S 


jo. i<j. 

Z/T --. V/f 

Fki 5. Commutative diagram showing relations in 
l x mm a 6 


The corresponding result for the connection 
between ‘Ijff and 17:T is given in the following 
lemma. 

Lemma 6. Ix‘t 7=707 and Let 

also Qs, Ov be the canonical projections 
0v:7'—7/.f and Then yVs;7/.7-^ 

777 is well-defined that is 

QsN = N,Qs ( 2 . 3 ^^) 

This relation is shown in Fig .S. ■ 

By the definitions of the induced maps the 
following relations hold true 

L, (2.40) 

M, = N,Aj (2.41) 

/-s-^.sL.s (2.42) 

Ms^ Ns A,. (2.43) 

All the relations that have been defined in this 
section are summarized in the commutative 
diagram Fig. b for //./ and in f ig. 7 for 7/ J. 



Fici. 6. C'ummutulivc diagram summarizing all relations for 

t/J. 
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F'Ki. 7. Commutative diagram summan/mg all relations (or 

r/:/. 

2.3. Partitions, induced partitions and their 
properties 

Since the partitioned subspaces are of great 
irnpcmance in our theory, along with the 
quotient subspaces which arc the key tools in 
this geometric approach, we point out some 
interesting properties that a partitioned subspace 
enjoys. Moreover these results will bring 
together the quotient and the partitioned 
subspaces. In this attempt we will need some 
new definitions. 

Define ? as an induced mapping partition if it 
satisfies 


A jS cz “f :#> (2.44a) 

^ (2.44b) 

1 - ,7 © :7, (2.4fi) 

= (2.46a) 

Ar^ = ^*As. (2.46b) 


where A j, Ej, As, Es Jire the induced maps as 
defined in Tlicorem 1. Moreover, as it has been 
shown by Syrmos and Lewis (1991), (2.4^>) 
guarantees that the structure of the Kronecker 
invariants is not destroyed under the action of 
this decomposition. 

Similarly define as a feedback-free induced 


map partition if it satisfies 

MjS^LfS (2.47a) 

LsfezMs!/ (2.47b) 

.r=,7©.7, (2.48) 

Lr<t> = ^Es, (2.49a) 

Mr4> = VAf.v, (2.49b) 


where Mj, Lr, Ms, Es are the induced maps as 


defined in Ixmma 4. Similarly (2.49) guarantees 
the Kronecker structure of the decomposition. 

Ilic next theorem exhibits some of the 
properties that these partitions enjoy. Actually, 
we will concentrate on the induced mapping 
partition since it is the one that we will use more 
frequently later on. Note that the next theorem 
holds for each one of these three partitions; that 
is the panitions .satisfying (2.5-7), (2 44 46) and 
(2,47-^48). Wc jwini out that this theorem 
through its pnH)f indicates the use of the 
generalized Lyapunov equations for the 
spectrum assignability problem using PD 
feedback. 

Theorem 1. f “ ./ © J is an induced mapping 
partition if and only if for any .r(0 )c f' there 
exi.sts an input u(f) such that: 

(i) jr(f) 6 f for t >0, for some u(/) 

(ii) The Laplace transforms of A(t), w(r) 
restricted to are strictly projKT. 

(iii) The Laplace transforms of i(t), u(t) 
restricted to .7 have no poles at the 
origin 

b/ote. For comparison of (ii) and (iii), note that 
a strictly proper transfer function has no poles at 
infinity. 

Proof, {Necessity) l.^M S, T provide us with 
bases for 7, :f respectively, 'fhen the general¬ 
ized Lyapunov equations (2.10) and (2.11) after 
some manipulation can also be written in the 
form 

(sE~A)r{sl, - 7;) ' 

^ ET ^ IHiAsIr -Ej) ' (2 .50) 

(E~s ^A)S(Fs-s ^ 

-A5 f flO\(7; - .V ‘AJ ’ (2.51) 

with .V a complex variable. Prcmultiply (2.50) 
and (2.51) by Qj and Qs respectively, where Qi 
and Qs have been defined in Theorem L Taking 
into account (2.18-21), (2.50) and (2.51) 

become 

(i£, - A , )PJ(sT ” Er) ■ 

^ ErPj'r + ^idAsi, - F,y ' (2.52) 

{£,- X 'As)PsS{F,-s 'l„) ' 

- AsPsS + lisGAPs - V '/„) (2.53) 

Then by using (2.30) and (2.31) in order lo 
change the basis representation for .T, we 
have 

(sEj -A,)TAsl,-Fr) ' 

= EjT, -t- ttrOAsl, - Erf' (2.54) 

(£v-.T'A,v).V„(/s-s '/„) ' 

- As.V„ + flvQy(£i - .V '/„) '. (2.55) 
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Restrict (2.1) to 3 and take the Laplace 
transform of the restricted version. Then (2.10) 
bcaimes 

{sE - A)Xj($) = Ex,(ir ) + (2..%) 

where A' 7 (.v) and ili\s) are the restrictions of 
A'(.v) and U(s) on J with respect to (w.r.t.) 7 
basi.s. Now take a Laplace tran.sform (denoted 
L(.)] of ( 2 . 1 ) defining 


Hx) = X'i.c) 

(2.57) 

L(x)^.s '{X'(s) + j x(l)iil). 

(2..58) 

7 hen ( 2 . 1 ) restricted to .7 becomes 


(E - .r ‘/»)Ar.((.v).v = Axs(yy ) + bUs(s)s, 

(2.59) 

where A'((.v) and Vs(s) are the rc.striction.s of 
A"(.v) and U{s) on .S' w.r.t. to .S ba.sis 


representation. By prcmultiplying now (2.56) 
and (2.59) by Q, and C^v respectively and using 
the same reasoning as above (2.56) and (2.57) 
become 

(sE, - A, )Xr.(s) - E,XrM) ) + «,f//,(.v) 

(2.60) 

(Tiv “ A 'v4,v)''’v,(.v)i- = /1 jc,v„(0 ) + BsU,y (s) 

(2.61) 

where A",,, f/,,, and A',v„, Us„ are the restrictions 
on .T, .'/ respectively w.r.t. 7', and S„ ba.scs 
characterization By comparing (2.60). (2.61) 
and (2.54), (2.55) it is .seen that the Laplace 
transforms of .t(f) and u(l) restricted to If arc 
strictly proper and that the Laplace transforms 
of jf(() and u(l) restricted to .7 have no poles at 
the origin. Moreover it is clear that .v(f) e '# for 
f^O. 

(Sufficiency) If for every jr/((l )e .T there are 
strictly proper rational «(/) and aft) restricted to 
:f that satisfy (2.1) and x,(t) = EjXf(f)~ 

P,Tx(i) 6 'f' Ihcn 

A'r.=.r ' S>tV,.s '. U,_^s ' V u' ,v ' (2.62) 

» .() 1-0 

with all I'V, £ '^ r »nd (2.W)) shows that 

= ) (:.63a) 

E,rV, Hru'l. (2,63h) 

If is a basis for :f. then (2.63a) shows that 
£/ “ KyT, and (2.63h) shows that 

- BjCr 

^Erhr-ErOr (2 64) 


for some Fj and Gj. According to (2.28) this 
identifies 3^ as an (Ar* £7 , )-invariant 
subspace. 

Similarly we ciin prove that cV is an 
(Es, As, )-invarianl subspace, which com¬ 
pletes the pr(K)f. 

Concluding the proof we address the interest 
of the reader to equations (2.54) and (2.55), 
where the terms {sl^ - Fj) and - * ^ 4 ) are 
presented. As we will show in Section 3 the 
spectrum assignability depends on the selection 
of Fs and Fj in (2.28) and (2.29). ■ 

A problem that will arise in the next section is 
the regularity of the closed-loop system under 
the action of PD feedback. The partitioned 
subpaces as well as the quotient subspaces are 
closely related to regularity, as we shall sec. The 
next theorem will provide us with the tools to 
confront the closed-loop regularity problem. 
Moreover, it justifies the choice of the particular 
quotient subspaces which we have used in this 
section. 

Theorem 3. Let 7. I hen the following 

are equivalent: 

(i) .7, 3 is a regular partition. 

(ii) 


dim {tl:f + A J + ;-i0) = dim ;f + dim 

(2.65) 

dim (E'f + A./ + :)8) = dim .7 + dim .iSv, 

( 2 . 66 ) 

for some ;49/,, given by 


39/, c E J © S 

(2.67) 

.99,s-c/1.7 © 

( 2 . 68 ) 

= :i9/, © .30 / , 

(2.69) 


(2.70) 


Before giving the proof of the theorem let us 
comment on condition (ii). This is a technical 
condition that seems cumbersome at first glance. 
As we shall see in the next section, condition (ii) 
is the key to relating the open-loop properties 
we are discussing here to the properties of the 
closed-loop system. 

Proof. (i)4^(ii): Assume that J is a regular 
partition then 

dim EJ = dim 3 (2.71) 

dim A3 - dim (2.72) 

But also since is a partition we have 

A J + 39x2 c E3 ® 38Xj 
E3 T 39^, c A3 © 38.V, 


(2.73) 

(2.74) 
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Then the following holds true: 

dim ({AJ^ Mr) n (EJ® Mr)) 

= dim(A J Mj) (2 75 ) 

dim((£y>a^)n(Ay©av,)) 

= dim(£y 4 Jv ). (2.76) 

Taking into account (2.71) and (2.72) then (2.75) 
and (2.76) become 

dim (A^' 4 38^;) 4 dim (£ J © ;^y^) 

~ dim (E J 4 A J 4 i#) = dim (A J 4 j 8 ^ ) 
dim (£y 4 JVj) 4 dim (A y © J 8 .v,) 

- dim (£y 4 Ay 4 J) = dim (EJ 4 ,j 8 v,>. 
or 

dim J 4 dim 387 ^ = dim (£\f 4 A ^ 4 M) 
dim y 4 dim Ss, = dim (EJ 4 AJ 4 J 8 ). 
(i)<^(ii): Straightforward. ■ 

Theorem 3 and specifically condition (ii) will 
be of .significance in our approach for the 
regularity of the closed-loop system under the 
action of PD feedback. Moreover, condition (ii) 
is the key for the construction of induced 
mapping partitions that preserve the property of 
regularity. 


3 PARTITIONED .SUHSPACES, QUO I lENT 
SUB.SPACE.S AND PROPORTIONAI. PL US 
DERIVATIVE FEEDBACK 

In this section we show how the partitioned 
subspaccs, which constitute open-loop charac¬ 
terizations, give information about the closed- 
loop system under proporlional-plus-derivativc 
(PD) feedback. We shall study how we can 
tran.sform these partitioned subspaces to induced 
mapping partitioned subspaces using the notions 
of the quotient sub.spaces. Moreover, we 
guarantee the regularity of the closed-loop 
system on these subspaccs. We show how to 
construct induced mapping partitions which 
preserve the closed-loop regularity of the 
system. As a result, we shall be able to solve 
Lyapunov equations that are equivalent to those 
of (2.10) and (2.11). Specifically Theorem 7 
desginates a computationally stable method for 
the calculation of and ^ 7 , that guarantees 
this equivalence. This cc^mputation is done in the 
very beginning of our design technique for 
spectrum assignability, which is based on the 
solution of the uncoupled generalized Lyapunov 
equations. Moreover we present a technique that 
constructs PD feedbacks for the desired 
closed-loop behavior of (2.1). This design 
technique is based on the generalized Hessen- 
berg form. Therefore it is easily implemeniable 


and compulaiionally stable. At the end of this 
section, Lemma 7 shows that the closed-kK>p 
spectrum assigned by the solutions of the 
uncoupled generalized Lyapunov equations is 
the same as those of ihe anipled ones. In order 
to achieve this goal we first present Si>mc 
preliminary results which will help us in our 
endeavor. 


.41. Partitions and PD feedback 

If the PD feedback 

N - - K^x f A'jji (3.1) 

is applied lo ( 2 . 1 ), the resulting closcd-lm^p 
system is 

(E ^ HK)x ^ (A A HK)x. (3.2) 

Even ii £ /, (3.2) may not be a state- 

variable system since (£ 4 RK.) is generally 
singular. Moreover in the case where £ 4 RK^ is 
ill conditioned it is wise lo avoid its inversion 
and study the closed-loop system as a singular 
system. 

The next result shows how lo use the 
Lyapunov equations (2 10), (2.11) or the 

Lyapunov equations (2.28), (2.2^) lo construe! a 
PD feedback lhal provides a certain closed-loop 
invariance property. 

Theorem 4. .f - 7 .7 is a partitioned sub- 

spacc, or equivalenlly an induced mapping 
partitioned subspace, if and only if Ihcre exist 
A,, A., such that 


(/I 4 BK,)y c. E.r 

(.1.3) 

(E 4 BK,)./cA:f, 

(3.4) 

(tr equivalently 


(A, 4 BrK,)Jc E,:‘i 

(.3.5) 

(/•v4 «vA.\)'/c /1,.7 

(3.6) 

Broof. IxM .S', T be bases for respectively 

and Fs. (is, E,. (i, satisfy ( 2 . 10 ) and ( 2 . 11 ). 
Select the feedback gains as 

IG, 01 = A',|7 .V| 

(3.7) 

(0 (is] = K,\T .V) 

(3.H) 


so that A,.S == A./ - 0 . Then (2.50) and (2.51) 
become 


(st: - (A+ BK,))Usl, - f;) ' - ET (3.9) 
({E ^ BK^) ~ s 'Amh], - s 'l„y ' = AS. (3.10) 

Also equivalent to (2.50) and (2.51) arc (2.54) 
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and (2.55) which can be written as 

u t, - (A r ^ BjKj ))TAsl - ' - EjT, 

(3.11) 

{(Es -f BsKs) - s ^As)SAE^ ».V VJ ‘ = >4,5,, 

(3-12) 

where Tj and S„ is another basis rcprcscntalictn 
for J and respectively. Note that Kj - K^Pj, 
Ks-KiPs, where Pj, P^ are the Moore- 
Penrose inverses of Pj, P\ respectively. 

ITius (3.9-12) along with Theorem 2 guar¬ 
antee (3.3“6). The converse argument follows 
easily. ■ 

We emphasi/e that the proof of this theorem 
provides an extremely convenient design tech¬ 
nique for PD feedback, since it relies on the 
solutions of the generalized Lyapunov equations. 
Moreover, the terms (sl^ ~ Pj) and {Fs ~ s '/„) 
in (3.11) and (3.12) exhibit the impi>rtance of Fj 
and Fs, in (2.2H) and (2.29) for the spectrum 
assignability problem. These terms assign the 
closed-loop trajectories of (3.2) on the subspaccs 
// and . Finally, Theorem 4 shows the relation 
between different representations, that is be¬ 
tween (2.10)/(2.11) and (2.2H)/(2.29), which we 
shall soon discuss further. 

Note that we make no claim on the regularity 
of the closed-loop system (3.2). In fact, the next 
results show that certain conditions must hold in 
order to ensure the regularity of the closed-loop 
system (3.2) (ui f. 

Theorem 5. Let f - .7 0:/ he a partitioned 
subspace. Define any K^, such that 

A',.V - K/r - 0. Then the pencil [s(E f HK^ ~ 
(A 4 WA'i)! is of full rank restricted to f if and 
only if ls(E^ BK 2 )~A\ and [sE ~ (A BKA\ 
are of full rank restricted to ./ and J 
respectively. 

Proof. Consider (t,}/., | and i as the bases 
for J and y respectively. Since :f~ .7 © y then 
we can choose a basis for 7 the set 

X,^ {I . . . i-,,}, I 6 (1,.... x) where 

X - dim 7 . 

If the pencil |.i'(fi 4^ WAi) - (.4 + WA,)] is of 
full rank on 7, then choose a basis for 7 as 
above and select s e 7. - [s(E 4^ BKy), (.4 4- 
flA,)]. then we get 

ls{E + BK.) - (A 4 «A,)).r. = (3.13) 

where h\ are linearly independent. Let us now 
impose the condition KyS - KjT = 0, keeping in 
mind the structure of the basis for .f clearly 


(3.13) becomes 

ls(EBK 2 ) ~ A\s, - ie{\, . . , a) 

(3.14) 

(.i'A - (i4 4 flA,)]/,= w,, i e{L . r t} 

(3.15) 

where the sets <*nd consist of 

linearly independent vectors. 

Conversely using (3.14) and (3.15) and taking 
into account that yTiy = 0, that is the sets 
{^n-rir-i and span two different 

subspaces that have the properly I/ O = 0. ■ 

From the above theorem we are led directly to 
the next theorem which displays the conditions 
for regularity of the closed-loop system. 

Theorem 6. Let be a partitioned 

subspace and A^, A^ satisfy (3.5) and (3.6) with 
KiS- K^T = 0. Then the closed-loop system is 
regular if and only if ( 7, 7) is a regular 
partition. 

Proof. Note that from Theorem 5, it is 
equivalent to show that \s(EBK 2 ) - A] and 
\sE -(A 4 WA,)] are of full rank restricted to .7 
and respectively. Equations (2.10) and (2.11) 
show the existence of a solution for every 
jr(() )e 7. This is independent of Gy. G/ and it 
is unique if and only if there arc unique solutions 
to (2.10) and (2.11) for Fs, Fj. That is ET and 
AS have full column rank or equivalently 
dim E'J dim J and dim A!/ = dim 7. There¬ 
fore 7 is identified as a regular partition ■ 

At this point, it is clear that for every partition 
(7, 7) that satisfies one of the conditions in 
Theorem 3 there will always exist a PD feedback 
that guarantees the closed-loop regularity of the 
system on 7. Specifically, derivative feedback is 
used on 7 and proportional feedback is used on 
J. 

3.2. The cofistruction of a well-defined partition 
It is important now to see how the property of 
regularity of the closed-loop system of a 
partitioned subspace is interpreted for an 
induced mapping partitioned subspace. This will 
be of significance since our final goal is to find an 
equivalent closed-loop system for which we can 
solve the generalized Lyapunov equations for 
the pole assignment problem. This need arises 
from the fact that these equations for the 
original closed-loop are cumbersome from the 
point of a stable computational solution, since 
they are coupled. The next theorem demon¬ 
strates under which conditions we can use 
equations (2.28) and (2.29) without destroying 
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the closed-loop loop regularity of the system as 
has already been defined in terms of equations 
(2.10) and (2.11) in Theorem 6. Specifically we 
seek conditions on 9 and S' such that the 
induced mapping partition is well-defined, that 
is, it preserves the closed-loop regularity. 

Theorem 7. Define a partition such 

that J and 5/ arc (£, A, ^)-deflating subspaccs 
and choose any where KyS = = 0 . 

Then the pencil [5(£ + BA^) - (ASA'i)] re¬ 
stricted to ST is of full rank if and only if the 
pencils [j(£v + BsKs) - A^j and I.y£/ - (A y 4 
BtK, )] restricted to ^ and J respectively are ol 
full rank, where Ay, A/, £v, £/ define an 
induced mapping partition. 


Proof. Define 9\ S as 


J = A?J ^ EJ ^ B ff r 

(3.16) 

9'^ AltElf + 

(3.17) 

such that 5, .T, .7 satisfy 


dim If = dim 9 

(.3.18) 

dim .7 = dim 9. 

(3. Id) 

Choose as in 'rheorem 5 (/,},' i. 



be bases for , .V and I respectively. Since the 
pencil {s(E 4 BA^) - (A 4 BA,)] is of full rank 
restricted to (3.14) and (3,15) hold true. 

Prcmultiply (3.14) by Qs and (3.15) by Q, Then 
by using also (2.18-21), (2.3(1) and (2.31) wc gel 

\s(Es 4 BvA.s) “ As].v„, = C?vH^ 

/e (1. a) (3.20) 

(.vty- — (A 7 4 B J K p)]t j = Ql^\f 

.t} (3.21) 

where clearly {.v,,);'., and i iitc bases for !/ 
and T respectively. The pencils \s(Es 4 BvAv) - 
A y] and [.^£ 7 --(A^ 4 B, Ay)] are of full rank 
restricted to and .3^ respectively if and only if 
rank Qs ~ o and rank Qt - But this is always 
true by the construction of the induced maps, 
that is (3.18) and (3.19) always hold. The 
converse follows easily by using (3.20) and (3.21) 
and the same reasoning as before exploiting the 
fact that ^ n J = {). ■ 

Theorem 7 is of importance since it provides 
us, by construction, with regularity conditions 
for the closed-loop system in terms of an induced 
mapping partition. In order to clarify this 
statement note that we can construct different 
classes of induced mapping partition. This 
freedom is due to the fact that we can arbitrarily 
pick y and S in Theorem 7. Therefore Tbeorem 
7 “chooses” the class of induced mapping 


partitions lor which the closed-loop regularity is 
guaranteed. Let :f “. :/©'f be a partition 
defined as in Theorem 7. Ibcn if there exists an 
induced map partition such that 

dim {EjS, 4 A 4 B, A;) 

-dim(£;f 4 A .f 4 B;ir 7 ) (3.22) 
dim(£v/;, 4 Ayy, 4Bv.#;/) 

- dim (£y 4 A.7 4 BJAy) (3^23) 

or equivalently 

rank (Ej 7] 4 A 7 /, 4 B 7 //J 

= rank(/;7 4 A.) 4 B/Jj ) (3 24) 

rank (£v Si 4 A sS], 4 B y/A/) 

-rank(£S 4 A5 4 Blfs) (3.25) 

S' will be called a welbdefined partition. Thus, 
wc can always construct an mduc'cd mapping 
partition that guarantees the regularity of the 
closed-loop system. Theorem 7 shows how to 
construct such an induced mapping partition, 

We point out that the calculation of ;Av and 
is of critical impr^riance, since it iiulicules the 
choice of .7 and :J ftir which the induced 
mapping partition is well-defined. We designate 
that the calculation ol //y and //y has to be 
performed at the lu‘ginning of the proposed 
design technique in order to construct a 
well-defined partition. 1 he construction of this 
partition is closely related to the choice of //y 
and //y that directly involves condition (ii) of 
Theorem 3. It follows that the selection of such a 
partition is not unique but there exists a class of 
well-defined partitions, that is the induced 
partitions that are constructed according to 
Theorem 7. All these notions will be made 
clear by presenting a computationally stable 
algorithm for the calculation of 7/^ and //y that 
satisfy (3.18) and (3 19), which we now do. Once 
//v and //y have been selected (he construction 
of the partition follows 

The construction ol a well-defined induced 
partition is closely related to condition (ii) in 
Theorem 3 as we have already mentioned. This 
will be evident by prc.senting a computationally 
stable algorithm for the calculation of such 
induced partitions. The first step to this 
algorithm is the compulation of //^ and Hj that 
satisfies (3.18) and (3.19). 

Define a partition such that 

dim(A:f 4£:7):^ dim y (3.26) 
dim (A ./ 4 £y) :< dim y, (3.27) 
Then according to Theorem 5 there always exist 
Hj and 77s siuch that 

dim {AS 4 £.T 4 BiT/) - dim J (3.28) 
dim (Ay 4 E.9 4 = dim 9. (3.29) 
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Define now column operations J, and /y on B so 
that 

J4 = \BJr, BJr,\ 


-!»/, B,,\ (3.3()) 

= [flv, flvj, (3.31), 

with Br^ and Av, 

^39 = £:feud,. (3.32) 

fcV/4 ©38.V, (3.33) 

which implies that 

(3.34) 

%.c>iy©r^,,- (3.35) 


This can be performed in a simple and effective 
way by checking the column rank of B. 
Therefore this column operation is a simple 
shuffle of the columns of B, where on each step 
we check the rank of the specific columns. Now 
choose as Hj * Hs any columns of J, . Js such that 
the following conditions hold true 

dim {A S f 3^ BW,)-- dim J (3.36) 
dim {A!/ -f £// 4^ HM,) = dim !/ (3.37) 

for the specific choice of and as has been 
defined. But (3.36) and (3,37) guarantee that for 
the specific selection of Hj and //y, (3.18) and 
(3.19) hold. Thus this technique, which is based 
on row operations on B (i.c. computationally 
stable operations), completely defines and 
computes the "Hfj and so that (3.36) and 
(3.37) hold Iruc. Specifically, this procedure 
defines/computes ff and as they have been 
defined in Theorem 7. For these 9 and 9 which 
the induced partition is well-defined as follows 
from Theorem 7. 

The algorithm for the conslruclion/com- 
putation of a well-defined induced mapping par¬ 
tition is given below. 

Algorithm 1 

Step 1. Define a partition (./, :7) such that 
(3.26), (3.27) hold true. 

Step 2: Perform row operations on B as defined 
in (3.28-31) and compute Hr and Wy. 

Step 3; Compute 9 and if by using (3.16) and 
(3.17). 

Step 4: For the computed 9 and .1 calculate /\ , 
Qs and Py, Qr as defined in Theorem 7. 

Step 5: Using equations (2.18-21) compute £y, 

i4\, t. f, A f. H 

It is now clear from Theorems 1 and 7 that Ey, 
As, Ej, Ar which arc computed by using the 
Algorithm 1 constitute a well-defined induced 


mapping partition for the original (y, .T) 
partition. 

The following remark goes a long way toward 
showing the relation of the constructed well- 
defined partition and the reduced order propor¬ 
tional state-variable feedback. The application of 
a PD feedback on such a partition can be 
decomposed to the application of two reduced 
order proportional state-variable feedbacks one 
acting on and the other on 

This observation follows from condition (ii) of 
Theorem 3 and the notions that arc presented in 
l^wis and Oz<;aldiran (1989). 


3.3. The spectrum assignability problem 

It is clear from our discussion up to this point 
that the solution of the generalized Lyapunov 
equations is extremely important for the pole 
placement problem using PD feedback. Through 
Theorem 4 it became evident that the choice of 
Ps and Ff assign the closed-loop trajectories of 
(3.2) on the subspaces ./ and J respectively. 
Specifically given the desired closed-loop trajec¬ 
tory on these subspaces, we define Fy and F, that 
give this desired behavior of the closed-loop 
system Moreover once £, and Fj are specified 
using the generalized Lyapunov equations we 
find and 7, On these subspaces the 
closed-loop spectrum is assigned. But the 
solution of these equations defines and Cj 
the knowledge of which will lead us to the 
construction of a PD feedback that assigns the 
desired spectrum. 

At this point wc will show that solving the 
uncoupled generalized Lyapunov equations 
(2.28) and (2.29) is equivalent to solving the 
coupled (2.10) and (2.11). The terminology 
“coupled and uncoupled" has been justified in 
Section 2. Recall that an extra condition that is 
imposed on (2.10) and (2.11) is -VTl J = 0. This 
condition is not imposed on (2.28) and (2.29). 
Therefore the independent solutions of (2.28) 
and (2.29) will lead us to the solutions of (2.10) 
and (2.11). 

Consider a partition and an induced mapping 
partition constructed as in Algorithm 1. Define 
the projection matrix 

where P e /\ e and Pj e Then 

Ps and P, have full row rank since they arc 
canonical projections as defined in Theorem 1. 
Specifically rank Py = a and rank Py = r. 

Consider now- X = \S 7] to be a basis for 

= y O , then 
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But since Ps: ♦ -* ^/-f ® .9' and Pj : H -*■ # /y a 
5, PsT = 0 and P,5 = 0. Hence (3.3<i>) beaimcs 

PX^{PS pr)-(‘);’ ‘') (3.4<)) 

or 

X~{S r).p*(^" “). (141) 

Equation (3.43) implies that given .V,, and we 
can find the solutions A' = \S 7). Therefore 
solving (2.28) and (2.29) is equivalent to solving 

(2.10) and (2.11). 

It is now evident that assigning the poles using 
(2.28) and (2.29) is equivalent to assigning the 
poles of the closed-loop system using (2.10) and 

(2.11) . This last observation demonstrates the 
importance of the quotient and induced mapping 
partitioned subspaces. 

In order to achieve our goal we have to find A,, 
and on which the closed-lcHip system is regular 
and on which the desired poles of the system are 
assigned. In this attempt we will need some 
well-known results which are briefly stateti in the 
sequel. 

The subspaces .7, .7 of a well-defined partition 
are (Ev. y4v, and (A,, E,, jO, )-invariant 

subspaces, and are closed under addition, so that 
each one has a largest member We symbolize 
the supremal As,, ;7)v )-invarianl subspacc as 
,7* and the supremal (/I,. E,, n )-invariant 
subspace as 7 ^ I'he next theorem shows how to 
compute .7* and (Wong, 1974) 


Theorem K. Consider the lollowing subspace 
recursions 


• 

II 

4 .^/l, ). With 




(3.42) 

1 — Fs '(As; 

\ 4 with 

i) 



(.3.43) 

then .y* = Y„ and . 

y: = A-, 

■ 


As an alternative to (3 42) and (3.43) and 
ff* may be computed by the numerically 

convenient Singular System Structure Algorithm 
(Lewis, 1986). 

3.3.1. The induced pencils. C onsider a parti 
tion (y, .T). Define the causal pencil of (2.1) as 

F(s)^[sE~A B], (3 44) 

and the anticausal pencil of (2.1) as 

D{z)-=[E-zA zB], (3.45) 

where z= 5 ’'. Having computed a well-defined 
partition using Algorithm 1, that is we 

constructed Es, As, Ej and Aj while (3.28) and 
(3.29) hold true, then define the induced causal 


pencil of a well-defined induced partition as 

IUs)-[sEr-A, Hrl (3.46) 

and the anticausal pencil as 

DJ^)-\E, zAs zBsi (3.47) 

Define also the closed-l(K>p induced pencils of a 
well-defined induced partition as 

P‘.Us)^\sF., ~{Ar-^BrKr)\. (-V4H) 

and 

= (3.49) 

The proj>erlies of restricted pencils have been 
studied extensively (Ganimacher, 1959; Jaffe 
and Karcanias, 1981; Van Dmiren, 1979, 1981). 
In our approach we (x>int out some of these 
properties in order to exhibit their significance in 
the problem of PD feedback 
We have already pointed out that derivative 
feedback is used on ,7. Equation (3.12) indicates 
that the finite poles of the clo.sed-loop that are 
assigned with derivative feedback are given by 
the reciprocals of the nonzero eigenvalues of Es. 
Moreover, the pi)lcs at infinity have degrees 
equal to the lengths, minus 1, of (he zero 
eigenvector chains of E (i e, the sizes of the zero 
Jordan blocks of Es, minus one) I'hat is, on .7 
the finite closed Ump poles arc the recipriKals of 
the finite modes of ly/jz), while the closed-liHip 
modes at infinity arc given by the zero 
elementary divisors, minus 1, of /);i(z). lliis 
definition is consistent with the point of view of 
Pugh and Ratcliff (1979) 

Wc may now explore the possibility of 
selecting the closed-loop modes on a given 
partition (.7../) by PD feedback, which 
amounts to selecting Es and E, with desired 
eigenvalues in (2 if)) and (2.11), or equivalently 
in (2.28) and (2.29), once (7, J) have been 
specified. 

Our technique of solving the generalized 
Lyapunov equations requires the knowledge of 
the unreachable modes of the induced pencils 
(3 46) and 3.47). Fhe matrix pencil theory along 
with the geometric theory can solve this 
problem. 

Define the finiie unreachable modes of (3.46) 
as 

ol(ErsAj) 

= {ae a(Ei, Aj) \ rank (PJs))< r), (3.50) 

and the finite reachable modes of (3.46) as 
a^{Er,Ar) 

= {O' 6 oiFr. Ar ) \ rank (/’...(.v)) = t). (3.51) 

Similarly, define the finite unreachable modes of 
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(3.47) as 
cTyftvi ^,v) 

= (ore a(Ev.>4A)|rank(/J,„(2))<a), (3.52) 


and ihc finite reachable modes of (.1 47) as 
crliEs, A,) 

= 10-6 fj(£v, As) I rank (D,„( 2 )) = a). (3.53> 


By using the algorithm proposed by Van 
Dooren (1981) the induced pencils (3.46) and 

(3.47) /^,„(a) and M„( 2 ) can be transformed to 
the form 


( slir^Ar 0 d 

• sE^t-Ar 0 
. sE'r-A\ sE']-A') 


(» 

0 

(3.54) 


( E; - zA's 0 0 

* E's “ zA's 0 

♦ - zA s F s 



(3..55) 


where * denotes possibly nonzero entries, 

and \sEr -A^, |E;;- 
A‘s\ are (square) regular pencils containing the 
finite and infinite elementary divisors, and the 


pencils 


and 


«';i 

(3..56) 


(3.57) 


are of full rank for all a, r with [,vE'{ -i4'|| and 
[/:') zA^)\ regular pencils. Moreover (3.56) and 

(3.57) are in the generalized Hessenberg form. 

Since the pencils sFi- Aj and £^-7/4^ 
contain the finite elementary divisors of 
the induced pencils (3.46) and (3.47) then the 
spectra of these pencils correspond to the 
unreachable modes of the pencils (3.46) and 

(3.47) respectively (Karcanias and Kaloge* 
ropoulos, 1987). Moreover the anticausal pencil 
deals with the reciprocals of these modes. That 
i.s, its zero unreachable mode corresponds to the 
unreachable mode at infinity for the system 
pencil (3.44). I or further details see Karcanias 
and Kalogcropoulos 1987). 


3.3.2. The solution to the uncoupled general¬ 
ized Lyapunov equatiotus. By restricting (3.54) 
and (3.55) to and //* and proposing a lower 
triangular form for T, S and a diagonal form for 
Fs then (3.54) and (3.55) become 

Mr Our; 0 

\A', AV\r\ r; 

/ E^r 0 
\E\ E'l 

= -(^!,)(f'r (’r) (3.58) 



and 

/£.C 0 \/5f, 0 . 
U'i E'i/ysi, sy 



'5'f, 

/n 

(u 


,S' 9"/ 

lo 

n) 


= f"v) (3.59) 

Observe that (3.58) and (3.59) are the uncoupled 
generalized Lyapunov equations. In the follow¬ 
ing theorem we propose a solution to these 
equations. Moreover, the closed-Uxip desired 
modes have been assigned to the closed-loop 
system restricted to //, ,J. This design technique 
is based on the solution of these equations, llic 
next theorem is of practical importance since it 
demonstrates such feedbacks and also guar¬ 
antees the closed-loop regularity. 


Theorem 9. Define 

p = dim Ej J* (3.60a) 

d ~ dim >4 v.V *. (3.6()b) 

Given a desired closed system structure select a 
self-conjugate set of/; desired modes of P\iXs) 
and a self-conjugate set 2,/ of d reciprocal (note 
that 7 = .s ') desired modes of />;/,( 7 ) such that 


o,i(£, A) c: I,, (3.61a) 

<jt{E.A)^l,. (3.61b) 

Suppose moreover that 

fT,^(£, 4)na/(£M)-(l (3.62a) 

al{E, A) n fr;( E,A) = 0 (3.62b) 


that is no finite reachable mode under PD 
feedback has the same value as a finite 
unreachable mode under PD feedback. 

Then there exists a feedback (3.1) that assigns 
Z,, and Z,/ as the closed-loop modes of T'/„(s) and 
iy,U^) ‘^nd ensures the regularity of (3.2) on a 
partition such that 

(3.63a) 

/t vV.cr/I(3.63b) 


Proof. This proof is a combination of the proofs 
given in Lewis and Ozi^aldiran (1989) and Lewis 
and Syrmos (1991) for pure proportional and 
pure derivative feedback. We have to emphasize 
that the proof is constructive and based on the 
solution of (3.58) and (3.59). We also note that 
this exploits the generalized Hessenberg form of 
(3.56) and (3,57). ITie computational technique 
is stable since it involves only unitary transfor¬ 
mations as defined by Verhagen and Van 
Dooren (1986). The regularity of the pencils 
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P^(j) and D;i(z) is guaranteed in Lewis and 
Oz^aldiran (1989) and Lewis and Syrmos (1991), 
Since, now this is true. Theorem 7 guarantees 
the closed-loop regularity of (3.2). This is true 
since we work with a well-defined induced 
partition. Hence at this point the reasttn of the 
selection of such a partition is obvious. This 
argument justifies the specific selection which 
was not evident in the beginning of this section. 


The computation of p and d in Theorem 9 
reveals the maximum number of pt^les that can 
be assigned by PD feedback on = . 7 ©if. We 
claim now that the finite closed-loop spectrum 
that is assigned to the pencils l.i(tv-l-Bvk'v)- 
A s) and [.y£f - (A , + £ 7 X 7 )), that is /'J'(y) and 
sD‘^{s ') is the same one that is as.signed to 
the pencil (.v(£ + BKy) - (A -t- ££,)}. Actually the 
following Lemma shows that this is indeed the 
case. 


therefore (3.66) and (3.67) 
becitme as follows 


or 



J c. (1 

( 3 , 68 ) 


.7 cO. 

(3.69) 


T = 0 

(.3.70) 

B,K: 

..V = 0 

(.V71) 


Direct manipulation of (3.6.5) u.sing (2.1K-21), 
(2.30), (2.31), (3.70), and (3.71) yields 


/(r(£v + /}vA'v)--Avl3'.. 0 

I 0 \^Er-(Ar^B^Kr)]I\ 

/siEs^ BsKs)~ As 1 ) \ 

V 0 sE, - (A I f ) * 



I'hen by using (3.3H) and (3,3*^), (3.72) can be 
written as follows 


Lemma 7. Let = .7 © & be a regular partition 
and K^S = K^T = 0 . Tlien the finite spectrum of 
the pencil [s(E ^ BK;,) - (A -f is the union 

of the spectra of the pencils [^(£s 4 BsKs) - As] 
and [sEj - {A j 4 BjKf )] restricted to 7 and .7 
respectively, where Es. As, Ef, Aj arc the 
matrices that arc constructed by Algorithm 1 , 
that is they constitute a well-defined induced 
partition. 

Proof. Consider the projection matrix Q as 
follows 

' (y';) (-•'«) 

where OeTf''"". and 

Then (7, and Qr, since they are canonical 
projections as defined in Theorem 7, arc of full 
row rank matrices. Specifically rank Qs - o and 
rank Q, = r. Then we can write 

!2[.v(£ + BK.) - (A + flA|)j|.v / j 

= e(.s(£ BK 2 ) -(A + BK,)S .v(£ BK.JT 
~(A + BK,)T] 

= Q[s{E + BK 2 ) - AS xET - (A + flA:,)7'| 

= {f%iEABK 2 )S-AS SET 

-(A -f (3 65) 

By premultiplying (3.3), (3.4) by Qs, Q 7 
respectively and by using (2.18-2.1) we gel 

(AsPs + BsK,)J c= EsPsJ (3.66) 

(EtPt ^ BrK 2 )^<^ArPr 9 0 67) 

But by the definition of Ps, Pr know that 


/l\{Es ^ BsKs) As 0 \ 

\ 0 sEf {A, ^ 

X P\S T\ (3.73) 

Therefore these pencils are related as follows 

Q\s(E^ BK:)-{A 4 /?£,)! 

s(Es^BsKs)^ As 0 

0 sEr-(Aj^ B,Kr)E 

(3.74) 

But by the construction of the well-defined 
induced partition wc know that rank f’» 
rank Q - o 4 t. Therefore these pencils have the 
same finite spectrum. ■ 

At this point, it is evident that solving the 
uncoupled Lyapunov equations is equivalent to 
solving the coupled Lyapunov equations. 
Moreover the p<ilc assignment using a well- 
dchned induced partition and the induced 
closed-loop pencils has been considered. 

4 Fl'tDBACK F KtT INI)tJ( r D FAKmiDNS AND 
SPI-CTRUM A.SSKiNAHILin 

The approach using matrix pencil equivalence 
ideas and quotient subspaces concepts challenges 
us to consider the closed-loop spectrum assign- 
ability by using feedback-free induced mapping 
partitions. In this section wc study the structure 
of feedback-free description of ( 2 . 1 ), that is 
(2,32). Based on this information we present 
methods for spectrum assignability. Note that 
these methods are ‘‘feedback-free” in the .sense 
that they do not depend on B. ITiis method 
involves reduced order nonsquare pencils, lliesc 
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pencils can he easily handled and studied. 
Specifically, the theory of singular systems 
covers the theory of nunsquare pencils. TTie 
Si>lution to the spectrum assignability problem is 
based on the feedback-free uncoupled general¬ 
ized Lyapunov equations. These equations 
follow from the feedback-free induced pencils. 
AsS a result they involve nonsquare reduced 
order matrices. Therefore the computational 
stability of the algorithm is better than the one 
proposed in Section 3. Moreover, since these 
equations are independent of alternative 
computational techniques can be used. 

4.1, Feedback-free partiuons and the closed-loop 
system 

For our purposes we will need some ancillary 
results that exhibit our motivation and constitute 
the cornerstone for further exploration. In these 
results we do not assume the property of 
open-loop regularity. The next theorem shows 
how the restricted pencil to a partition {S, T) 
can be decomposed into a form that involves the 
concept of the feedback-free induced partition. 


Theorem 11. Define a regular partition (5, T) 
such that dim S = dim and dim y = dim y. 
Then there exists a feedback-free partition such 
that 

i) 

X Q[siE BK 2 ) - (A + BK,)l (4.4) 
where |.v(£ + BK 2 ) - (A BKi)] is regular. 


Proof, Since (5, T) is a regular partition, then 
there exist Kj that satisfy (3.8), (3.9) such 
that the closed-loop system is regular. Moreover 
we can always construct a well-defined partition 
such that (3.74) holds. By premultiplying (3.74) 
by 



we get 


(,, + + »/<:,)i 

_(sLr-M, 0 \ 

\ 0 sLs-mJ ' 


(4.6) 


Theorem 10. Let (.V, 7 ) be a partition Then Then by using (4.1) and (4.6) we observe that 

there always exists a feedback-free induced (4..1) holds true where (.s(£-l-flAi,) - (/f + fl/C,)] 

partition such that regular ■ 


Q\sL - M) = 


- Ms 
0 



proof. Consider 



to be the projection map where Q f and Qs are 
defined in Lemmas 5 and 6. Lei now N be the 
left annihilator of B as defined in Section 2. 
I’hcn by using (2.38-36) the following hold true 



Thus (4.1) holds true for every feedback-free 
partition. ■ 


For our purposes, that is spectrum assign- 
ability, wc requrie regularity for the closed-kK)p 
system. This concept leads us to focus on the 
class of regular partitions. This effect is exhibited 
in the next theorem. 


The next theorem reveals another property for 
the regularity of the closed-loop system by 
providing conditions for the choice of S and t. 
This selection will later give us the ability to 
transform this feedback-free de.scription form to 
a regular closed-loop form description. 

Theorem 12. Define a partition ry = y©y such 
that y and ,9‘ are (L, Af )-deflating subspaces. 
Then the pencil sL - M restricted to !< is of full 
row rank if and only if the pencils sL^, - Ms and 
sLj “ Mf restricted to y and J are of full row 
rank, where Lj, Mj, Ls, and My define a 
feedback-free induced partition. 


Proof Note that since (2.37) and (2.38) hold, 
then the following is true 



0 )/(2.v\ /^v(2s\ /e.v\ 

Nr'\Qr' 


(4.7) 


Choose as in Theorem 5 U,}f=i 

be bases for and !€ respectively. Then by 

using (4.1), (4.4) and (4.7) we get 

(sLs - Ms = NsQs w, „ „ / e (1. o} 

(4.8) 

{sLj - Mt)Is, = NrQrWi, i 6 (1. .... t} 

(4.9) 
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we get 


for if 

(Ns 

(2.38) 



_/A'v 


“ V 0 

(4.10) 

/ s 

. T). 

x( 

(4.11) 

K P 


It follows from (4.10) and (4.11) that the pencils 
sLs — Ms and sLr Mr have full row rank 
restricted to .9 and J if and only if 
dim y = dim y and dim 'J = dim which is 
always true by assumption. The converse follows 
easily as in Theorem 7. ■ 

Theorem 7 in the previous section indicates 
how to construct a well-defined induced 
partition. Similarly, Theorem 12 indicates how 
to construct a well-defined feedback-free induced 
partition. The condition that requires the 
partition to be regular will reveal its importance 
at the end of our design technique while we try 
to build back our closed-loop system description 
(3.2). Once having computed a feedback-free 
well-defined partition, the next step will be how 
to find a corresponding well-defined induced 
partition. This will later lead us to a regular 
closed-loop system with the desired closed-loop 
behavior. The next theorem provides the 
relationship between a well-defined feedback 
free partition and a well-defined induced 
partition. 

Theorem 13. Let ^ = .70,7 be a partition. 
Then given a well-defined feedback-free parti¬ 
tion constructed as in Theorem 12 there always 
exists a well-defined induced partition as defined 
in Theorem 7 so that 

I^Ts~Ms 0 \p 

\ 0 sLr-Mrl 

V 0 NjJ 

/s{Es^BsKs)-A^ 0 \ 

I 0 sEj ~(Ar^ BjKr)> 

XR (4.12) 


sEj - {A 


0 . 
r^BrKr)> 


(4.13) 

Note first that and Ki have to satisfy (3,7) 
and (3.8), but this will not attract our concern 
now since it is un intermediate step at this point- 
We will later discuss the choice of A.'i and X'l* 
Our concern is to verify that the maps As, Cv, 
A j, Ej constitute a well defined partition. Note 
that the selection of the well-defined feedback- 
free partition in Theorem 12 guarantees that the 
maps As. I s, Aj, Ef constitute a well-defined 
partition Ihis follows alsi> by applying rank 
criteria foi (Js itnd Qj using (2.37) and (2.38) 
and exploiting the fad that this is a well-defined 
feedback-lree partition constructed as in 
rheorem 12. ■ 

In light of these concepts the classes of 
fecdback-frec partitions depend on the selection 
of .7 and :'f. Among these classes select the one 
which is addressed by the proof of theorem 7. 

Once we consirud the desired feedback-free 
induced partition using Lemma 4 and taking 
under consideration the conditions of ITieorcm 
12, we arc ready to proceed with our technique. 
After that we have to be sure that we can find 
our way back to the closed-loop system without 
destroying the closed-loop regularity. I'heorem 
13 guarantees this procedure. 

We have exhibited how we can go from a 
partition to a well-defined feedback-free induced 
partition I hen Theorem 13 shows how to go 
from a well-defined leedback-frec induced 
partition to a well-defined induced partition 
which m the sequel will lead us to the desired 
closed-loop system. Since we ensure this 
procedure we arc ready to show how a 
well-defined feedback-free induced partition can 
be used for the spectrum assignability problem. 
In this attempt we need some preliminary results 
as in Section 3. 


Proof. Direct manipulation of the RHS of (4.12) 
gives 

/sLs-M, 0 V 
\ 0 sLt - Mr' 

= 0,L-M) 

= + BK^) -(A + BK,)\ 


4.2. 7/ir spectrum assignability problem using 
nonsquare matrices 

I’hc subspaces .7, !f of a well-defined 
feedback-free partition arc (Ls, Ms)- and 
(Mj, L 7 )-invariant subspaccs and arc cloised 
under addition, so that each one has a largest 
member. We symbolize the supremal (JLv, Ms)- 
invariant .subspacc as y* and the supremal 
(My, L/)-invariant subspace as The next 
theorem shows how to compute If* and 
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Theorem 14. Consider the following subspace 
recursions 

. i - Af; ‘( L ). with (4.14) 

Ls ' (Ms %), with % - (4.15) 

then //:- y,, and ^ X,, ■ 

As an alternative to (4.14) and (4.15) and 
J* may he computed by the numerically 
convenient Singular System Structure Algorithm 
(Lewis, 19H6). 

Consider a regular partition (.7, if ). Define 
the causal pencil of (2.32) as 

nv)-(vL - Ml (4.16) 

and the anticausal pencil of (2.32) as 

D(z)-=\L - zMl (4.17) 

where z - .v V Having computed as in Theorem 
12 a welbdelined regular partition, then define 
the feedback-free induced causal pencil as 

rj^)^\sL, ~ A/,1, (4.18) 

and the anticausal pencil as 

/),„(z)-|Ls ~zA/s|. (4.19) 

We should point out that the unreachable modes 
of the pencils (3.44) and (3.45) are invariant 
under the action of N (Karacanias and 
Kalogeropoulos, 1987). As a result of this 
remark we can stale that the unreachable modes 
(which correspond to the finite elementary 
divisors of a pencil) of (3.46) and (3.47) are the 
same as those of the pencils (4.18) and (4.19). 
Despite this, we will symbolize them as 
a!,(T. M) and M) respectively for com¬ 

patibility with our notation of the L, M matrices 
though they are nonsquare. Using the same 
computational technique for the transformation 
of the pencils (4.18) and (4.19) to their 
Kronecker canonical form, and restricting them 


lo .f: 

anti ./ ,*, 

respectively wc get 

the following 

set of 

generalized L 

yapunov 

equations 



0 


: (» 





\Af', 

w; 

)lr 

' 7-' 

.1 






ll-r 



u'-; 

<* \ 






\r\ r; 

H,; 


(4.20) 

iinii 








/U 


(S':. 






vl: 

lyj 

tv.'. 

no ) 
1* 







M^s 

0 \ 

is^, O' 

i/Ft 

0 \ 



= ( 

Ms 


(.V .V" 

II ir’ 

l( 0 


(4.21) 


Observe that (4.20) and (4.21) are reduced order 
uncoupled generalized Lyapunov equations. 
Therefore we significantly reduce the order of 


the original matrices. It is evident now that the 
solution of these equations is much easier than 
those of (3.58) and (3.59) due not only to the 
fact that arc reduced order equations but also to 
the fact that they arc invariant of the presence of 
B. Thus we reduced the amount of required 
operations. Also, the algorithm becomes less 
complicated and easier to implement. Wc note 
that the B has not been annihilated. On the 
contrary, it plays a significant role through the 
following equations. 

B'l(A\ A^l){T\ r:)-B^l{E\ £^) 

X(T\ Oo n) = -(Gf c;) (4.22) 
and 

B'liE', £^0(A‘ 5?,)-fl‘r(A‘ A'’) 

x{Sl A’r,)(0 F‘^) = -(GJ G:’) (4.23) 

where and /i\’ are the Moore-Penrose 
inverses of //') and B\l 

We pt)int out that these equations consist only 
of matrix-matrix multiplication operations. 
Therefore given the Fs and F, the solution of the 
feedback-free generalized Lyapunov equations, 
that is S and 7 completely defines G^ and G, 
through the equations (4.22) and (4.23). Under 
these considerations our goal is to find .7 and J 
using the computationally easier equations (4.20) 
and (4.21), then substituting .7 and J back to 
(4.22) and (4.23) we compute G\ and G,. Then 
using Gy and G, as well as our ancillary results 
of this section wc will define the feedback gains 
A'l and K 2 that guarantee the closed-loop 
regularity of (3.2) and also assign the desired 
spectrum. For these reasons the next theorem 
explains how we solve (4.20) and (4.21) for the 
specific selection of Fy and F,. This theorem is 
the corresponding result of that of Theorem 9. 

Theorem 15. Define 

p ^ dim LjS* (4.24a) 

rf^dim A/v7,V (4.24b) 

Given a de.sired closed system structure select a 
self-conjugate set of p desired modes of 
and a self-conjugate set of d reciprocal (note 
that z ’) desired modes of *^uch that 


(4.25a) 

a-:(Z.. Af)cl.,. (4.2.5b) 

Suppose moreover that 

al(L, M) n oJ{L, M) = 0 (4.26a) 

ai{L, W) n crXL, M) = 0 (4.26b) 


that is no finite reachable mode under PD 
feedback has the same value as a finite 
unreachable mode under PD feedback. 
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Then there exists a feedback (3,1) that assigns 
Zp and 2^ as the closed-loop modes of and 
Dt{z) and ensures the regularity of (37) on a 
partition 5^, such that 

cLr^; (4 27a) 

(4.27b) 

Proof. The first part of the prtxif is based on the 
solution of the uncoupled fecdback^frec general¬ 
ized Lyapunov equations. This solution is a 
special case (fl=0) of the one proposed in 
Theorem 9. It alsci exploits all the advantages by 
using unitary transformations. Moreover, it is 
based on the generalized Hessenberg form 
(Verhagen and Van Dooren, 1986). There are 
several advantages of this technique. The order 
of the matrices is reduced, the algorithm is less 
complicated and can therefore be more ea.sily 
implemented, and finally Gs and G'/ are 
computed explicitly using the equations (4 22) 
and (4.23). 

The .second part of the proof is based on the 
construction of feedback gains that uses the 
solutions of these Lyapunov equations while 
the clo.sed-loop system is regular. Moreover we 
will verify how these feedback gains assign the 
desired closed-loop spectrum. 

Since we used a well-defined feedback-free 
partition, then according to Theorem 13 we 
know that (4.17) holds true. Therefore we need 
to calculate the projections Qs and Qj in order 
to compute the well-defined induced partition 
that is defined by the induced maps As. Ej\ 
Ar This can be easily accomplished by using 
(2.37) and (2.38). Having computed Qs and Q, 
wc calculate all the induced maps Es, As. Ej. 
Af as defined in Theorem 1. Iliis is a 
well-defined induced mapping partition and is 
guaranteed by Theorem 13. 

Our next step is to construct feedback gains 
from the computed Gj . Gs and 7’, This can 
be easily done using the following 

Gi=Kj7, (4.28) 

g:s = a;vV.. (4.29) 

Then we can also compute A, and as follows 

Ky^KrPr ( 430 ) 

A2= A.,7\. (4.31) 

But these feedback gains assign the desired 
closed-loop spectrum and guarantee the closed- 
loop regularity as Theorem 7 .shows. ■ 

In order to summarize this technique wc 
provide the most critical steps in the following 
algorithm. 


Algorithm 2 

Step 1. I>efine a partition (//. 5) such that 
(376), (3.27) hold true. 

Step 2: Perform row operation.s on W as defined 
in (3.28-31) and compute .9' and using (3.18) 
and (3.19). 

Step 3: Compute now a well-defined feedback- 
free induced partition using the .7 and as 
defined in Theorem 13. 

sStep 4: Solve the feedback-free generah/ed 
Lyapunov equations for the given closed-loop 
specifications. 

Step 5: For the computed .7 and :? calculate Ps. 
Qs and Pj, Qj as defined in Theorem I. 

Step 6: Using equations (2.18-21) compute Es. 
As. Ej, Aj, that is a well-defined induced 
mapping partition 

Step 7: Using equation (4.28-31) compute the 
necessary gains for the desired closed-Uxip 
behavior. ■ 


AN I XAMPI I 

Wc consider the system defined bv 



2 0 2 \ 

0 1 0 \x 

0 0 1 / 



(5.1) 


This singular system has been derived by 
Newcomb and D/.iourla (1989) for the problem 
of “input for spc'cific output’ . In order to avoid 
lengthy calculations wc first bring (.5.1) to the 
generalized lower Hessenberg from by using the 
algorithm proposed by Van Dooren (1979). This 
yields 



0 

t)\ / 

- 1 

d 


1 

0 \x - 1 

0 

~ 2 

\() 

0 

d/ \ 

t d 

(1 



We will u.se R(.) and e, to denote the range of a 
subspace and the /th column of the identity 
matrix. 

Let .y = R(e,) and .7 = R(e., r,) It is easy to 
check that 7“.7G),y defines a partition. 
According now to Theorem (7) note that 
and //=^R(r,) define a well- 
defined induced mapping partition 
such ihat dim J ~ dim ’’i ~ 2 and dim f/' = 
dim.y-1 for and where 

.j = R(e 2 .'’() ^*f>d ./= R(e,). Using equations 
(2.18)-(2.21) the induced maps arc 
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Av= -1, 


By choosing again the same partition as 
previously employed to be a feedback-free 
induced partition, the induced maps are 


Bs =- <», 

L,=(h 0), 

Moreover the induced pencils are 

Mv=-L ^r=(-2 -2). 

D,nU) - 1 

-z 0) 

Consequently the induced pencils are 


fs-^2 2 0\ 


‘ 0 -1 -2/ 

PJs) = (,? + 2 2). 


It is easy to see that \sEi - A ^ B j ] contains one 
finite reachable mode, actually the mode {-2}. 
The pencil \Es zAs ^.s| contains one finite 
unreachable mode, actually the mode (0). It is 
noteworthy to mention that the original system 
restricted to ,7 and .7 respectively contains one 
column minimal index of order one and one 
infinite elementary divisor (ied) respectively. 
The ied of the original pencil has been 
transformed to a zero elementary divisor as was 
expected. 

In order now to solve the uncoupled 
Lyapunov equations we compute d = 
dim Asifa “ 0 and p - dim /:/./* = I, I.el now 
{”4} be the desired spectrum. Since the pencil 
Pin{s) is already in its Hessenberg form, then 
equation (3.58) can be written as 



a solution to which is r, " - 1 and g, = '. 
Therefore by using /C/7i we find that 
Kr “ [i 0] It is easy to check that the spectrum 
of the subsystem is ( -4). Moreover, AC, = 
KrPj ^ [0 \ 0 ). 

Similarly, by solving (3,59) for the pencil 
/'>,„(,v). we get - 1 and can be chosen 

arbitrarily. Therefore select as A'v=l. then 
/C 2 = [l 0 ()|. Wc can see that the spectrum of 
the closcd-hH^p subsystem is {()}. Knowing that 
the feedback gains are ==(10 0| and 
AC,“(0 j 0|, we can verify that the finite 
closed-loop S|X?clrum is (-~4}. It is also 
noteworthy to observe that the Kronecker 
structure of the system remained invariant under 
the proposed decomposition. 

The same problem can be alternately con¬ 
fronted by using the feedback-free approach, Wc 
will also use in this case the transformed system 
(5.2). In order to do so select 

/I 

'^-(o , o) * =»'’ " 

such that iVfl = 0 and = L Then 


0 0\ 

/--I 

0 


1 o)' 


V 0 

-2 

-2/ 


In order to emphasize the impc^rtance of the 
discussion on p. 366, we point out that the pencil 
D,„(z) contains a zero finite elementary divisor, 
while the pencil l\Js) contains a column 
minimal index of length two. 

In order to solve the uncoupled Lyapunov 
equations wc compute d -- dim Afv-7* = 0 and 
p = dim L j Jt - 1 Let now { - 4} be the desired 
spectrum. Since the pencil is already in its 

Hessenberg form, equation (4.2) can be written 
as 



a solution to which is r, “ - 1. Moreover, from 

(4.22) we have that f*, “ Therefore by using 
gy = Ki '!] we find thal Kj - 11 ()|. It is easy to 
now check that the spectrum of the subsystem is 
{-4}. Moreover, A, - E f Pf “ |() \ 0|. 

Similarly, by solving (4 21) for the pencil 
we get “ I and can be chosen 
arbitrarily. Therefore select as As~l, then 

A%= [1 0 0). We can see that the spectrum of 
the closed-loop subsystem is {()}. Knowing thal 
the feedback gains are K^ -- [ 1 0 0] and 

?. '^c can verify that the finite 

closed-loop spectrum is { 4). It is also 

noteworthy to observe that the Kronecker 
structure of the system remained invariant under 
the proposed decomposition 

U. C ()N( LIJSIONS 

In this paper we presented a new' classification 
of invariant subspaces by utilizing the concepts 
of quotient and partitioned subspaces. It was 
also exhibited how these are related. The 

partitioned and quotient subspaces preserve 
certain open-loop properties as was shown in 
Section 2. Moreover an alternative formulation 
was used, thal is the feedback-free description. 
This latter one involves the concept of 
nonsquarc pencils. 

These properties along with specific conditions 
thal should hold led us later to the determination 
of a well-defined induced partition. This class of 
subspaces that is constructed by using the 
notions of quotient subspaces constituted the 
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center of interest in Section 3. In this it was 
presented that this class of subspaces establish a 
new technique for spectrum assignability using 
proportional-plus-dcrivaiive feedback. The pro¬ 
posed method was based on the decomposition 
of the closed-loop system into two equivalent 
subsystems. The solution to the spectrum 
assignability problem was confronted by utilizing 
the uncoupled generalized Lyapunov equations. 
The solution to these equations is based on the 
generalized Hessenberg form. 

Finally in Section 4 the problem of spectrum 
assignability was confronted from a diherent 
point of view. Specifically the concepts of 
feedback-free induced partition were used. As a 
result we dealt with nonsquare pencils in order 
to assign the poles. This technique involved 
reduced ordered matrices, subsequently the 
algorithm was computationally stabler It is 
noteworthy that the solution of the feedback- 
free uncoupled generalized Lyapunov equations 
were invariant of B. Therefore the profK)sed 
algorithm was less complicated. Ihe use of 
nonsquare pencils to the spectrum assignability 
problem constitutes a powerful technique not 
only in the singular systems but also in the 
state-variable systems At the end the ad¬ 
vantages of this method were discussed and an 
algorithm was given which exhibited the 
philosophy behind this endeavour. 
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Kalman Smoothing via Auxiliary Outputs'*' 

JOHN KORMYLOt 

Key Wof4B —Kiilman filiering, Mncxithing, ftplinefi; stale csliiriaiion; sUK'hasiic systems 


Ahflinct—A cliiss of computationally efiiticnt, fixed interval, 
discrete-time KaJman smoothers is discus&cd, of which 
Bierman's smoother is a special case l"hcsc smoothers 
obtain estimates of the complete state vector without having 
to store the error covariance matrices. In particular we 
ccmsidcr the smoothing problem when the transition matrix is 
singular but the system is still completely reachable 
Smoothing splines arc used as an example. 

1. Introduction 

NuMiiKOus hxed-interval discrete-time snuxiihing algorithms 
have appeared in the literature Mcditch (1973) and Kailath 
(1974, 1975) have surveyed this area, and Bier man 
(1973,1977,1982) made numerous cxintribuiions to it A 
major problem with most algonthms is that the complete set 
of error covariance malncCvS must be stored between the 
forward and revere: passes Dierman's most recent smiKithcr 
(Bierman, 19H2) avoids this problem in a sluble way, but i.s 
constrained to models where the transition matrix is 
invertible. 

This paper shows how an entire class of smcxithers can be 
developed for completely reachable systems using the 
concept of^ auxiliary outputs. ITicsc .smiKJlhcrs do not require 
storage of the error covariance matrices, in fact. Hierman's 
smtxJlhcr is a special case of this lypn: of smo<3iher. A second 
type of auxiliary output can be used when (he transition 
matrix i.s singular, yet retaining the advantages of the 
Bierman smoiither 

2 Problem formulation and notation 

Consider a standard discrete-time linear dynamic model of 
the form 

%{k + 1) - a>i(A)-»- I w(A) VA =-0. 1./V - 1 (1) 

with discrete observations 

z(A) -//x(A)^ 11 (A) VA - I_ N. (2) 

'fhe usual statistical assumptions for Kalman filtering arc 
made; 


E(w(i)w'(/)) -(?d(i -7) (3) 

E{nU)n'ij))^Rd{, i) (4) 

£'{w(A)i'((l)) - 0 VA^O (5) 

£:{n(A)x'(())) =0 VA-U (b) 

and, for the sake of simplicity, 

£(w(i)B'(y)) =--0 V;,; (7) 


While matrices O, T, Q, and R arc not explicitly denoted as 
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Kwakernaak. 
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lime varying, the following results are valid foi the lime 
varying case as well 

The predictor-cxirrector form of the Kuiman filter under 
these assumptions is given by 


i(* + 1 1*)- 

‘ OI(A 1 k I 

(H) 

Pit 4 1 |*)“«l>nA |A)4> 4 lyi' 

m 

lor ihr predictor ulugc. and 


«AH - l)-»(*t- 

«»(* |A ■ 1) 

(10) 

!'(*) '< HP{k 

. 1* - 1)//' 4 H 

(11) 

£(*) » P(k 1 

k - DAf'V' '(*) 

(12) 

&IA {A) ’. i(A ! 

A - 1)4 £(*)*(* 1* 1) 

(13) 

and 



Pik |A)-|/ 

- K{k)H\P{k 1 A 1) 

(14) 

for (he corrector stage. 



'Die modified Bryson 

Frasier snuHither (Bierman. 

1973) 

computes fixcd interval 

cMimaies ft(A | N) F(i(A) 

|»(l). 

, f(A/)) ii.sing 



l(A 1 N) ^ l(A 1 A 

- 1)4 Pik 1 A l)r(A 1 ^) 

(IV) 


where r(A \N) is the adjoint state vector and is computed 
recursively in the reverse direction using 

r(A |/V)-|/ A(A)/f| d^'HA ^ I |^)^ H'V '(A)4(A |A- 1) 

(lb) 

starting from r(/V 4 1 | A/) * 0 

The procedure lor obtaining .sminithcd Mule estimates 
u.sing the modilicd Bryson Frasier smoother is to perturm 
Kalman filtering (.storing the results) then recursively 
compute (lb) m the reverse direction 

Quanttlies stored i(A 4 I | A). /'(A 1 | A), K{k) and 

V '(A )i(A 1 A - I ). Total « (n 4 n" 4 rim 4 m)Af words 
where n is the dimension ol a, m is the dimension of x, and N 
IS the number of samples lor fixed interval smixiihmg 

Finally, using Mendel's optimal smixither (Mendel, 1977; 
Mendel and Kormylo, I97H) one can compute fixed-interval 
estimates for driving noise w(A) using 

#(A I S) - QV'rik 4 I I N), (17) 

where r(A | N) is defined as before Note that only K{k) and 
V' *(A)i(A I A - 1) need be stored for these CKtimates 
lliesc estimators will be uiicd in the following derivations. 

3. AuxiUary ouipuLi 

Consider an auxiliary output, y(A), of the form 

y(k) - A%(k) A Mk) (18) 

for some matrix A, so that suhsiiluting (or w(A) in (1) yields 

x(A 4 l)-|a)- r/»li(A)4 l>(A) (19) 

If (d>, F) describes a completely reachable system, then 
there exists a matrix A such that 

r; = |<i>-M| ' ( 20 ) 
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cxiM^ und stable Sinct* ihc charactcriNlic valuer uf a 
completely controllable system can be urtriiranly located 
(Kwakernaak and Sivun, 1972) and since the dchmtion of 
crjntrolhibility is mathematically equivalent to reachability. 
OIK* can chfKfse A so as to force all the characteristic values 
t)f d> I VI to be outside the unit circle, in which case (m will 
exist and have all of its characlcrisiic values inside the unit 
circle 

From fl9) and f2(J) we see that 

«(k) - fVa(A f 1) r;[ y(A). (21) " 

and lakjnft the conditional expectation given i(l), . ,*(/9), 

we obtain our desired result 

i(/l I N) - (;i(k ^ I I A') - (;0(* I N). (22) 

■nic itnporianiT i)( (22) i.v lh;ii given S(A' I A/) and 
snuKithed estimates for auxiliary output y(A), one can 
recursively compute smiNilhcd estimates for the slate vector 
x(A). Since the dimension of yik] is generally much less than 
i(A). computing estimates yik\N) will require much less 
storage between the two passes, as will now lx- shown 


l aking the conditional expectation given i(l), . . x(/V) of 

both sides of (18), we obtain 

^(A I N) ■■ .>1i(A I N) ^ Hk I N) (23) 

SubMitiiting lor i(A | /V) using (IS) and tor w(A | N) using 
(17), we sec that 

y(A I (V) /ti( A I A - \) ^ A nk I A 1 )p(A I N) 

I C^l 'r(A f I I N) (24) 

Also, from (12), (14), and (lb) wc see that 

nk I A l)r(A \N) ■ r(k I A)d>'r(A f I | /V) 

+ K{ky}.(k I A I) (2S) 

so thal (24) can be reduced to the form 

iik I ,V) - Ai(k I* 1) f ! A)<r<' t C'l '|r(* I | V) 

*■ AK{k tUk I ^ - I) (2<>) 

or. using (I V), 

^(A I A) A*(A I A) f |/W*(A I k)<V' + C^r'|r(A i- 1 | N). 

(27) 


lb obtain lixetl interval snn>olhed slate estimates one 
performs Kalman liltcnng (storing the results) then computes 
r(A I .V) and i(k | /V) lecursivcly in the reverse direction 
uMiig (14), (22). and (27). starting Ironi r(,\ 4 I | ,V) - 0 and 
ft(A/| ,V) Since the ilimension of y(A) is generally much less 
than the dimension id *(A). this requires lar less memory 
than the nioililied HrYsoiV’Frasier smiHbhcr. 

Quantitirs v/orrd yiA | A). A. /VA*(A |A). K{k) and 
V' ‘(A)I(A I A - 1). loliil - (/ V 2fi/ 4 nm 4 m)N words 
where n is the dimension of x, m is the dimension of z, I is 
the dimension of w, aiul .V is the number of samples fur fixed 
interval smoothing. 

Obviously, this smoother requires less storage when 
/ ' (n(o > I )/2n 4 I) ^^ 0 /2. 

4 /fierrmin’v snutothfr 
For the special case when 

•■t = eii* 'IT/ (2H) 

we satisfy 

AP(A i A)4>’ 4 C>r'- 0. (29) 

m which case from (27) we see that our snuxithcr dties not 
require the adjoint slate vector Fhc reason for this 
simplification is thal, as one can easily show. 

(3(1) 


when (29) is .satisfied, and therefore 

J(* I^) = y(* 11) = .44(* I*). (31) 

This can pnxiucc coasidcrablc savings m storage, as one rK) 
longer need store the Kalman gains or iniKivaiions. The only 
disadvantage is that it requires the transition matrix lo be 
invertible. 

Quantititj stored: y{k | N) and A. Total ^ (/ 4- nl)^ words 
where n i.s the dimension of a, / is the dimension of w, and N 
IS the number of samples for fixed interval smiKdhing 

In addition, one can easily show that 

|«>-Ml/'(* \k)<t> P '(k + I 1*) 

= /-ri/»/’((( |*)<i>' + ciF '(* + i|*) (32) 

.SO that when (29) is sati,Hhcd wc have 

G - P(A |*)<I>7' ‘(A + I I *) (33) 

which is the well known smixiihing gam function (Bicrman, 
1977). 

Also, one can use the matrix inversion lemma to show that 
(. =(/ +4* 'Hl-A<t> T) ' (34) 

and there tore 

f;f'- <i> 'n/->ta) 'n ' (35) 

We can now rewrite (22) as 

i(A I N) - 'x(A 4 1 I N) 

-‘l> '{{i A^ '1) '[y(A I A') 

A^ 'x(A 4 1 I /V)| (36) 

which is useful when ‘l is time invariant and can 
therefore be prc-compuicd. 

5 .Sinji'ufflr transition matrix 

Let us now consider an auxiliary output, y(A). of the form 

y(A ) - Anik ) 4 B%{k 4- I) 4 w(A ) (37) 

for some matrices A and H Substituting for w(A) in (I) we 
now obtain 

|/ 4 l7f|x(A 4 i) [4> - r4|x(A ) 4 ry(A) (38) 
and therefore 

»(A)-|<l>-r/l| '|/ + I'«1*(* + D-1*-I-^l '!>(*) 

(34) 

Similarly, wc now have 

J(A I N)-.4i(A I *) + Bx{k 4 1 | A) 

+ [/»r(A I A)<l>' 4 BP{k 4 1 I A) 4 C/l''lr(A 4 I [ A/) 

(40) 

in pliicc of (27) 

When is singular, there exists some non-lnvial matrix C 
such lhai 

4>( ---0 (41) 

where the rank of f' plus the rank of <I> equals the dimension 

of X. If we choose A using 

/t = arT'(A|A) (42) 

for some scalar a *■ 0. and c)ioosc B using 

fl --(3r7* '(A 4 1 I A) (43) 

lircn from (40) wc now )iave 

J(A 1 ^) = ^(A I A) = /li(A I A)4 fli(A 4 1 I A) (44) 

and It* - M| ' exists One can al.so s))ow thal 

[<I»-r/4| '|/ + rB| = P(A |A)<I>’P '(A 4-1 I A) (A.A) 

which is our old friend, the smoothing gain. 


(•{J(A|A)i(;l,-l))-0 V/'A 
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Quaniuus stand: ] S). A, and H Toial = (/+ 2#i/»,V 

words where n is the dimcnsiOfi of e, f is ihc dimensH)n of w. 
and A/ IS Ihe number of samples for fixed mlerval smmnhmg 

Note: the only crilcrion for chiK»tsing a is thal ihr 
cofidilion number of - TAj should be as low as possible 
Also, when ® Q (as is often the case) ihc solution to (43) 
IS given by B = -(PT) 'T', in which case Bt{k I 


6. £iflmp/e. Cubic xmcfothing spUnes 

Cubic smoothing splines arc found by fitting data points to 
a senes of cubic polynomials constrained to be amiinuous up 
to the second derivative This can be formulated into a 
Kalman smoothing problem by defining the state vector to 
consist of the polynomial cocfiicienis so that the observation 
matrix is given by 


H(k) = 


1 


1 


(T, (T,-t*)' (r, 


(r^-rj (T, fj'J 


(46) 


where arc the knot locations and the are the observation 
times, where 


{t -T,}r (47) 


If we model the third derivative as a random sequence with a 
very large variance, from the continuity constraints wc obtain 


r ^ M ^ * I . 1 ^A ) 


and 


. 1 U ) -^(^A 4 1 

1 Ml, ., 

0 (I 

On 
0 
0 
I 


ikY 

fi) 


(4H) 


One can easily show that <!>(' 0 when 

Ml,.,-!,) 11'. (4^) 

and the value of a which minimizes the condition number is 
given by 

ct - ™1/C 'P '(k I k)( (-SO) 


Also, in this case notice that I ~ 0. so ihal we need not 
store the B matrices 

On the other hand, if we model the third derivative as a 
random walk, wc have 

'1 (^.1™^) (t*,!' 0) 

() 1 3(t, 

0 0 1 3(/*,,-/*) 

_() 0 0 I 

which is obviously invertible For this modeling assumption 
wc can use the standard Bicnnan .SmcKithcr, TTic diflcrencc 
between the two models will only appear when Q is small. 





Fig. I Cubic spline fit to fourth order polynomial (high 
SNR) 


; ..- . . , . 


i‘! 'v;»;r j 
0 fcj'V' ; 

1.' j 


1 

li-tAl" j . , , .... 

Fill 2 ('ubu spline fii In step (unction (low SNR) 

I'hc lirM mivdel will attempt to keep the thud ticnviitivc 
small, whereas the second model will attempt to keep the 
disc'onlinuiTies in Ihc third iJerivalivc sriuill. 

Figure I depicts the results ol using Noli 4i| the iifvove 
models to lit the lourlh ordei t>olynomial 

:(/) tr I) M(r I Mlf VS)(/ 4 S) (Sj) 

using QIH 10000 The cm lev denote the obscrviitiims. the 
solid line shows the lit using laiuiom third dcnvulivcs, aiul 
the dashed line (hidticn under the siilid line) shows the (ii 
using a random walk mi>del Ihe RMS errors lor the two 
models were 01)2020,S and t)()20,UI, icsiK’ctively Hus 
denionstraies that l>oth methods can produce gixid estimates 
and are virtually indistinguishiibli lor large values ol 
figure 2 depicts the results ol using lH>lh ol the alsovc 
ituwJcIs to fit a step function using Q/H 1 Ihe ellccl ol the 
small IS to dam|X‘n the o.scilluiioas ol the resulting splines 
Ihe circles denote the observations, the solid line shows the 
lit using random third derivatives, and llu* dasherl line shows 
the fit using a random walk model Hu KMS errors lor the 
two models were 0 130 and tl i S2, resiKetively I his 
demonstrates that the two methods can priHiuee sfigfilly 
different estimates due to the difleiences in the modeling 
assumptions 

7 ( oriftuMon 

For completely reachable systems, it is possible to obtain 
smtMilhed siiile vecloi eMiinalcs by constriicimg aiixiliaiy 
oulpiits arul inverting the resulting system Hierman's 
smoother is a sfx-cial case winch docs not require using the 
ad|oml slate vector When the transition matroi is singular a 
.second type ol auxiliary output can Ik.- used with all the 
advantages of the Hierman smo<iiher 
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Numerical Computation of Decentralized 
Fixed Modes’*" 

R V. PATELt and P MlSRAt 


Abfinct—In this paper, wc use an algchrau- chanicicri 7 .alion 
of 'Tixed modes" of a decentralized linear muliivanuhlc 
system (u show that the fixed m<xlcs are related ii» the 
"bliKking zeros" of certain Mil>sysicins derived from the 
given decentralized system. A numencul algorithm is then 
presented which enables us to compute the fixed miHles in a 
reliable manner. Examples arc provided to illustrate the 
main results of (he paper. 

I Introduction 

In RtK't N't years there has been considerable inieresi in the 
study of decentralized control of large scale linear 
multivariable systems such as those which arise in developing 
control strategics for large flexible space structures, e g 
West Vukovich ct ai. 1^84 or multi-machine power 
sy,stems (e.g. Davison ami fripaihi, I97K) The ilecenirali/ed 
structure of these systems is a consequence of the constraints 
that are imposed on the information flow within the system, 
usually because of the locations ol various sensors and 
actuators. By judiciously locating these sensors and 
actuators, a structure can he chosen for a deeeniraii/cd 
controller which makes it considerably simpici to implement 
than a ":cnlralized" controller 

llic structure of a decentralized controller is an im|Hsriant 
issue in the control of large-scale systems. This is because o( 
the existence of "decenlrali/ed fixed nuHies" (d f ms) (e g 
Wang and Davison. U>7,^, AfulerM)n and ( Icmcnts. PIHJ. 
Armenlano and Singh, 1^82; C orfrnat and Morse. l^*7b. 
Wcst-V'ukovich el al , 1MH4) D f ms are those modes ol the 
sy.stcm which are invariant under the implcmcnialion ol all 
decentralized controllers having a particular sirueiure. 
Therefore, if a d f rn corresponding |i» a particular 
decentralized structure is unstable or has other undesirable 
churaeierislics, the decentralized controller will not be able 
lo remedy the situation One aspect of the design problem, 
therefore, is to develop mcthiKls of determining a structure 
for a deeentrali/cd controller such that there are no d f ms or 
no undesirable d.f.ms Consequently, it is of interest to 
investigate the conditions under which these modes occur, 
and develop a numcneally eflicient and reliable method lor 
computing them. 

Several characterizalions of d.f ms have been obtained m 
recent years, e.g (e g. Misra and Patel, Davi.son and 

Wang, 1985; Tarokh. 1^85. Patel and Misra, 1984. Davison 
and Ozgiincf. 1983; .Scraji, 1982; Ander.stm, 1982; Anderson 
and Clements, 1981; Corfmat and Morse, 1976; Wang and 
Davison, 1973) Some of these references provide charac* 
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tiTi/iitions in icrms of tran.vmission zeros ot cenain 
■'sub syslems' of the given system Die deierrinnatiim ot 
d ( m> by these approaches can Ik- eompuiuiiomdly cxtiensivc 
lor sv^tems having high order and/or a laigc mimisci ot 
“stations", since many transmission zero cxmipuialion tests 
would Ih' requiicd Anderson (19K2) gives a inmsler tunction 
ehanictenzation Mowevei. the chaiiieteiizutit>n does not 
provide an ethcicnl and numencidly reliable meihiKl by 
which d ( ms may be computed Anderson and ('Iciiicnls 
11981) give an algebraic chaiacten/ation which provides 
valuable insight into the pro[Kriics ol d I ms and conditions 
under which they iKciir I“hr chaiacieri/aiion requires the 
partilioniiig ol the set ol slaiions inlo (wo disjoini suIhcIs 
and involves a rank lest, hut as will \k disi ussed hitci. a 
direct application ol the result to find d 1 ms can Ih* 
cornpuiutionally exfKnsive 

One of the most straightforward ways ol compuimg d f ms 
IS the methtwl suggcsied by Wang aiut Davison (197.t) 'Hiis 
gives the fixed modes as iho.si* eigenvalues of ihe slide malrix 
which arc unaltered when random deeeniraJi/ed feedback is 
applied However as |Mnnted out in Misra and Paid (19Hti) 
and Vaz and Davison (1989). the inethml bused on 
eigenvalue computation can be nurneiically unreliable Ilns 
IS explained (uriher in Section V 

In this paper , we relate the concept ot "bliK'king /enrs" 
(Paid. 1986) ot a linear multivariable system lo the lixed 
nnnles of decentralizenJ syslcms li is shown how such a 
charaiienzalion leads to a numerically lelnihic algonihm (or 
computing d I ms 


2 Preliminaries 

l>efwinfm 1 A linear lime invarianl multivariable .sy^lcni 
dc.stTibcd by 

V 

i(f) ■ /tid) + V <2 la) 

r 1 

y,(r) (>(/), 1 ' 1, . (2 lb) 

where i(/)fR''. ■.(r) e , y,(f)rR^^'. i-l, ..,N, is 
culled an "A/ station dcccnirali/.ed system" 


Dcfiniiion 2 (iiveri the system (2 I), if we define a set K of 
bl<Kk diagonal matrices K as 


K - (K ! k - bliK’k diag (A,. . K^). K, r flC"' (2.2) 

then the set ol d.l ms ol (2 1) with rcspcci lo k is ddined as 

A' 

AM. K) - n niA + V H,K,(',] (2,1) 

^ ,Ti ' 

where r7(*) denotes the set o( eigenvalues ol the matrix (•). 


Theorem 1 A scalar A(o(4) is a d i m of the system 
described by (2.1) if and only if for tome partition of the set 
U- (1, . /V) into disjoin! subsets U, (i,. . . , i*) and 

" 1^1: 1 I ’ < ^ ll ' 


rank 


Af., R,; 

0 (I 


(2.4) 
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Prtwf See AnJerMJn and Clements (J9H1) 

Remarks. Since, Xt oiA). all ‘fWMisiblc ' candidates fur 
d f ms arc known a priori. F urther, since the partition in 
(2 4) IS disjoin!. any mode which is controllable and 
tibscrvahic from one or more stations cannot be a d f m. and 
these miKles cun be eliminated from conskkraiion 

Theorem 2 Any multi-input, multi-output, single-station 
system (A, H. ( ) can Ik reduced by means of an orthogonal 
Slate ccKirdinalc transformation 7' to a condensed form 
(7, (m. //) called a “block uppirr Hessenberg form ” (BUHF') 
such that 7 - r'A !\ (i T^H and H - CT, with 



where 7;^ f Ifl'- and (/, e R'''"". 'rtie 

integers I,, I ~ 0.A arc delincd as lollows; /„ - rank (/f), 

A 

I, ■■■ rank (7,, , ,). t I. .A and }] /, p where p is the 

< > II 

dimension o( the controllable subsystem; p - n it (he system 
IS conirollahle and p '■ n if the system is uneonirollahle 

Proof 1'he proof is bv conslrueiion and can he lountl in 
Patel (l‘fKI), Paige (IMHI) and V'an Dooren (IMKI) 
Reduction of a system to a block Hessenberg form has also 
been reported in several other publications (e g Nmir-Lldin, 
l‘)77, Ise i7 al., I^VH; KoiiMantiiiov ci al , 17H1). although 
non orthogonal transformations have been used in some 
eases 

Remarks A similar result can he slated for reducing the 
triple to a “block lower Hessenberg form" (Hl.HF') lising 
Htcorem 2, we can easily obtain a minimal order subsystem 
from the given triple (.4, /f. ( ) by hrst determining the 
controllable subsystem ff'* *, ('^'‘) and then computing 

the observable subsvsicm (.4‘"V o( \ 

C"). 

tail I, I'he system {A, H, ( ) can he reduced by means of a 
unitary slate coordinate iranslormalion H to a condensed 
from (7. a. H) - ((■'^^4^^ ( U) where denotes the 

conjugate Iransjxise o( I', such that 7 is in an upper Sehur 
form (l)SF') In this condensed form, all eigenvalues of A 
Lip[Kar along (he diagonal of 7 as real or complex scalars, 
and can Ih* made lo appear along the diagonal ol 7 in any 
desired order by appropriate choice of U (Ciolub and Van 
l oan, m^) 

Tact 2. rhe system (A. H, f ) can he reduced by means ol an 
orthogonal state L\>ordinatc transformation 7 to a condensed 
form (7. (>, Tif) (7 ^4 7, H, ( T) such that 7 is in real 
Sehur form (RSf ) Ihc eigenvalues of ,4 appear along the 
diagonal of 7' with real eigenvalues as scalars and 
complex-conjugate puirs of eigenvalues as 2x2 blocks, 
Phese scalars aiul 2x2 blocks cun be arranged in any desired 
order by appropriate choice of T (Ciolub and Van Loan, 
IMH4) 

Definition } A scalar Atl is a "blocking zero" 
(Patel, I^Hh) o( the system (.4, IT C) with ,4 a cyclic matnx, 
il ( adj (A/„ ,4)71 - 0 where adj(-) denotes the adjoint of 


the matnx (•) If Xio(A). then A ls a blocking zero of 
(A. R, C) if C (Ay, - A) 'H -0 

4. Charaeterizatum and computation of d f .ms 

In this section, we will investigate the conditions under 
which (he inequality in (2.4) is satisfied. It will be shown later 
that these conditions can be easily used to derive an cGBcient 
and numencallv reliable algorithm lo uimputc the d.f ms of 
( 2 . 1 ). 

Consider a system (7, fV. 7/) with 7 c-R”*’'’, CjeR"'*'" 
and H Assume that 7 is a cyclic matrix with an 

eigenvalue A of multiplicity r Also assume without loss of 
generality that the matrix 7 is m IJSF (see Fact 1). The 
system (7‘, (i, H) therefore has the following structure: 



Since A^o(7',|) and 7 is a cyclic matrix, rank (A/-7')- 
/I - I, which implies that /' ,. , / I), ; ^ 2, . r We can now 

slate (he following result; 


Theorem .V Lei the system (7, (i, //) defined above have an 
uncontrollable tm<y iinohscrvahle mode at A Also, assume 
(without loss ol generality) that the eigenvalue A 


corresponding lo (his mode is in the (ri. n)th position of 7 
Phen rank ^ !) j ^ ^ blocking 


zero i>f the system (7, (», H) where 



Proof. See Appendix 


Phe above result can be easily applied in characterizing 
d f ms of (2 1) Once the set has been partitioned into 

disjoint subsets H, and Q,,. the matrix O' will be 
the partitioned matrix |f;,, (i,^ 0,J and ihc matrix H will 

be the partitioned matrix \H,[ ^ 

One way to obtain the partitions and U,, is to (ind all 
the stations from which A is uncontrollable and all the 
stations from which it is unobservable. This can be done 
merely by inspection once A has been reduced to its USF F 
with A al position (n, n) and (1,1) to check for 
unconirollability and unobscrvabiliiy respcciivcly For 
complex-conjugate pairs of eigenvalues, we can avoid the use 
of complex arithmetic by reducing A lo an RSF, wiih the 
corresponding 2x2 blocks at the bottom right and top left 
corners to check for uncontrollability and unobservability 
respectively. However, the information obtained from the 
above inspection may not necessarily give a disjoint partition 
i.c. U, n H,,# 0 where 0 i.s the null set 
If there IS a station y such that y e Q, n then for (2.4) 
lo hold, A must necessarily be uncontrollable and 
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imobscfVftble fruMn ihe yih statKMi Ixl nu^,^0. To 

verify ihc rank condition in (24). ii is necessary to assiitn 
each element of V to U, or such that O U,, - 0 and at 
the same time, the partition should he such that if A ts a 
d.f jn. of (2.1), then the rank conditK>n in (2 4) is satisfied 

The problem of oimputing the d.f.ms of the system 
described by (2 1) can he divided intu two smaller problems: 
(1) Obtaining a set A such that the set of fined mi>des 
As As 0(4), The set A consists of all possible candidates 
for d f.m$; and (2) obtaining a disjoint partition of U (if it 
exists) such that the rank condition (2 4) is satisfied 

To find the set Ast^(4) that consists of the possible 
candidates for the d.f.ms. we remove all the eigenvalues of A 
that are controllable and observable from the same station 
'Oiis can be accomplished by reductions to BUHF and BLUF 
using orthogonal transformations as described m rheorem 2. 

Remark. AW A, e A need not he d.f ms of the given system 
The set A contains those eigenvalues of the system which art* 
possible candidates for d.f.ms L/sually the set A is a very 
small subset of 0(4), 

Having obtained A, we now need to examine each element 
of A to determine whether or not it is u dim of the system 
We denote the subsystem obtained at the end of the above 
procedure (after the controllable and observable subsystems 
from all stations have been removed) by an rilh order system 

(4, fl,, f/,). 1 = 5^1 .,V. Ibe elements of A are the 

eigenvalues of 4. 

In order to obtain (he disjoint partitions ^2, and il„ (if they 
exist) that also satisfy (2 4), ii will be nccessarv to evaluate ut 
some complex value A .several ‘ fratufer furn non reiations " ol 
the form 


\A/. ,-4) 'fi, 


(-V1) 


where i. / e il and i ^ j. The matrices A. fi, and ( \ alxivc are 
obtained from the system (4. C,) as shown IkIow I cl 


A - 


O' A 


O' 

O' 

r 






fij, U 2 ,, I 

A ii, , , ) 

0 A 




4) 


Then 


r^ii "n 

o' A + a., 


0'^ 


<*: , * 


. ^ “ K (I ^ 




Next, we will discuss a systematic procedure which enables 
U.S to find the required disjoint partition of Q into 12, and U,,. 

Aif^oritkm 1 (To find disjoint sets U, and 


Sttp 1; (a) $cl q - \ and A = 0 . 

(b) Tran.sform (4. fl/. Q). / - 1.A/, such that A 

IS in IJSF with A^ in us (L U position 

(c) Form a scl where Q(, contains all the stations 
for which the first columns of the output matrices C), 
/ = 1, . . . , A, arc zero vcctors. 

Slep 2; (a) Transform (4, B,, C,h i~\, A, such that 
4 is in USF with in its Jii. n) position. 

(b) Form a set Q, where C2, contains all the staimns 


for which the Inst row> ol tlie input mairiises H,, 

/ ’ 1. . A . are iei'toi> 

Sitp .V Let the sets U and guen hv U, 

K- 

where the ' iisieitsked " clcmentis are 
the ones which coirespond ti> the stiiinMvs (rom 
where IS either ciuiirollable but u!iol>M?rviibk or 
urK'ontrollable but ob.sc:r\ablr Form * U, f 
.10 iuid u, - (/:. .i;i. 

(1% ,. . IJ I and A “ I, 

.Sirp 4 (a) ( orresjwniilmg to the A th (asterisked) station of 
fomi .V, , A) /1 U, 

th) For / ♦ U. 

( I ) If .S,^ II and It U go to Step 

( II ) 11 ^ b and /1 UA 

Set ti k2 ' ! {/} (remove / tiom Q ) 

Si-t L2„ ^ {{] (add t to UJ 

Set 'I* • 'V ( I |/). go In .Step 4(c) 

(Ml) It 0 for all / fi 12, ^o to Step 4(c) 

(c) II all (asterisked) stations of 12, arc exhnusled, 
go lo Siej> b 

FlIsc, vet A - A 4 1 and go lo Step 4(ii) 

Step ^ lltcre is no ilisjoini paitiiion (or which (2 4) is 
satistied Ibcielore, A,^ is noi a d ( m ()o lo Step 7 
Step 6 Sc( U, U, ; (he disjoint piiMilion salislyrng (2 4) is 
given by 12,, and 12, rhcrelorc is a d.f in Set 
A A (I) A^. and go to S(e[» 7 

Step 7 1( q • M, stoj); else set if q 4 I and go to Slep 1(b) 
Ai the end ol Algorithm 1. the set A(i;. A) atniairis all ihe 
eigcnviilues i>l A which aic d I ms ol (2 1) 

Nfrnarks When A has some complex coniiignic pairs of 
eigenvalues, we can use (he rc<hiciii>n lo KSI in Sicps 1 and 
2 lo avoid cornplcs iinihmclii In Slep 4b. the coiulilion in 
( 1 ) implies that for al least one s(4iiion lhal musi aj>jH'ai in 
any dis)oini |).irti(ion ol 12. die translei lutvebon relation 
evalualeil al i\ noio/cro I his. in turn, means lhal there is 
no disjoint partition of 12 that sabslies (2 4) lot A,^. I he 
condition in ( 11 ) coriespoiuls to (he Case where the stalion is 
ill both (2, and U,, II the condition is satislied. then ihe 
stalion cannot be iru luded in U, So wi* include it in U,, and 
U,, and remove ii Irorn L2, and In oiilei lo conform with 
Ihe value of A in subsequent steps, we shall assume that Ihe 
o|H‘ration of sei addition in Step 4b (n) corrcsjxituls lo 
including the slaiion I al ihr end ol the set 12,, ( ondilioii (in) 
does not provide any additional information about lorming 
disjoint partitions ol L2 excein to say that A^^ could be a 
d ( m II 'V IS die ernplv sei but is iiol a d.I.m . llien 
eorulitnm ( 1 ) would be satislied 

4 Doi USMiin oj thf rrwi//v 

In this scdion, we will diseiiss various eompulaiional and 
numerical proiKriies ol die pro^nrsed algorithms 

4 1 (icneral remtirky 1 Note that the eompulaiional 
priHcdurc lU’velnjsed in this (>a(H*i assumes Ihat Ihe stale 
matrix is cy<//i I his re.smels die cbiss nf systems loi which 
wc can eornpule d I ins However, ii should lie (xiinied out 
dial the eigenvalue problem (or mm (Vi la mainces is often 
likely to be [mmuIv inmliiioiied (Mewari. 1974) Therelore, 
any procedure that requires knowledge of the eigenvalues of 
such non cvelie slate rnairnes will give inaccurate results 

2 Dccentrali/aiion can f>e considered as one class of 
constraints lhal can be imjvosed on a (ccdback structure. A 
more general class can be defined via arbiiiarv eonslraiius on 
the elements of feedback matrices For such systems, the 
proposed mclhiKl will not be suiiafde for computing "fixed 
modes” whereas the eigenvalue approach of Wang and 
Davi.son (1974) can Ik used 

4 The tharaelcri/alion of d ( ms in terms of bliKking 
zeros of cenain sulisystems derived from the given 
decentralized system i% consistcm with the eharacteri/.alion 
given by Davison and Wang (l9H.'i) ol d f.ms m terms of 
transmission /er<is Such charnclcriZiilHms provide "struclur- 
al” information alioul the dccenirali/ed system. It sluuiid be 
mentioned lhal the characten/aiion d»KS not impose any 
rc.slnclion on the structure of the decenirabzed system 
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Simpler results can of course be obtained when the system 
haft certain additional properties, c n , block diagonal 
structure for A, or interconnected Nystems with only input 
and output matrices in block diagonal form 
4 The algorithm for obtaining A, uses cmly orthogonat 
state aMirdinatc transformations and is numerically "back' 
ward Hiable’ (Van r>oorcn, 1981) This is a desirable 
properly of the algorithm from the point of view of its 
application to very high order systems For greater 

reliability, singular value dccom^ioftiiion (f^atel, 1*^81) can fie 
used for the reduction of the system to its BIJUF 
5. The breakdown of the operations count required for the 
proposed algorithms is as follows. 

(a) Obtaining the matrix A This step requires .several 
reductions to block lower and upper ffes.sciiberg furm.s 
and involves approximately 

% / 

X + X + /'->) 

A ... I ' , i > 

operations, where u, the dimension of (he original 

system; k ;r 2 . is the dimension of the subsystem that 
IS unctmtrollahic an<l/nr unobservable (rom the previous 
k " I stations; r is an integer which is the smaller ol N 
and the minimum niiml>cr ol stations from which the 
entire .system is controllable and observable 
fb) Finding the elements of the set A; f'hcsc elements 
correspond to the eigenvalues of A and typically n«n. 
Note however that since we need to evaluate the transfer 
function relations il would be advantageous to have 
A in upfier llesscnbcrg form Reducing the entire system 
to upper flcssenbcrg form would require approximately 

fi‘( i y (ni, f pj ) 


operations. 

(c) Obtaining the partitions U, and 0„; For ihis step we 

need to rearrange the eigenvalues of A to determine the 
stations from which a particular element ol A is 
uncontrollable and/or unohscrvahlc. In this case, since 
the value of the shift in (he (^K algorithm is known 
(Ciolub and Van l.oan, this requires upproxi- 

matcly ri' operations lor each OR step. Including the 
iransrormations on H, and ( ,, we need approximulcly 

n*|/i f V (ffi, > p,) J 

ufxerutions lor this step. 11 A contains a complex- 
conjugate pair of eigenvalues, then an implicit double 
shift can be used to get an RvSF. 

(d) The number of transfer function relations .V,, that need to 
be evaluated to lind the disjoint partition depends on the 
given system data and therefore cannot he specified a 
pnon. However, a rca.sonahle operations eounl for each 

c. A is approximately 

(n 1 )‘(m “ I f y m, + P, ) 

I -1 

where A and N .v are respectively the numiTcr of 
elements in and 12,. 

Note that in Step (a), lor most practical systems, n^, k -'2, 
would generally be much smaller than n. i.c most of the 
modes of the system would typically he controllable and 
observable from many of the stations, llicrcforc, taking into 
ac'counl all the operations mentioned above and dropping 
the less signihcani terms from each step, we require 
upproximaicly 

V 

(2 + y)n-|n(^, + 4) + ^ (w, +/),)] 

operations for aunputing all the decentralized fixed mixlcs. 
where y is the number of transfer function relations that 
we need to compute in order to find the disjoint partition of 
U. If the aproach in Anderson and C'lcmenls (1981) is used. 


the count will be considerably higher because it requires 
several rank tests on systems of order grc^iter than n. 


4.2. /liusiratntr example. We shall now illustrate Algo- 
nthm 1 by an example of a decentralized .system with 
Q, « (4. 1,2, 5,6. 7). Q„= (F2,5,6,7,3). - {4} and 

"(3). llicreforc, using the notation in the algorithm. 
s 1 and V - 6 . Oiven below arc the results at various steps 
of the algorithm for checking if a scalar € A is a d f m of 
the given .system; 


A - I 

Step 4 a ‘v. A “ 3 . Fvaluatc |A\|.V^>.S\4 .V,v5'm,V i^l at A^ c A, 
Ixri .Sm - i^nd .V,,, 5'v, ^ 0 
Step 4 b(i); TTii-s condition is not sati.sfied (.544 0 ) 

Step 4b(ii): Since .S,,. .Vy,#(), remove stations I and 6 from 
Q, and 'R and include them in 12„ Hus gives 
^ {2. 4. 5. 7}. ^F-{2.5. 7). - (4) and 

tin - (3. l.b} 


k - 2 

Step 4a; tv,* - I t.ei 

Step 4b(i); This condition is not satisfied (.V ,4 ■ 0 ) 

Step 4b(ii): Since rcmcive station 2 from Q, and 

and include it in i2,,. This gives H, - (4. 5. 7), 
^ 15. 7). il, - {4} and il, - 13, 1.6,2} 


A - 3 

Step 4ii: ^ 6 Let Si^ - 0 for all / c Q, 

A - 4 

Step 4a; - 2 Let 3^ • 0 Fir all / ( U, 

Step 6 A,^ is a d i m and the disjoint partition 

(1,2, 3.6) and il (4.5.7) satisfies the rank 
condition (2 4). 


In the above example, if either 3,., or .S'^, were non-zero, 
then A,^ would not be a d.f.m If 3,,, and were non-zero, 
but 3^4 and were zero, then would he a d im with 
i2„ - {1. 2, 3. 5, 6 , 7) and |4}, 'Lhe algorithm ends 

when a disjoint partition is found or else when a eonelusion is 
reached that no disjoint partition (lor the value of A,^ under 
consideration) satisfying (2 4) exists. 


5. Numerical examples 

In this section, we con.sider two numenciil examples to 
illustrate the proposed algorithms. 

l:xample 1 ('onsider a 3-slalion decentralized system. The 
matrices describing the system are given m 1 able I I'he stale 
matrix has eigenvalues at | 2. - 1 5, - 1 t), 3 0. 2 5, 2 1 ), 
1.5. 1 (!). It IS found that A - {2.1)) i.e only A - 2 0 is a jTos.sible 
d.f.m Next, it is found that A - 20 is unobservable from stations 
I and 2 and uncontrollable from stations 1 and 3 Ihcrefore 
C2„ “ (/,. (*) and i2, - {fi. 1 *) Following the steps of Algo¬ 
rithm I, it IS found that , A,,) 'W,i and 

3^, “ 1 ' A,,) ‘B,, are both z.cio matrices for A,^ ■ 

20 I'he elements id the matrices 3., and 3.4 are given in l able 2, 
I'hcy are of the order ol JO and can he safely assumed to be 
zero Therefore, we have the partition Q, ' ^nd 

- b:) which are disjoint and sali.sfy the condition in (2 4) i.c 
A 2.0 IS a d f m of the given system 

Example 2. In this example, we will illustrate a difficulty that 
may be encountered m deciding whether or not a particular 
eigenvalue is a d.f.m. using the lest proposed in Wang and 
Davi.son (1973). For instance, depending on how a random ’ 
decentralized feedback matrix aftecis the closcd-limp 
eigenvalue problem, it may not always be possible to say 
conclusively by inspection of the of>cn-loop and closed-loop 
eigenvalues whether or not there arc any d.f.ms. The 
difficulty is increased further when the eigenvalue problem 
for the open-loop stale matrix is ill-conditioned. The 
characterization and computational algorithms presented 
here enable us to conclude with greater certainty if a given 
mode is a d.f.m. or not. The data for Example 2 i.s given in 
Table 3. For several randomly generaicd values of feedback 
matrices with their elements of the order 10 ^, it was found 
that certain eigenvalues of the system do not ‘move” 




Table 1 V arioi’s MATRicK,st in Example 
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appreciably. However, as Jhc magnitude of the elements i>( 
the feedback matrices were gradually increased lo ibc 
eigenvalues changed completely Table 4 compares typical 
values of some of the open-loop eigenvalues with Ihcise of 
the closed^loop eigenvalues for 2 reprcsenuiivc sets of values 
of feedback gams: - 10*' and 10^" where the are 
the elements of the randomly generated decentralized 
feedback matnees. 

It .should be noted that the eigenvalues at -3 0 and 2.5 do 
not change appreciably for ^ 10^ but are altered 
completely for k,^ 10'". In eontrast. corresponding to the 

eigenvalue ai -4.6. we have eigenvalues at -4.50492 and 
-4.4b<i91 for A^ - 10^ and 10‘" respectively Such obMjrva 
lions with this and several other examples suggest that some 
difficulties could arise in computing the set of d f ms using 
the charaacrization given in (2 3). Applying the algorithms 
proposed above, it was found amclusively that the system 
docs not have any d f.ms lliis was further confirmed by 
performing the rank lest (using the singular value 
decomposition) on the system matrix in (2 4) 

A question that arises from Example 2 is what numerical 
or "threshold*' value should be used for "zero" in the 
algorithms proposed in this paper Among the numerical 
techniques used in the algorithms, (he maximum error is 
accumulated in the reduction of the state matrix to an RSI 
and hence an error b<jund on this reduction (Stewart. 1^173; 
Wilkinson, 1%.S; Cioluh and Van l oan. IMHSt) may be used to 
define a value for "zero’' 

6 . Concluxiotu 

In this paper, we have u.scd a charactcri/ation of d I ms 
given by Anderson and Clements (1981) lo define d f ms in 
terms of bl(K'king zeros of certain subsysicrns of the given 
decentralized system. Based on this chanicten/ation, an 
efficient and reliable method has bi*en propi.»M:d (or 
compuling d.f.m.s The compuiatioiiLil method uses only 
orthogonal transformations and can l>e easily implemented 
with software available m scientific programming packages 
such as IMSL. EISPAC K, UNPACK, ek Exten.sive 
numerical tests carried out so far suggest that (he proposed 
approach is numerically more reliable than existing rnclhods 
lor computing d.f.ms 
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Appendn 

l*r(H>f ifj Theorem V Since A is an unconlrollahlc mode of 
(/-, a, //), il follows Irorn the struckire ol / and (i that, 
g, ,, 0 Al.^o. siiue A IS an unobservable mtHle of (/*, (i, //) 
and T is a cyclic matrix, we have 
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where ^ ^ r ■ ^ii) 'T/- /2, , / + I and 

« denotes possible non-zero vectors Since 
r 2, , r, It follows that ^:f(A) - 0 Next, performing the 
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clcmentury row operations mentioned above on the matrix 


p/, F 

1 H 

G 

0 J’ 

we obtain 
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0 . 

* n “ r 4 rank 


flA 


h., h.r 
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/m 


fy. fy, 
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|_#,(A) ■■ ♦,(*) H,ai„ ,-Fu) J 



llic right hand side of the above equation is exactly the if and only if A is a blocking zero o( (f . 0. W) The result of 

result that we would get if we were to apply the elementary the theorem then follows, completing the proof 
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AbslnKl“-A nunilKT ol large-scale inteiLonncclcd systems 
often encountered in practice arc com|>osed ol subsystems 
with similar dynamics interconnected in a symmeincul 
fashion and the synthesis of controllers for such systems must 
exploit the special structural profHTiies in order to avoid 
overly conservative designs and to lake advaniagc ol the 
fxissible beneficial efTecls ol the interconnections. An 
analysis of some imp<ir(anl Ljualilaiive pro|X;rtics of such 
symmetrically inicrconnecicd syslcnis locussing on the 
spectrum characlenzHlion, controllability and observability, 
and the solutions of (he algebraic Riccati equation and the 
matrix Lyapunov equation is conducted in this paper and 
procedures for consirucling the solutions to the analysis 
problems at the overall system level from the computation 
ally simple subsystem level solutons are dcvelojK'd A 
deccnirali/eil coniroller design procedure is presented as an 
illustration of the utili/ation of the available structural 
information m addressing synthesis problems Numerical 
examples arc included to demonstrate ihc sujHrnoniv ol the 
presented designs over the use of existing approaches which 
do not lake full advantage of the structural knowledge in 
these large-scale syslcnis 

1. Inirodmiton 

A n'NiJAMi NiAi structural feature often observed m several 
large-scale systems commonly encountered in the real world 
is the identical nature of the operational characteristics of ihe 
components, such us the subsystems whose mlcrconneciion 
constitutes the large system under mnsideraiion and Ihe 
interconnection units u.sed to interconnect these subsystems 
Allhtiugh true in several naturally evolving systems as well, 
this is particularly prevalent m engineering systems 
assembled by man. since a pHipular strategy for constructing a 
large system is to mass produce several smaller but identical 
components and to perform the assembly by iriterconneciing 
the subsystem blcxks using the interconnection blocks Ilie 
reasons for employing such a strategy could be .several; the 
principal ones being the use ol automated and standardized 
design prtxedurcs for the mass production ol components 
and the desire to employ massively parallel computation 
where a number of identical units arc operated in parallel for 
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distributed processing to achieve a system-w'ide objective, 
llie phenomenal growth ol interest in neuro c4>mpuiing and 
artificial neural netw'orks in ihc recent times can lx* 
iillnbuted lo the latter rcuMm (llophcld, 19K2, Ruinclhart 
and Mc( lelliiiuL 19Kb) Such principles arc employed in the 
synthesis of various kinds ol sysiems ranging from iirn'rolevcl 
implementations (such as m VL.SI/VHSIC circuits (Mead. 
1989)1 to maciolevel assemblies (such as in |xiwer sysicm 
networks comprising ol icKrnliciil gcncialing units with 
balanced interconnections lor exchange of gencniled (xiwcr 
(Elgerd. 19KI; (jlaviisch and (talianii. I972)| and have also 
contributed to the evolution ol several popular iirchilectures 
(such as the star lopoiogv in local area computer networks 
(Stallings. I9H4)| 

Lhis pafxr is concerned with the analysis of some 
fundamenlal profxrties ol a class ol dynamical large-scale 
systems assembled from inlcrctmneciing identical subsystems 
and with the idenlilicalion ol a lew synthesis priKX'durcs that 
exploit the special structural arrangement present in these 
sysiems .Spccilically, we shall consider a large-scale sysicm '/ 
that may be described as an mlcrconneciion of \ subsystems 
... -V,. bv 

j,(0 - A,.4,(r) + V + /(,n,(/) 

; I (II) 

y,ff) ( 1, 2, . . 1 , 

where x,{ ). H ♦ K'' and y,( ) W .System (LI) can lx 

equivalently ilescribcd by the conifxisitc equations: 

x{i) Axil) f Huii), v(0 C 1(0 (1.2) 

where x{ ) .H -* ^ x' { ) \x\{ \x]{ ) i/( )|. u( ) : 

i u ' ( ) -^ |u,'( )ii?( ) u;i )\ and y( ):/^--• 
y'( ) ■ |.v?f )y f( J )|. with the composite 

matrices A r /T'"’'’, h r ^ 

structure 




fiv 



-^1 


■■ 


«... 


• • A,. 


B ^ cliag(AJ|), and C ^ diag(f J We shall hereafter refer to 
this system a^ a Symmetrically Interconnected System. 

It must be emphasized that one finds several mcjdeling 
studies in very diverse areas resulting in state models of the 
type dcscribird by (1 1) and symmelrically intcrconnccicd 
sysicms arise as models for several physical pnxcsscs. In 
fact, a numlscr of these application areas arc quite 
well-known lo control spctialisis since these models were 
developed in the course of designing appropriate control 
strategics for these sysicms For the sake of illustrating this 
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daifFi, wc fihall hncHy mention a (cw examples ul 

mmJcl dt*vclopmc^t^ ((jbtamed cspuTLially lor controller 
jiynllicsis), (fiving references lor details A formulation of the 
load-lrequcncy tonlrol problem in [i multi machme power 
system given in Mobadjer and Johnson IP/H3) and Abdulla 
flVHbJ results in a large scale interconnected system having 
the structure (1 Ij Models having ihc prcsenl structure for 
indusinal manipulators with several degrees of Irccdnm are 
dcvelofx'd m Vukubraiovit et ai. (l'J77) and Vukubraiovic 
and Stokic <I‘^H2) and are shown to be appropriate vehicles 
lor the synthesis ol improved control strategies. In BryMrn 
and Ho (IWJ) can be found a model of the present type for a 
mechanical structure comprising of a number of spring- 
coupled |:H.'ndulums lor which control schemes using 
traditional optimal control theory arc dcvelofxd 

While the above examples serve to illustrate the iRCurrence 
of symmetrically interconnected system modelf. in several 
applications when; the models are tlevcIofHrd for the explicit 
construclioii of control slrategies, several other applicainins 
iMJlside the mainstream control interests alKiurul for 
example, syrilhesis of neur:il networks employing the (Hipular 
llopliekl type rmuIcK for optmii/tilion and input-output 
mapping ap|>lieafioris are diseus.sed in I’ineda and 

Sudharsanan and Sundiireshan (l‘^K'J) where symmetrieally 
inlerconnccled system slruelures arise as network arthiice 
lures of choice In addition to their frequent oeeurrence in 
diverse appliealions mentioned above, symmetileally mler- 
eonnceled systems offer a very efmvcnienl fiamework for 
several mvesiigations which could he used at the first step in 
the analysis and design studies of more general large scale 
systems and modilying ilie results at the later steps through 
appropriate periurbiiiion afiproaehes 

Symmetrically mtereonneeted systems have been the 
subject of some study in (he recent limes, which have miimly 
focussiTil on the siahililv iiruilysis ol the composite system 
(Hergen, ld7d, Ualiga and Kao. I WO; l,im/e, I WO). An 
im(>orfant outcome resulting from these works is the 
conelusive (lemonsirahon that the knowledge of the 
struclural infoim.ilion can be utili/ed for obtaining 
sigriiliciinlly improved results compared with the approaches 
that allempl to investigate the properties ol general systems 
with aibnrary inlereonneclions It is evident that the latter 
approaches are generally more conservative, are of a 
weak coupling nature (Jamshidi. I0K3) tiiuJ ignore the 
[■Hissible heiieticial efteets ol the mlerconneelion pallerns thus 
disregarding tfie inoperative lunclioning of the subunits 
which underlies the synihesis ol a maiorily ol engineering 
systems In particular, (oi several complex leehriologieal 
processes synlhesi/ed such that the subsystems must 
coofierate m ordei to execute a specific task, ii^e of overly 
general approaches (i e results that iiie developed under 
very geneiul sellings in oidei to he valid loi aihitrary system 
structures and syslerii ob|eclives) could indeed he disadvan¬ 
tageous and may simply not jHiitrav Ihe riMlity of the 
environment 

In this [lapei. we sh.ill examine some lundarnental 
properties of symmetrieally interconneclecl systems, mainly 
focusing on the eigenvalue ehiii aeteri/aiiun and the 
cunirollahiliiy/ubservahiliiy questions I'hese are lurlher 
ulili/ed in the development ol solutions to the algebraic 
Kiecali ecjuatioii and ihe 1 vapunov matrix equation which 
are encountered in seveial areas ol system analysis and 
design As sfH*eilie illustrations ol how tfic knowledge of the 
siruetural inlormation can be exploited m the design of 
synthesis pivK'edures, we shall preseni a tew results lor the 
synthesis ul deeenlialiAed eumrolkTs fur stahili/ation and 
pidc plaeemem. Ihiough luimeneal examples, we shall 
dcmonslraic that these designs offer significant improve¬ 
ments over Ihc existing approaches for this class of 
large-scale systems rhe contributions of this paper are the 
viiiious analysis results presented in Section 2 and two 
syntheses results presented in Section ^ 


2. Amij/wiv o/ i/Mu/r/iifii'i' /iropernes 

f or the system :/ cleseiihed by (l.l) oi (1.2), lei us define 


.*1, - .'I, 4 (I - \ 


(M) 


Wc then have the following results. 

Lemma 1 (Eigenvalue characterization). 

spec {A) ^ spec U juspcc (A^)| (2 2) 

where IJ sjk‘c iA^) - spec {A„)U spec iA^)U ’ * U spec 
(A^) (i e eigenvalues of A„, repeated (.v - 1) times) 

Pr(Mf. Consider the malnx 7 e given by 

/ ()()(* 

/ / (I IJ 

7 - /II / ■ 0 ( 2 . 3 ) 

-/ f) I) 

where / is an n x n identity matrix Then, 

A, //,, //„ H,n 


Hence the result follows ■ 

Lemma 1 is useful m analyzing the stability of the 
uncontrolled system l e system 7 with u = 0 It may be 
noted that evaluation of the eigenvalues of the smaller 
dimensional matrices A,, \r H'*’'' and A,„ f is .sufficient 

to conclude the slabililv of the overall system 'J of dimension 

S7I X \ n 


l.emma 2 ((’ompleie conirollahiliiy I System ./ is completely 
eoritrollahic (e e ) if and only it the pairs [A^, and 
{A,„. /f, j are both c e, 


Proof, Using the transformation matrix 7 given in (2.3), 
A LA I' ‘ IS obtained as in (2.4) and further, 


7J, n (I 

/J, H, 0 

H TP 7L 0 H. 


0 

0 

(2.5) 


0 0 

Now consider 
M^\al A : 

ai A,, //,, W, I) 

0 al - A,, U 


(I n 
0 


0 0 


af A,„ I) 


Then, it follows (C hen. IW4) that 

(A. fl) c.c.O(A, H) c CO Rank (M) ~ sr\ (2.6) 

Let D "O'-«('I 'rrii constructed in the form 
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Then, 


M^MD^ 


ral-A^ 

0 aJ~ A„ 


L 0 0 


“//jj : fl, 0 

0 i 0 H, 


a! - A„ 


0 0 


0 

0 

B 


and hence. 

Rank (A#) »= Rank (Af) « Rank \ at - A^ ; i9,| 

+ (j ~ U Rank (cr/-; fl,|, <2 7) 


Since Rank \ al - A^ i ^,) and Rank \ al ~ A ; /^,| cannot 
exceed n. It follows from (2.4), (2.5) and (2 6) that {A, B) 
c.cO(i4p. a,) c.c . and /?,) c.c On the other hand, 
if (^, B) is not c c., then Rank {M)<sn. which implies that 
cither or both of {A^. fi,) and B,) arc not c.c ■ 


Sufficient conditions for the complete conlrollabiliiy of 
both (Ap, Bi) and {A^, B^) can Ik obtained as 

(i) (>f,. i?,) IS c.c 

(ii) Rank|0, f/, J Rank |f},] 

For details, one may refer to Elbanna (19K8) 

By duality, one can obtain corre.sponding results for 
complete observability, which we shall slate without pnHjf in 
the following. 


Lemma 3 (Complete observability) System y' is l o if and 
only if the pairs {A^. C,) and (A^, C,) arc both c (v 
Of fundamental interest in the theory of linear dynamical 
systems arc the solutions to the algebraic Hiccati equation 
and the Lyapunov matrix equation, which arc needed for 
conducting various types of designs of controllers and 
estimators. For the .symmetrically interconnected system 
under consideration, such solutions can he constructed 
simply from solving corrcspi^nding equations for considerably 
lower order systems The following results provide ihe details 
of these constructions We .shall assume that {A, B) is c.c 

Theorem 1. Ui P,, 6 9 P„ ^ Pj, ^ 0 and P„ e ^ 

P„ ” P!„ > 0 denote the .solutions of the Riccati equations 

^ ^>^1 - 0 (2 H ) 

+ c;, = 0 (2.y) 

respectively, for arbitrarily .selected Q y € R'' ’ ^ Q ^ - Ql >(l 
and Ry e 9 /?, - A?f >U. where A^, and A„, are given 

by (2.1) Then the unique symmetric and jwsitivc dchnilc 
solution P 6 of the Riccati equation for the composite 

system (1.2). i.e. 

A^P+ PA - PBR ^B^P ^Q [) (2 10) 


where Q -■ diag [CAJ and R - diag {R y], has the structure 


With P parlitioocd as m (2 13). expanding (2.10) oiw 
obtains the two sets <d equalums, 

AjP^ + P,,A, - 4 0, - t - 1.2. .(2 14) 

and 

* P.,A, * /*«(«,.- - A',P„) + (W,:, - .v,r,')'r„ 

+ i I («.! - i v, p;. ) + (//„ - I .V, Pi) f*. I - (», 

* " I. j ^ \. 2. . . X. 1*1, (2, l.'i) 


where V, = fl,K|'fl|, Cl + + t'„ * 

I ,1 #< 

. Now, letting Fy « /*. V /. j 1, . v, ^ ¥‘ 

one can sec thal (»y t AffvA*, i F*//,. F; and 

0i ^ Vi ^ (V I)|W,V; 4 F;//,, - Fj.VVl follows 

that the solutKins of (2 14) me equal foi all i I cl Fj - F, 
denote this solution With these suhsliiiiiions, (2 14) and 
(2 1.*') can he rewritten as 

.AfF,4 F,/l, F,.V,F, y. M' ■ \) 

^ lA/fjF, 4 /V«S,F,1 - (I 12 16) 


and 


AU\ 4 r,Ay 4 F,(//,; .S,F:) 4 (f/;, F>.V,)F, 


^ ~ 2)|F,(//, 


0 




(2 

17) 

Now, muliiplying (2 1 

7) by (.i - 1) and adding the result to 

(2 IH). one obtains 




X t] 

,. 4 . 

(2 

IK) 

where 



I'r 

■ p, 3 (' - 1)/'. 

(2 

ly) 

Similarly, subtracting (2 

17) from (2 16), one obtains 



Al,r,„ + 

r„s,p„ + y, - 11 

(2 

211) 

where 





I'n, - /V 

(2 

21) 


Since [A, B) is c c . {A^. F,) and W,) are both c.c 
from Ixmma 2. which further ensure.s that the solutions A*, 
and F„, of (2 IH) and (2.20) respectively arc unique, 
symmetric and jxisiiive dcliiiilc. 

Solving (2.19) and (2.21) for F, and F, m terms ol P and 
F^ rcsull.s in the expressions given in (2.12). Al.so F in (2 1.3) 
reduces to the structure given in (2 11) Furthermore, using 
the transformation matrix 7 given in (2 3), one obtains 


f’r 

P? Pj 

Pi 

II 

Pn. 

(1 

r ^ tpt ' = (1 

0 /*_ ■ 

0 


F== 


Pi 

P. 


P, 

Pi 


Pf 

P: 


Pi Pi Pi 


(2 11 ) 


and hence 


0 0 


Spec (F) == Spec (F) - Spec ( P ^,) U I U Spec (F,„) [ 


where F, € and F 2 E K'”'" are given by 
F,=^|F^4(.5 - l)F,„l/.r) 

andF2-|F^-F,„|/i J 


( 2 . 12 ) 


Proof. For the selected Q and R matrices, the solution F of 
(2.10) is unique, symmetric and positive dehniic, since the 
pair {A, B) is c.c. Let the n xn matnx partitions of this 
solution be given by 


rPt, Pii Pul 

Pii Pn P^ 

LP.i />.: 


(2,13) 


Our objective is to demonstrate that F„ = F, V r = 1, 2, . . . , 

and F„ “ F, V I, y == L 2, . . . , J, I #y. 


Since F^ and P^ arc positive definile, ihi.s concludes Ihiil P 
given by (2.11) is symmetric and positive definite F'inally, 
since the positive definite solution of (2.10) i.s unique, it 
follows that F given by (2.11) is the only solution of (2.10) 
and hence, our proof is complete ■ 

The remarkable simplification resulting from the need to 
solve Riccati equations of considerably low dimensions only 
is evident from the above result Iliis properly is indeed 
fundamental in our being able to synthcsi/c efficient 
decentralized controllers and estimators for this class of 
systems By employing a similar construction, the soluiicm of 
the Lyapunov matrix equation for symmetrically intcrcon> 
nected systems can be obtained from solving corre.sponding 
equations of a much lower order, as given in the following 
result. 
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'fheorem 2 Lcl S[K,i: iA) c l.Hf' and SfKC (/t^) c /.//f*, 
and let f], e ^ f), - 1*1 - 0 and ^ > 0 

denote (he Mjlutioris of the l.yapunov matrix equations 


rurthcrmorc, following the steps in the proof of Ixmniii I 
(i.e using the transformation matrix 7 given in (2 3)), it can 
be shown that 


-* 1’,.'^, ^ L>^ ■ I) 

A'J',.. + Q, - I) 


(2 22) SpccM - «Af) = Spfc(/»^- /J,A:,)U j U Spcc(4„ - 


respct’livcly. for an arbiiranly se lected (7| < 7^"(7, - 
(7/ 0. where and iirc given by (2 1) llien the 

unique symmcirit and positive dehnile solution F f of 

the l.yapuiiov matrix equation for the composite syMcm 

(12), i c 


A'F f FA t (7 0 

where Q - dlag|C^|. siruciuic 

r/> l\ F: 

/^ F, F, 

where Ft € IF' and F, ( IF' arc given by 
I\ l)/'J 

and l‘: '\l], !•,„] 


( 2 . 22 ) 


(2 24) 


Froof flic proof follows along identical lines to that of 
Iheorern I and noting that Spec(/I^, )r /J//' and 
Spec (-4^,) c l.HF together irrqily from Keriirna 1, St>ee {A ) c 
IJIF. Hence, (2 23) has a unique symmetric ami positive 
driimte solution ■ 


3. .Vy/ilfnMrv of rontrof/er al^ipruhtm 

Hy making essential use of (he properties of symmelncallv 
mterconneeted systems outlined in the last section, it is 
possible to give systematic synthesis procedures for viinous 
types of controllers, l*or (he sake of tneviiy, we shall give the 
ilclails of only a lew illusiialive itinslniclions A greater 
variety of coiilmller synthesis procedures aiul a detailed 
evaluation ol the properties ol these controllers can he lounil 
in lilhanna (I^^HK) The specific design procedures that will 
be discusscil here are based on the following results, 

I'hforcm 3, I’Oi system / described by (11) or (1.2). let 
A, f 77"'”" 1 .Spec (.4 I 7f,7.‘,)r iJlF and lei W< fF"^' 
given by 


W - / (r l)(7/',,\' I A',//,,) (3 1) 

IS [losilive dclinite lor r s and r I), where A, i 
/V, ■() IS the solution ol 

(,4, /(,A-,)',V, ♦ «,A,) ( / . (I. (.1.2) 

/ being the n x n identity matrix t hen Spec ( 7t,7s,) ( 

LHP and Spec(.4„, W,Ak.’|)« IJIF, where 4^, and .>1,„ are 

given hy (2 1) l urtherrnore. ,S(x-c(.4 HK)i I MF. where 
K f i K diag 17C 1 1 

Froof. Starting with the system 

i(0 (4,. - /^,A,)c(n (3.3) 

where /( ):7^—*7^" and eornpuling the tirne-denvativc of 

l(r) .-'(O.V.rtO (,\4) 

along the iriijeciones of (3.3). one obtains 

.''(01(.4,, - fl.A.l'V, + H,K,)]:{,) 

- *’'(/)|(.4, - fl|A,)',V, + - ff.A.) 

4 is - + .V|«,..)].'(() 

= .’'(01- /4 - I)(//',,V, 4 .V,//,,||-'(0 (.2..‘5) 

Heivce, V(i) is nc)|ii>ivr dehnile it W' in (.4.1) is pixsiiivc 
dehnile for t- .v, which implies Spec (4,,A.) c/.///• 
Similarly, il cun be shown tha( Spcc(,4„, - »,A',)c LHI'. if 
IV in (,f.l) i.s positive dehnile for t - (I. 


and hence 


Spec (4 HK)i I IIP 


llic usefulness of the above result m the construction of 
informationally decentrali/cd stabilizing controllers stems 
from the property that K - diag[A,|. For the selection of A, 
given the pair (4,. Hj, ime may he guided hy the following 
considerations If (4,, 7f,) is c,c , there exist in general an 
infinite number of selections of A, that will make 
Spec 14, 7i,A,)r IJIF. We are however inicrcsicd in the 

choice of A, that will jxissihly make W positive definite for 
both T - I) and r - v Observing that a sufficient Ciindiliun for 
W to he positive definite for both r ^ I) and r v is 


II77,,II 


2(1 


I 

l)A.,(A,)' 


(3,h) 


where A^(A,) denotes the maximum eigenvalue of A,, the 
preferred choice of A', is the one that will result in a solution 
A, of the l.yapunov matrix equation (3 2) with the lowest 
value for A^^fA,). An analytical solution to this problem is 
highly complicated (es(X'cially when the ilirnension ul 4, is 
large) since one is required to solve nin 2) nonlinear 
inequiilities Available literature on (he 1 yapunov matrix 
equation (Karanam. 1^)K1. Mori vt al , 14K(4 gives only the 
bounds on A^^^lA,). but these cannot he used li.>r the problem 
at hand Approximate numerical solutions can however he 
determined lor each dimension ol (4, /f. A,) when the pair 

(4,,7f,) is m certain eanomcal lorm.s, and iteratively 
changing its eigenvalues f or the sake of illustration, the 
results of this compulation foi n 2. .1, 4 and > lor the 
eigenvalue locations to yiclil the smallest value ol A^d^V,) in 
(he case when (4,. /f,) is in the controllable canonical form 
are given in f able I. 

When (3 1) is not satislied hv the interconnection pattern 
existing m the system to |X'rniit the construction id a 
diagonal A matrix accorilmg to Iheorern V an allcrnaie 
construction of A can be made lor assigning the eigenvalues 
of (4 - UK) al arbitrarilv specified loealions. as given m the 
lollowing result 

Theorrm 4. For system J described hy (1.1) (or (12)). let 
A, t A"’*", r “ 1. 2. , .v, exist such ihai 

spec (47f, A ,) f (32) 


and 


spec (/f„, 7f, A,) ■ I / - 2, 3. 

where 4^, and 4„, are given by (2.1) and I ,, r - 1,2.i 

are sets ol arbitrarily spceifieil complex numbers I, ■ 

(A',. A'..A'„} saiisivmg the condition that lor any 

A', c f.. A‘,i H >A)* c I ,(A)* denotes the conjugate of A)), 
rhen 


spec (4 - HK) U 1 1 CVS) 


Iahi i I 

ri Eigenvalue lixations for minimum A^,(A|) 

2 -Ill4142y 1 36()S 

3 - 1. - I.267M. -4.7321 3024 

4 - (1. .S i 0.86(1/, - I (I43h, -230564 S 177 

5 “ (),3i (I 714/, - 1,3H3, -3.MH. -5 240635 
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for K e given by 

A, U 1) ■ 0 

Ki" A': 0 (I 

Aj~A, 0 A\ 0 (.V9) 

A', “ A. 0 A, 

Prcpof. The prcKjf follows simply by observing ihiil - 8K) 
can be transformed using the transformation matrix 7 given 
by (2.3) into 

D - TiA - BK)r ' - 

Va^-h,k, //,, w,, //,, 

0 n 0 

0 0 ."/fiA, (I 

^|A, 

and hence, spec - TfA) spec {[)) - spec (/!,, ~ ff,A,)U 
spec (.3^, /f I A ,) U s|x*c (.T^, 7f, A J U U sjxrc (/t^„ 

«,A,) I 

It should he noted that A m (3.9), although not diagonal, 
has a special structure and hence does not correst)ond to the 
gam matrix of a cenlrali/cd controller, in faci. ii results m a 
decentrali/cd control scheme with a minimal information 
exchange in that subsystem 1. receives an additional 

input (A, - A,)a| If the design ohjcelive is not arbitrary 
eigenvalue assignment, hut slabili/ation ol the overall 
system, f', may be identically chosen lor all / - 2. 3. . . . v. 

which implies A> A', K, f urthermore, il A, c A''*'” 
exists such that spec (/I/f, A,) r /.///» and spec 
(A^, - /f,A',)r LHP, then the choice ol A\ ^ Ai V/ 
1,2,3,. , v, lesulls in a diagonal A and hence a 

corresponding dccenirali/ed control scheme u - Ai 

A parbcularly noteworthy feature ol the present designs 
arc their simplicity in the construction of controller gams 
compared to similar controller <lesign procedures lor 
large-scale systems one may find m the literature I here are 
no iieralivc calculations that are needed m the determination 
of controller gams, which are mainly computed f»y simple 
pole placement compulations. Ihe present designs also 
follow' precisely executed steps m the sense that (here are no 
trial and error compulations needed as in several available 
designs lor these types ot systems.t In addition to the 
computational simplicity and precision, ihc present design 
al.so permits elements ol considerably larger magnitudes in 
the interconnection matrix. This is of considerable iniciesi 
since most of the available results for large-scale systems are 
of a weak coupling nature and impose very restrieiive 
conditions on the norm of the interconnection matrix lor the 
design to be valid Some numerical examples to illustrate this 
claim will he given in the next section. 11 is to Ik emphusi/ed 
that these advantages are a result of our being able to exploit 
the available structural knowledge of the interconnections 
present in the overall system. 

By employing duality arguments. eorrcs|^vmding designs 
for constructing observers for symmetrically mtcrconnccied 
.systems can be developed, which possess several advantages 
over the decentralized observer design procedures available 
in ihc literature (Sundareshan, 1977; Sundareshan and 
Huang, 1984), For a concise description of the procedure, 

+ The constructions arc often ba.sed on an initial choice of 
Lyapunov functions for the is<ilaicd subsystems and the use 
of stability arguments for the overall system following cither 
a vector Lyapunov function approach or a weighted sum 
approach (Jamshidi, I9K3) The trial and error nature of the 
design stems from the fad that if Ihc interconnections do not 
satisfy the required conditian.s, one is obliged to Mart with an 
alternate selection of the subsystem Lyapunov functions and 
repeal the entire process 


consider the i>hscr\atii>n scheme 

M, - + AC, + A,u,(i) 

+ S 1^,(0 

+ (0) (yio» 

and 

l/(f) “ (A, - A,C t AVv/(f) 

+ /»!. .V ,.v, i.vin 

which together with (LI) results in the ‘ error sysicm” 

» M, - V |H,, (*:, A',K ,!•■,(0 (3.12» 

and 

- A,( ,»<■,(;)+ V (t). 

r'l 

1-2. ^ .V, (3.13) 

where f,(0 - x,{i) ■ t « 1. 2. . s ObsciA'ing ihul the 

problem ol interest now i,s the selection of the observer gain 
matnccs A, i - 1.2,. . .v. such that (3 12) and 

(3 13) arc asymptotically stable, one may readily consirucl, 
by duality, observer design ulgonthms that parallel the 
umiroilcr design algorithms given alxive More dclaiU on 
this construction, together with additional discussion on Ihe 
propcrlics of ihe observer, may be found in lilhanna (1988), 

Some examples; 

Lxamplr I (onsidcr the Symmelnciilly IiUcrconnedcd 
System 

i,(f) - f t V 


V,(|) - c ,1,(0, 1 

1. 2. 

where 


0 1 

0 

0 0 

1 

3 254 1472 

4.375 ^ 

0O71K (1,828 

0,2584 

- 1 0 (»().3 0 27,32 

0.3084 

ll.]33K (I274^ 

1) IM2 

Bf |0(l 1|' and C , is arbitrary 



Selecting A, ^ |9,2542 U)..‘)2H 1I 37.S1 to place the 
eigenvalues of (A, - H^K^) at 1. I.2b79 and 4.7321 (see 
table for eigenvalue IcRaiions given eailier) and solving (3 2) 
for N,, one ohiains 

I (>944 -0,501 

N, -0.50) 0()(i(>7 "0.501 

-0h(>b7 -0.501 1 502 

Now consirueling W, and as 

1,9242 OfMHH 0.0604“ 

fV, - /4 (A/f,\, 4 A/,A/„) - -0 1)488 0,9445 -0.3471 

[ 00604 - 0 ,3471 0 9871 _ 

and 

0O70H 0.0488 -0.0604 

W,-/~(//f,N, 4/V,7/,,) " IH)4HK 1.0555 0,3471 . 

[ - 00604 0.3471 1.02129^ 

one can check that )V, and W 2 arc positive dcrinilc. Hence, 
the decentralized conirol scheme ii,( )« - A,jt,( ), 1,2, 

.siahilizes ihc given system. 

For comparison with available methods, il may be noted 
that the inlcrc<mncciiun matrices in this system do not satisfy 
the required conditions for dcccnirali/cd stabilization by any 
of the earlier developed results, including the most general 
and recently developed results due to Ikeda er al (1983) and 
Shi and Gao (I9H6) Iliis example conclusively demonstrates 
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the; Hupcriority of (kKign procedures Kuch aft the pre«tcni erne 
v^hich conjitructivcly ulili/.c the availahlc kiHiwlcdgc of the 
mtcrconncttion ulructurc within the f^ysicni when compared 
with design prcKcdurcs that attempt to stahili/r a broad clafiN 
of large scale syisternR with arbitrary mterc^mnection 
structures, which naturally yield overly con.wivaiive (and 
hence less useful in practice) results 

t.xufnplf 2 ( onsider the Symmetrically Interconnected 
Syslctn 

i,(/) f V //, 


where 


y,in - ( , I 1. 2 . \ 

I 0 1 

A^ ■ (I (I 1 

I I 0 S 


0 S27 (I 6702 U 127H 

//,; (Hm 0 16.11 0 2720 

()4SV2 0 VVtS 0 ryg, 

|1 2 4|^ and f , is arbitrary, 

following Ihc steps ol the design algorithm, one can 
delernuiic that a seiccnon ol R'" ^ such that W, and W, 
arc both positive ilefinilc cannot he made Hence we follow 
the eonstruetion in Step 4 Since A^. and 

A„, A , //,. are 

2.1)S4 I 4SK4 4.2.SS6 

A,, O 10 0 426(1 0 4S42 

[ l,^Mk>4 1 6fi7 0 712 

and 

0 474 0 6702 2.8722 

A„,- 0(t*^S 0,1644 1,2720 

() 5468 0.6()(i5 'O KKi 

aiul the pairs (,4^,, /(,) and /!,) are e c . one inav select 
K,, I 1.2. 4. as A', |I,464H 1 4224 I 7K0I|, A, |1.SH47 

I0,046K 2H.0674|, A, -|1 7,S4S 2H 4h74 17 4270), \n make 
.spec(/V. {- 2y 05.1 /0,M. specie,, O,A,) - 

{ V 4 5, 4} ant) Npcc(/I„, /f|A,) ( 4 5. - 5. 5.5} 
(tliese eigenvalue loeaiions were selected arbitrarily (or 
(lliistialive purposes) I he control scheme u Ai , where 
A has the structure given m (4 0). results m a com- 
fHiMle svsieni with eigenvalues at the specified locations i e 

I 0..*i t /() s, S, .1. S, 4, 4 ,v 5. S 

11 should be emphasi/cd that no existing result lor 
iiilcrconneetetl systems perfoinis the pole pliieemcnt in such 
a simple manner 

4 ( (tm hi.sufn.\ 

The principal coniribulions of this papt'r are the analysis of 
the qualitative properties of an important class u( large-scale 
inlereonnecied systems comiHiscd ol symmeincally intercon 
necicd subsystems and a decentrali/ed controller synthesis 
proeetlure which makes essential use ol these projKrties. 
While a number of spccilk important results are developed 
in this papHT. they should l>c considered as illustrations of a 
more fundamental meehamsm by whieh solutions to the 
analysis and synthesis problems at the overall system level 
can he developed (rom subsystem level solunons In 
pariieular, a demonstration is given of how the synthesis of 
amtrollers can exploit the special siruetural properties of the 
systems in onlcr lo avoid overly eonservalivc designs and 
also lo lake advantage of the (xissihic Hcnefieial erteers of the 
inlereonneelion patterns present I vuieritly. such a siraiegv 
of tiiiloring the design procedure lo die existing intcrconnec 
turn patterns has several payoffs, some of which arc 
quantitatively illusirated through numerical examples m this 
paper 

Although the primary Ukus in this paper is to develop the 
analysis and synthesis results that make use of the specified 
structural urrangcmeni of the subsystems, some extended 
results can be developed through standard perturbation 
approaches to cover the cases when the interconnection 


pattern departs from Ihc nominally Kpecihed structure or 
when (he sulysysiem dynamics arc altered due to parameter 
variations. An illustration of such an approach, for the 
particular problem of stability analysis, can be found in 
tunze fl‘>89). 
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Brief Paper 

On Practical Stability of Linear Multivariable 
Feedback Systems With Time-delays* 

WEINING FENG+ 

Kr^ Wordu—Linear multivariable feedback; inliniictiimal (H'liurbaiions; praciical siabililv, 
lime-dclays; Smith Predictor. 


Abatract—In (his paper, practical stability properties of 
linear multivariable feedback systems with time-delays are 
studied. I1ic control schemes considered are conventional 
feedback control and Smith Predictor control Depending 
upon the known perturbation structures, tight conditions are 
given which guarantee practical stability of the control 
system 


Nomenclature 


JH 

Field of real numbers. 


T 

Field of complex numbers 


jr"" 

Matrices with m rows and n columns 
element.s in 'M. 

with 


Matrices with rri rows and n columns 
elements in f 

with 


Matrices with m rows and n columns 
elements being rational transfer functions 

with 

a t A 

Element a belongs to set A 


kl 

Absiilutc value of c e f 



Matrix M with elements being replaced by 
absolute values. 

(heir 

Re(r) 

The real part of c e T. 


K(M) 

flh eigenvalue of the matrix M e T"'"’ 



Largest singular value of matrix M r. 


f>{M) 

Spectral radius, max |A,(M)|; i - 1,2. .. 
M e r ' C 

. , fi ; 


Structured singular value of matrix M c C'”" 


d 

A generic symbol for some (small but 
infinitesimal) negative number. 

not 

s 

A generic symbol for some complex number, 
r, - 0 4 jfii with o -5 d and (.i J f * 


1 Introduction 

Onk or the difficulties with time-delay system analysis is that 
the poles of the system are infinite in number llicrc arc 
generally two ways of treating delay elements to eliminate 
such terms from the characteristic equations of closcd-l(M)p 
systems. For systems with relatively small delay constants, 
the time-delays arc ignored or replaced by sufficiently 
accurate Padd approximations (Takahashi ei ai, 19K7). Ibc 
conventional structure of feedback coiurol can ihen be 
applied as shown by Fig. 1 If delay constants are 
considerably larger but the system is open-loop stable, a 
special time-delay compensator such as the Smith Predictor 
(Fig. 2) is usually a candidate for the system control (Smith, 
1957; Alcvisakis and Seborg, 1973) 

llic term ‘‘practical stability” was first used by Palmor 

* Received 2b January 1989; revised 2 May 1990; received 
in final form 15 June 1990, T^e original version of this paper 
was not presented at any IFAC meeting. This paper was 
recommended for publication in revised form by Associate 
Editor R. V. Patel under the direction of Editor H. 
Kwakemaak 

t Control Systems Research, Department of Engineering, 
University of Leicester, Leicester LEI 7RIL U.K. 


(1980) to describe the ability ol a (imc delay system to 
remain stable in the presence of small tTciurbutions Pulmt>i 
pointed out ihc fact that some Smith Predictor coiitrolled 
systems can be destabili/ed by very small ficrlurbutions in the 
plant transfer function (malriK) coefficients and/of time 
delay constants. In Section 2,1 of this pjqxT. an example is 
given to show that, like Smith Predictor control, the 
conventional feedback control system with time delays also 
have the same practical siabiliiy problem 
I'o ascertain the closed-UHip practical slability of a 
multivariable eimtrol system with a Smith Predictor, Palmor 
and Halevi (19M3) have given a m*rrv,rarv condition which has 
a very simple form ami can he easily checked. Lafer Palmor 
and Halevi's criierion was elatxiraied by Yamanaka and 
Shimemiira (19S7) and developed into a nrcenury and 
suffuieni condition for scalar systetru lest 

Based on a uriilicd Iramework (or time delay system 
stability analysis, inlinilesimal perturbations of time-delay 
systems are characlcri/.ed and (he effect on system stability is 
studied m this paper A suffiaent condition is given which 
can be applied to linear multivariable lime-dclay systems 
with Smith FYediciois. and to conventional lecdhack control 
as well With a modest assumption, a ritTf'.v.vrtr>^ and sufficient 
condition is derived for closed-loop practical stability of 
conveniional feedback systems 


2 Infinitesimal perturbations and prai tical stahiliiY 

For Ihc syslenvs as shown in Figs 1 and 2, Ihe lollowing 
notation is used. 

f/fv) {m X r) iransfer fiinchoii matrix of Ihe 

plant 

) (r;i X r) transfer function matrix ol ihe 

plant model. 

t ' (/(,i) without lime delays 

('miXvlc wilhtmi lime-delays 

U^(.v) c •^(.v)""' J ransfer function matrix of the primary 
controller. 

Jo be more sjKCific, the element of ffj.v), f#u(,v), and 

following form: 


|('n(v)|„- *„(.0 ( 2 ) 


Controilur Plant 



Fig I Conventional feedback control. 
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rrimary 

dimlrollrr i*iunt 


1 






1 ' 


r 




.Vrnif^ /Veriir<t>r 


l ui 2 Srniih Predictor control 


Consequently, the cloed loop system h practically unstable 
for infinitesimal r and f since /rj(.s ) - 0 has its zeros on line 
Re (.») ^ log 1.25 (Bellman and C fx>kc, 1%3) 

TTic above example shows that the stability of time-delay 
systems is vulnerable to even very small parameter 
pcrtarbation.s. It has also shown that conventional feedback 
control has the same practical stability problem as Smith 
Predictor control and is a pr(»blcm deserving attention 

2.2 Praaical xtahiliry of time-delay .r >'.rfem.r One of the 
advantages of applying a Smith Predictor lo crinirol a 
time-delay system (Fig 2) is that, in the nominal ca.se 
C/(i)»» G’^(i). the characteristic equation of the system 
becomes delay-free as 

dell/+ (ft) 


where g,/s), /( (.t) f ^ 0, 0 0, i - 1, 2-- r. 

/ -» 1, 2, . , m, 

2.1 Practical \tahdify of vom^entional feedback control 
First of all, the definition of system stabiliiy given by 
Yamanaka and Shimemuru (1987) has been adopted here 
mid \h repreated as follows 

Definition 1. Let the eharucteristic equation of the 
closcd-lrxip system with time delays he fix) and 

1 ^ (rr I fj Re (z),f(z) 0) (5) 

The closcd-liKip system is said lo be stable iff 1' has a 
negative upper fniund 

It is noted that, in general 1 is an inlinitc S4‘t (Bellman and 
('ooke, 1963; Yiimanaka and Shimemura, 1987), the 
requirement for the negative upper hound for I is to exclude 
the chm: where the closed-loop poles make up an inlinitc 
chain asymptoliclly approaching the imaginary axis from left. 

('ompared with Smith Predictor control, the practical 
stahility problem for the conventional feedback control 
structure has received much less attention Lhe following 
example is taken from Yamanaka and Shimemura (19H7) 
with slight modification. It considers a fictitious system 
(conventional feedback control) with a seemingly negligible 
time-delay. It shows that, in presence of small time-delays, 
an infinitesimal perturbation of the system transfer function 
coeflicicnts can destabilize a nominally stable (when iheie is 
no plant/model mismatch) system 

Example I. ('on.vidcr a plant with transfer function; 

(.S' f f.v 4 I 

■ (t.v+ l)(.> + l)(iv t l)‘’ 

where the small parameters < and t arc non-iicgaiive The 
control configuration is shown by Fig I with the cascade 
com^Knsulor (3 ) a.s; 


Equation ((>) is the same as the characteristic equation of 
conventional feedback control and is dclay-lrec 

Usually, the design of (fix) is based on (-r^„(v) so that 
del |/ ^ (t„,uU)(j, (.1)1 d. Re ( v) * d which means that the 
system is nominally stable. In practical situations, mismatch 
between (i{s) and (/,„(3) always exists and can cause serious 
problems to closed-lcMip .stability, ('ontrol systems which can 
be dcslabili/ed by a very small perturbation are of no 
practical value. Assume that the vector o r. if*' denotes the 
coefficients of (/„(>) susceptible to pcrlurhations. and 
introduce (/,,,„(' )• '^herc ) is obtained iroin (/„( v) by 

selling ft ft^,. 

Definition 2. A control system with lime-delays is lerrned 
practically stable (Palmor. I9K0; Palmor and Flalevi. 1983; 
Yamanaka and Shimemura, 1987) if; 

(1) Ihe system is closed hnip stable for the nominal case. 

(2) There exist positive numbers and . such that, for ft 

and satislying ||ft ■ ft,„lh the 

closed loop system is stable 

2.3 A diai^ctnalixation proct-dure hv structural dec omptrsi 
lion It is observed that, if the plant model is chosen to be 
delay-free such that (/,,, the Smith Predictor control 

(F'lg. 2) IS reduced to the conventional feedback eonirol (Fig. 
I). For expositional clarity. Ihe problem formulation is based 
on the Smith Predictor control scheme first 
( onsider the Smith Predictor control system as shown by 
Fig. 2. The ehariictenslic equation of the overall closed-loop 
system is; 

delj/„, ^(^(', ^ (L„j() " f'fri)(^, ) 1 

— del |/,„ 4 ((/ |/del (/„, -f ' (f„)(>, I 

det |/,„ 4 ((f f^r. )f'. (4ri ) 'I [An ^ I 

del \l,„ 4 )(f\ 

(7) 

In the nominal ease (i (f^,, equation (7) is reduced to; 


A'.TO 


2S 

4 3.75 4 2.5(U, 


If the plant model is chosen to be 

" (,f + l)(i5 4 I) 

then the transfer function of the nominal closed-loop system 
I 

0^ Kv 4 I 


is ohviou.sly stable However, the opcn-liMip transfer function 
of the real system is 


i/(a) ^ g(.v)g, (.y) 


1.25(0 - 4 4 I) ^ 

.v(e.v 4 l) 


It IS known that the characteristic equation 1 4q(>)“ 0 has 
its zeros making up an infinite chain asymptotically 
approaching those of the comparison function 

1 4 l.25e 'V 


The primary controller ( 1 , (.v) design ensures the closed-lrKip 
stability of the nominal system, thus, the actual overall 
system has a chiiraetcrisiie equation as. 

Ufr, (f' - (/„, 4 ) '] - d (H) 

Assume that elementwise knowledge of perturbation on C 
is available and there are altogether k perturbed elements in 
(I Without loss of generality, order the k perturbed 
elements and denote them as g,/(.v)e (q ^ 1, 2. . , A). 

The corrcsp<inding elements in model (f„ are (.»)e 'H* 

(q ~ I. 2.A,) It IS noied that a perturbation may exist 

only in the time constants or simultaneously in both A^^(a) 
and 0^ (q ^ 1, 2.A ) 

Thus there arc only k non-zero elements in (O’ “ G^). and 
(G ' G,„) can be diagonalized by a structural dccomptisiton 
as. 

(; ' G;, t Md{s)F ( 9 ) 

with Ec A(:;(v) 6 f* and f G Both E and F 

arc constant mairiccs whose elements arc Is and Os. AG(j) is 
a diagonal transfer function matrix and its elements are the 
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difference between perturbed plant elements g (De 
the corresponding model elemenis e ( a )c 

1.2, .A) Let 

and 

iq - 

6’j = diag -- K.(.t K' 

(101 

‘l'“g 

(11) 

<?=•!. 2. k 

(12) 

.Vj.) = d.ag|-*4'.* 4 '^' 

113) 

.9«(.5) = diag (f c V-’.c ""v*) 

(14) 

,V,(.v) diag (c c . e **“} 

(IM 

then AC*(.y) can be writlcrn as 


A(;(v) “ (ij - 

(lb) 


Thus ihc left hand side uf |H| can [m: icvsritvvn as 


del |/„. 4 +'| 

-dei|/^4 4 a f,) ’| 


vcclor ^ and r >(K such that 

j I k Kr(j).-d 

iS-.l** ' (I**) 

and l,» I ■' r, if 1, , k 

and 

.STv) - diap \hy\ h.^\ , (210 

In the light of the Lemma I, the uN^vc assumplum is a fairly 
rca.sc»nahk one and fxxurs m nu>si practical siiuaiiotts which 
is alsiv shown hy the given example In the Itnite region 4>f the 
i plane with Re (v) -d and pi r. mismatch between 
and by small cticfticicni iHOiurbation is tin* small to 

have any cflcct on system stability ami. at a disiiuKc lar away 
from the origin, t v I 1; approaches By 

rcsifKiing the |x*!taibation lo aitiitianly small, the distance r 
over which Le,,!' {\) 11 is negligibk becomes urbiirariiy 

large 

Based ujxm the aKive assumpiion, some cnleiia me 
dcroed which reduce the practkal stability tests into a 
siriictuicd singulai value compuiatnvn loi kiuiwn huiiiiccn 


- del |/. 4 4 r;.i '/• | 

- del |/t 4 .S„|v)|,\„.V, -- /, |/„, 4 I '/I 

l.cl 

(')(L ^ f)<<■,(')) '/; 1171 

then the closed loop system is piacliciil si.ible il, and only il, 
the closed-loop characteristic equation 

del[/* /jA/(v)| (I (IM) 

has a negative upper boumi for the real parts of its zeros 

liquation (IK) characterizes the practical siahilily o( the 
original system with the diagonalized unccnaiiuy .S„( S,,,S, 
the mullivanahle nature ol the problem is preserved by 
matrix M which is generally noi a diagonal matrix II is the 
uncertain part .S^,(,9^,V, I^) which causes Ihe problem ol 

praerjeal instability 

2.4, ( haradcnzuiion of infinitcMmul fivrfitrhalioris l!se 
the same notations as in Sections 2 2 and 2 .T the |KHurhed 
coefficients ol the plant are represented by the real vector 
n ( and its nominal value is t Perturbations in 
delay time eonslanls are denoted r^^, if - 1. 2 . , A 

In the ideal situation, a and r,^ - 0 (t/ - 1, 2, .A), 

and hence .S„(v) - /^ and \(v) /^; thus, the uncertainty 

\j(' )(\( 1 ).S, (v) - /i) in (IK) is actually a zero matrix (Ol* 

F or any v - o t joj waih o ' d and ls| • 4 ^, all the elemenis 
ol transfer function matrix Q{s ) ^ \,(v)(.V, (v).S, (a ) ,)A/(v) 

are analytic functions ol u and 4 (/ 1,2. .A) 

Therefore, for any given rT there exist and c'),. such that, 
bir all a and (1 - 1 , 2. , . A ) salisfying ||n n„J| • . 

|tJ ’ r^,(Vj). 1 !C^(')|| “ f'> holds lo summarize, the folUming 
lemma applies. 

Lemma 1. Assume that Aff.v) is a Mable transfer lunciion 
matrix and the mismatch A,(v) caused by coeflicient 
fxrturbalion is also stable In Ihe closed hall plane 
Re (,i) -*■ d, all the zeros ol equation (IK) can only be at s -► 
under inlinite.simal perturbations 

PracUial siability lests for i\me'delay vvv/ffm 

By la:mma I, the practical stability lest is needed only at v 
which is at a sufhciently large distance from the origin 
However, uncertain matrices and .S,(s) in (14j, 

(13) and (TS) present a computational difficulty Conse¬ 
quently, some easily obtained criteria are highly desirable for 
practical stability tests. In this part of the paper, light 
conditions arc given which guarantee practical stability of 
general time-delay .systems For a special class of systems, 
ncccjcsary and sufficient conditions arc also presented 

3.1. An as^iumpuon. Ba.sed on Lemma 1, an assumption is 
made on the uncertainly caused by c(xfficienl perturbation 

Assumption 1. Assume that there exist Mime non-negative 
integer vector - |zi,. . . nj', some non-negative 


3 2 Pruitiinl tests for t^eneral wsienis, Since 

PiilmoT and flalevi's (P>hM original loncliisum ( Theorem 2, 
p 23K) docs not v'onsidr'r the unceiiainty fatioi .Vfi) caused 
by small nxflicieni txriurbaiions. iheic can be a 
consitlerahlc gag* between then test and the exact condiltoii 
in the piescme ol vdcflieieni (KiUiibation Hie billowing 
theorem seeks to reduce Ihc gap 

Theorem I ((icneral iime delav systems) With the assump 
non (PM iiiul (2b), the closed b>op sysiein widi lime delays is 
practical siahlc il 

/i|(.V(jnO’ + 2/* )/W(|riO|' 1. as Uf » ' (21) 

Ihe .structured singular value coires|>onds to the dtagonul 
uneertiiiniv structure 

Proof See Atipendix I 

It IS noted that Theorem I eari be equally applied to 
conventional leedbaek systems as well as Smith Ihedictor 
eonirollcd systems The lomputation ol the sliueliired 
singular value (Doyle. lbH2) mvolveil in (21) is needed only 
once With tn Ixing suffinent large 

Theorem 1 is derived by inspecting the cigenviilues ol 
matrix k^()<a) \dj'fM(\, (I'o.l'i, (|n») /^)M()iiM <•! (IK) as 

Uf * ' SmIP") \(jf") diagonal matrices and their 
elements are pure time delav'' ot difleient constants At 
sullicientiv high frequeneies. ,S„(jn<) and ,S, ( j»n| can tdmoM 
always provide phase shdts to make 

min (Ki! A,|\,()"M(\lj</M‘V,(b'0 /* )M| )n>)l) 

7»|(,S()f/M' ♦ 

iind the diagonal structure ol <Vr 4 (jriD suggests the 
replacement ol s|xetral radius p by ihe siruefured singular 
value p. thus the sufficient condition (21) is expected to be 
fairly clove to the exact condition 

However, in the case ol Smith f^redicior control and where 
the pcrturbaiiirn exists in only one plant clement with A - I, 
,S„(jrfi), S^ljf/r), .V,(pi>), and M{\iu) are stalars With \,(jri^) 
providing arbitrary phase shift at high frequeneies, the scalar 
counterpart of inequality (21) becomes Ihe exact condition 
for system pracfical stability 

i orollary 1 (Smith FVcdicior conttol) In (he cave ol Smith 
Predictor control and where there is only one plant element 
which IS periurhc'd, (rn example as m a scalar system, (he 
closed-loop system is practical stable il, and only if, 

f.Sljfij)' + 2) !M()iii)h" I, as u} .(22) 

Proof. .See Appendix 2 

It is noted that C'orollary I can only be used in Smith 
Predictor control systems with only one periurhed element 
. If C orollary 1 is applied to a scalar Smilh 
Predictor conlrol system, there is no need lor structural 
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(kcompoHition and the iraritifcr mafrix Mia) reduccfi tu the 
a>mpkmcnlary senMilivity iranftfer function 



M(s) 




where r IS a small perturbation parameter The plant model 
without delay lerms is; 


C'orollHry I turrui out to be the necessary and suflicient 
condition given by Yamanaka and Shimemura (I9K7, 
T heorem I. p 7H9| 

.3.3 Praciual stability test for a class of convenitoitfil 
feedback ctmtrol systems. A conventional feedback control 
system has the fallowing features; 

(a) 

(b) 

Consider a class of sy.stems satisfying; 

del |/* AT( v)| 0, Re (.v) - d. (23) 

The exact test lor practical stability of this class of systems 
has a very nciil form and is summarized in the following 
theorem; 


Iheurem 2 (( onveiitional feeilback control). For the class of 
conventional feedback systems satisfying condition (23) 
together with Assumption I. the closcd loop system is 
practical stable if. and only if, 

^|(.S'(jiu)' i /)M(jtn}(/^ '1‘ 1. as 

(24) 


where the structured singular value p corrcstxinds to the 
diagonal structure 

Proof See Appendix 3. 

It should be emphasized that Ihcorcm 2 can only he 
applied to conventional Iccdhack control systems, It should 
also l>c pointed out that a very large class ol sysienis may 
satisfy condition (23). For example, if perturbations occur at 
the plant outputs (or inputs) and ciin be written m a 
riuilliplicalivc form, then there will he no need for structural 
decomposition and M(,v)(/* M{.s)) ‘ f/,„(,(.v)f/,( a) (or 

f»;(00;.„(.v))- 

If rheorem 2 is applied to a scalar convcnliunai Iccdhack 
control system, the closcd loop system is praclicrd stable if, 
iind only if, 

(.S'(jfii)' t 1) |g, ()<ii)g^,()n»)h I, as (ij (23) 

If (oiollary I is applied to a scalar Smith Predictor 
controlled sysicni with the same perturbation, the closed- 
loop system is practical stable it, and only if, 


(Aljni)' 4 2) 


k’. 

I + .k’. 


as ( 1 ) (2b) 


It can he easily proved that inequality (2b) implies 
inequality (25). hut not I'lcf'-omu So on one hand, it is 
emphasized that conventional Iccdhack systems, just like 
Smith lYcdictor controlled systems, have the same prueiical 
stability problem in the presence of inlinilesimal time-delays. 
However, it should also be pointed out that conventional 
feeilback control can be slightly less s€n.silivc to infinitesimal 
perturbations than the Smith Predictor control with the same 
pertiirhalions 


(jmnU) = j j 

Ls + I J + 1 J 

For the plant, the only element that is perturbed is the (1. 1) 
element. To i.solalc (diagonalize) the perturbed clement, let 

^" [o] ^ 

then 

0-(i)-0„(a-fe(e 
SJs) - 1 
.V(.i) - n 

MU) - (-')(/„, + c;„„(.t)c,(,i)) 't: 

k ,(,s ^ 1 )(a + /c. + 1) 

" (k\ + i).»- + (*, + I )(*.’ + 2)^ + ) 

By C’orolliiry 1, the closed-loop system is practically .stable if, 
and only il, 

(2 f ,V(A )’)|M(.Oh- 1 as 

that is 

2A,/(A, f 1)' 1 

then 

kr 1, 

So the closed-loop system is practically stable if, and only if, 

it,' 1 

Example 3 Consider a 2-input. 2-output lime-delay system 
with conventional feedback control The plant and plant 
model arc 


(f.v" ts + 1 )e 
f;(.0 - O + I 

0 

and 


1 n.5 1 

v4l Zs^\ 
0.5 1 

Lll 1 A -f 1 J 


where c. 
is; 


1 


(LU) 


0.5 


0.5 1 


A 1 Iv ^ 1 


I 


Is +1 A -I- 1 

T,. and r, are small perlurbalion.s Tlie controller 


CV,(A)-- 


k^ 0 
0 k. 


4 Examples 

Example 2 C onsider a Smith Predictor controlled system 
with the plant, plant model and the primary controller as; 


0'(A)- 


V + 1 

e • • •• c " 

A 41 A fl J 




A 4 I 
, I) 2N« 


LA4i A^ii 


It can be seen that the plant perturbation occur in output 
channels and is already in diagonal multiplicative form, 
hence. 






I 0.5 1 

A 4 T ir 4 I 
0.5 1 

Llv 4 1 A 4 1 J 


(S' 4 fA 4 I 
f A -i- 1 
0 


0 

1 


= /. 



0 


C 


1 
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M{s) * 4 g^45)<l;, ) ‘f: 

== G^(i)G^(l> 4 G^U)G;) ‘ 

/"M(5)--(7. 4G^(3iGV) ’ 

and 

M{s){I-MU)) 

It IS obvious that for k , > 0 and > 0. ifur nominal sy?iicm is 
stable and dci (/- Af(5)] 0, Rc(s)i-d, namely, t ondiiioii 

(23) is satisfied. As lj|-^ 4 ac, 

4 C.¥ 4 1 

-- ^ I ^ 

fX 4 1 

thus 

.V(r) ^ diag {s. 0} 

and 

I 0 5 1 

.y 4 1 2 a' 4 1 

0 5 1 

Lii + I v^ i J 


(.V(jiti)' 4 /)G^(ja/)(i; 


A, l).25A, 
0 


Yamanaka, K and IL Shtmemura (lUiK?) Bfifenis of 
mismatched Smith conirollci on stabihiy m s>'stems with 
timc'dclay AuimruUicti. 23, 7K2 7dl 

Apprndu I (PriKif of Itieorem I ) 

As frea^uency approaches inlinily, M>mc profiertics of the 
pure lime-delay diagonal matrices and will be 

ujjcd in the theorem proof and arc listed as follows 

(a) At a given suflicicnlly high Irequcncy hand, each 

diagonal element of can provide arhitiunly independ¬ 

ent pure phase shift 

(b) Liven if ihc time delay cimstanis of 5^(.v) are distinct, at 

any frequency pomi ai. ihc phase shifts provided by the 
diagvmal elements of ate dctsciidcni but at some 

sufficiently high frequency rHnnis. the phase shifts by 

can bt* dose to M>mc required phase shills 
The priKif of the theorem cun be carried out in two steps 
(I) let “ o 4 |u> with o ‘ d and l.v^i ♦ 4 *. it can lie 
proved that, tl it 1) and i 2/^ )Af(ji4;)| * I as 

ui -* X, equation (18) has no zeros (or ^ 

First, the diagonal malrix 

,V( v) - A„( I )(.V, (> )\, i s ) /, K\(^) * 4 II ,) ' 

with V - V. and it-4() is invcsiigaled where -V, (i ), 

5,(4). and 5 (a) arc given in (13), (14), (15). and (20) 
rcspcitiv’clv As |a,|’-* 4 * . the iibsolutc value ol the (i. i)th 
elemcnl of Y(a . ) is: 


/A, (),2,5A., 

) - A, 


1 

V 0 0 

/ 




By ’['heorem 2, the closcd-UKip system is practically stable if. 
and only if, A:, < 1 


5 Conclusions 

Based on the framework ol Smith Predictor control in 
which the conventional lecdhack is a s|K‘cial case, the 
practical stability problem of lime-delay systems has been 
investigated. It is revealed that the practical stahiliiy problem 
can exist in conventional feedback systems as well as in 
Smith Predictor conlrol systems (riteria have been 
established which guarantee practical stability of linear 
multivariuhle time-delay systems under infinitesimal pertur 
hation.s in plant coclficicnts and delay lime constants Ihc 
proposed practical stability tests can he easily |K’rformed and 
provide guidelines (or the control design ol time-delay 
systems. 
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h, i.v ,.r ♦: 

, ,1 

I 

h. h-.l"' ^ 2 

I'.I"' t:! 

i ii.. 

h. h.r * 2 

i. v,r'’ + 2 . 


1 Me ■ 1| 


Consequently, ihc largesi singular value of Y(v,) satisfies 

■ ' a*"' 

• ^<|.V(y.)(,V(i,.)' -t 2/,)M(,v.)| 

• ' +2/JAf(i ,)| 

thcrelorc. cquati<»n (18) has no zeros for Rc(a.) >^() if 
^((.V(.«,.)‘ 4 2 /UM(vJ)- 1 with + *-. which is the 

same as /4|.V(j<;»)' 4 1 with m-*'* 

(2) In what follows, it is going to prove that, if 
^|.Sfjw)* 4 2 /j^)M(j<u)| ' I with oi , there will exist a 
Oo' f) such that, equation (IK) has no zeros for s * v. and 
a„ 5:1 o 4 0 

Ivct ^4|(.S(i„)* 4 2/^ )3f (v, )| ^ fi,,' 1 and investigate the 
following function; 

' " h, lij"' ► 2 

Obviously, for f7 r: 0, /i,(o) 4 1 is monoUmieally decreasing 
with a Ixf be the unique solution of 


ACTTj 27:2-1. 
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iKcn ht{a)< Vo,,/' rz-sO. Define; 

-a*J. 

ll followi that, for o„sas(), the aNtoluie value of the 
(i, i)lh element of diagonal matrix Xh^) n 





< j 

which mean.*! that the diagonal matrix A'f.r.J has its largest 
singular value l/^„. On the other hand, 

« p|A'(iJ(,V(.r J‘ 4 2/*)M(i J| 

‘ 4 2/JAf(i J| 

^(.Vfv.r 4 2/, )Mh . )\ 

<■ I. 


Apprndij 2 (Proof of Corollary 1) 

In this case, the sufficiency of the condition (22) can be 
directly obtained from Theorem 1. The proof of necessity is 
as follows 

Assume that |(.V(jw)^ 4 2)A/(jciij( ^ 1. from the pnx)f of 
Theorem 1, a non-negative scalar o,>2^0 can be found such 
that 

" |(i'(j«7)* + 2)Ar(jiu)| ^ *■ 

What is more is that c can give A'fo,,-!- ]u)) an arbitrary 
phase 'Thus, X(n^f^\u)) can provide the exact magnitude 
scaling as well as phase shift to make 

= A'(o„ 4 jw)(,S’(jaj)* 4 2 )M(j</;) “ -1 

at certain discrete frequency points with which means 

that the equation (IK) has a infinite chain of zeros on line 
Re (. 1 ) * o„ 0. therefore the clo?u:d-kx)p system is not 
practically stable Consequently, Condition (22) is also 
necessary 

Appendix 1 (Fr(H)f of Theorem 2) 

In the ease .V„(,i) - 7*, with ^ a 4 jw and \\ , | —► 4 x. 

del (7, 4 (.V,(.v J - 7J/V7 (aJ| ^ 0. Re (a J - d 

is equivalent to 

del |7 a 4 >S\(.y,)\,(v,,)M(.v.)(/* Af(v J) '| # 0. 

Re (vj 4 ri 


Therefore, equation (IK) has no zxros for Re (ir?-if 
M|(AXv.jW27,)/Vf(.vJ|< I 

C^omhinc (1) and (2) with Lemma 1, it is obtained that 
equation (IH) has no zeros lor Kc(.y)^'a„ if )i((.V(j(o)' 4 
llt)M{\u))\<. I as ( 0 -* In other words, o,, can be regarded 
as the negative up|)Cf bound fur I delincd in DcTinition 1, 
and the closed-loop svstem is practically stable 


under the assumption (23). This lime, dehne; 

and keep in mind that \(jo0 can provide arbitrary phase 
shifts, the prtH)l of Ihcorcm 2 can be earned out in the same 
way as the combined Iheorem 1 proof and ( orollary 1 
prtKif 
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Abstract —This paper reports recent work in the theoretical 
development of the polynomial equation approach to the 
optimization of multivariable control systems llie algebraic 
properties of the polynomial matrix equations which dehne 
the optimal controller are investigated, and new results 
concerned with the numerical solvability of the equations arc 
derived 

Notation —All systems considered in this pafxr arc described 
by means of real polynomial mainccs in the delay operator 
d. The reader is referred to KuCciu (1979) lor details 
For simplicity the arguments ol polynomial matrices are 
often omitted, such that A'(ri) is denoted by -V Ibc 
adjoint of X{d) is written as A'*(r/)-- ') For any 

fKilynomial matrix X{d) define (A') as the matrix of terms 
indcjicndcnt of d Stable square (Kilynomial matrices are 
those with zeros of their dcicrrnmiini strictly outside the unit 
circle of the t/ planc 

I introduction 

Tut i7i.siifN of optimal controllers for niultivanahlc plants 
subject to noise dislurhanccs has been intensively studied in 
recent years If only the plant output can Ix’ measured it is 
well known that the optimal controller consists of linear 
output feedback and can be designed using either 
time-domain (Kwakernaak and Sivan, 1972) or frequency- 
domain ( Youla ei al . 1976) methods. 

Alternatively, the optimal multivariable controller may be 
designed using the poiynomtal vquatum approach which was 
developed by Kudera (1979) Kudera’s output regulation 
solution was extended to the tracking ease by Sebek (I9H3) 

If, in addition to the plant output and reference signal, 
some disturbance can be measured, then a three-input 
controller, utilizing feedback, reference control and 
dLsturhance measurement feedforward may be used to 
improve the controller performance (i.e. In decrease the 
optimal cost). 

For the ease of smgle-inpui single-output plants, the 
solution of such a mixlificd optimal control problem was first 
given by (irimble (19Hf)) for stable disturbances. Ibe solution 
for pos.sibly unstable disturbances was subsequently given by 
Sebek ei al (1988) Indcpcndenlly, Sternad and Srklcrstrom 
(1988) obtained the scrlution for the stable disturbance case 
using an alternative prtxjf technique A completely general 
srilution to the scalar rccdback/fccdforward stochastic 

t Received 28 November 1989, revised 11 lunc 1990; 
received in final form 11 July 1990. The original version of 
Ibis paper was not presented at any IFA( meeting This 
paper was recommended for publication in revised form by 
Associate Editor P. M. G. Ferreira under the direction of 
Editor H. Kwakernaak 

I Department of Mechanical Engineering, University of 
Glasgow, Glasgow GI2 BQO, Scotland, U K. Author to 
whom all corre.spfjndcnce should be addressed 

§ Institute of Information Theory and Automation. 
Czechoslovak Academy of Sciences, Pod vodarenskou vc2i 4, 
182 08 Prague 8, Czechoslovakia 


tracking problem ina>r|x>r»ting dynamic C(>kI function 
weights ha.s been obtained by lluiil (I9H8). The direct 
feedback/feedforward regulator solution of SetTek et al 
(19K8) was recently extended to mulfivanahle plants by Hunt 
and .^bck (19HVu) An indirect solution to the multivariable 
feedhack/feedlorwiird problem has previously been obtained 
by Gnmble (I9HK) Cirimbic's solution was obtained by 
icformulaling the plant model and optimal control problem 
as nn equivalent, augmented, output regulation problem A 
full ireutnient foi b<nh scalar and multivariable Nysicms is 
given in Hunt (1989) 

Ihc theoretical developments put lorlh by Hunt and iebek 
(I9K9a) were recently used as the basis of a Multivariable 
LOG Self-tuning C'onirollei Algorithm with Disiurhance 
Measurement Feedforward (Hunt and iel>ck, l9H9b) 

LQCi self-tuning control for single input single-output 
systems ha.s previously been considered by Gnmble (I9H4) 
and Hunt rt al. (l9Kti, I987ii). and is mmi lully dcHTibed by 
Hunt (1989) Hunt (1989) also reports a detailed application 
study of LOG self-tuning control relaling to the steam 
temperature control hxip on an Advanced (Jas-ciMilcil 
Reactor |x)wer installation 

Ihe polynomial equaiitm approach has been shown to 
provide a sound basis lor the application of high performance 
controllers and we continue here with import ant aspects td 
Its development 

The optimal multivariable controller consists of three 
parts: a feedback pari, a rcleieiice tracking pari, and a 
feedforward part In general, caiculalion of the optimal 
controller requires the s4>lijtion of three pairs of coupled 
two-sided polynomial matrix equations, one coupled pair of 
equations lH*ing connected wiih each part of the controller 
Elimination of the common (or coupling) term between the 
coupled equations results in three ,ong/r one sided 
polynomial matrix equations, the so-called implied 
polynomial matrix equations 'Ihe minimum degree solution 
of the original three pairs of coupled cqualions results m the 
optimal controller, which shifts the jxilcs and zeros of the 
closcd-l(x)p .system to their desired optimal po.sitions On the 
other hand, a controller calculated using the minimum 
degree solution of the implied equations ensures only the 
optimal positions of the cbmed-bxip poles. 7he conditions 
under which the implied feedback equation dttrs yield the 
optimal feedback controller have been derived by Hunt et ai 
(l9H7h) llie related conditions for the tracking controller 
equations and the feedforward contrrdlcr equations arc 
established and proven in this paper 

llii.s question is of crucial imtxirtance in the multi variable 
LQCi self-tuning controller algorithm (Hunt and f^hek. 
1989b) .since the cx»mpulalianal burden presented by solution 
of ibe single-sided implied equations is much less than that of 
the original two-paded coupled pairs of equations. 

The role of the cxjupled polynomial matrix equations 
arising in the optimal control problem solution has also been 
considered by Roberts and Newmann (1988) Roberts and 
Newmann obtain the conditions, for stable plants, under 
which the first of the coupled cqualions is itself sufbcicni in 
the delerminalion of the optimal controller 
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2 System model and cost function 
'T*hc multi-inpui muiti-cjutput plant under con^^idcration is 
governed hy (he equation; 

Ay - Bu s ( f (\d. fl) 

where y is the vector output H-qucnce, u is the vector control 
input Hequence, and and dj arc two vector noise 
sequences. A, fi, (.■^ and ( i are polynomial matrices m d. 
The plant is ussurned strictly causal, so that {A) is invertible 
while (//) tl The noise comp<»ncnt dy passes through a 
filler to priKiucc a measured disturbance signal i e 

A,\ - (\dy ( 2 ) 

where /I, and (, arc polynomial matrices in d, with square 
rhe filter /t, 'C, typically represents measurement dynamics 
Furihcr, consider a reference vector sequence r modelled 
us; 

(3) 

where A, and C\ arc left coprime polynomial matrices in d, 
with (4^) invertible d, is a stochastic generator vector. The 
available version of the reference .sequence is ct>rrupled by 
an additive observation noise 

The general linear controller which operates on the plant 
output (corrupted by a measurement noise on the 

reference signal (corrupted hy i\„), and on the measured 
disturbance signal S, is described hy; 

Pu^~ y(y f W(r f ^J + ,SA (4) 

where P, Q, H and .V are the polynomial inainccs to he 
found, and (/') is invertible Ihc overall system structure is 
shown in Fig. I. Note that in practice the controller must be 
rculi/cd UvS a single dynamical system having three vector 
inputs and one vector output (i.c. the control signal u). 

All the vector random sources f*),. I), and are 

mutually independent stationary white noises with miensitics 
01 ■ 0:. 01. 0/ i*nd 0,,,. respectively. To avoid the trivial 
case of 0; - fl (i.c, no measurable disturbance) we a.ssumc 
here, without loss of generality, that 0^ / 0,, 0.. 0, and 

are real non negative definite matrices 
The desired optimal controller evolves from mimmi/ittion 
of ihc cost-function: 

J - tr{U(pJ i rr(l(p, J (5) 

where 0„ and 0, ^ are correlation functions of n and the 
tracking error r - v in steady slate, respectively U and 1 are 
real norMicguiive definite weighting matrices. Thus, the 
design problem is lo minimi/e the cost ('') subject to the 
constraint that the closed-loiip system defined hy equations 
(l)- (4) he asymptotically stable 

1. Optimal rontroiler 

Ihc first stage in the design procedure is to lind a pair of 
righl’Coprime polynomial matrices A^ and fl, and left 
coprime |>olynomial matrices A,, and fl,, such that 

A ((i) 



We define stable polynomial mainoes D^. and G (the 
spectral factors) which satisfy; 


A^OA,* = D’D, 

(7) 

Aip,A* + c,ip,c: d,d; 

(B) 

A^^„a: + = GO*. 

(9) 

For brevity we assume here that the given data make the 
problem regular, and that .stable spectral factors do exist. 
This is normally the ease m practice and ensures a solution lo 
the optimal control problem. Even when the spectral factors 
arc not strictly stable a solution to the problem may still 
exist See Kudera (1979) for a formal treatment of this ease. 
We then calculate any left-coprime matrix fraction 

A^ 

(10) 

Further, the following right-copnmc matrix fractions arc 
defined by; 

Of 'A = AJ)f.' 

(11) 

Of 'fl - B„o„! 

(12) 

A 'f , = C^A, ' 

(13) 

OE ’=- (/4,G) 'A,B„ 

(14) 

A^Cj\'=-G 'a,. 

(15) 

Finally, we detine the right-copnmc polynomial matrices fl^., 
C; by: 

flO. - C\fl. 

(16) 

Fhe optimal controller equations may now be stated as 
follows: 

Theorem i fhe optimal control problem is 
only if: 

solvable if and 

(i) Ihe greatest common left divisor of A and fl is a stable 
polynomial matrix. 

(ii) Cf is a .stable polynomial matrix. 

(iii) A^ is a stable polynomial matrix 

The optimal controller jKilynomial matrices P, Q, fl and .V 
are obtained from the following left-copnmc matrix fraction: 

/), Q. H. S\ 

= YO,;. MG, (Kn,„'r., - Z)A, 

'G, '/»,!. (17) 

Here, X and Y (along with V') is the 
equations; 

solution of Ihe 

n;X ^ ^ A*,ilDf^ 

(IHa) 

D;K - F*A,, = flri7)^„ 

(18b) 

.such that {V) 

The polynomial matrix M (along with L and N) is the 
solution of the equations; 


(19a) 

/VMs-flrXC^ 

(19b) 

such that (/V) =0. 

Ihe polynomial matrix Z (along with U 
solution of the equations: 

and W) is the 

o:t/+Wfl, = ArQc; 

(20a) 

oyz-w^A, ^flriQ 

(20b) 

such that (W) ~ 0. 

Pnwf. The feedback part of the optimal 

controller (i.c. 


relating to P and 0) was first derived by KuCera (1979). The 
tracking part (fl) was subsequently obtained by §cbck 
(1983). Finally, the feedforward part (5) of Ihc theorem was 
derived hy Hunt and Sebek (1989a). 


Fill 1. CU>scd-li>op .system 
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4. Impiied poiynonuai matni fquanom 

Lgmma. The polynonual mnlhccs X and V in equation (IK) 
aho sulisfy the implied feedback polynomial matru equation: 



Proof Eliminating V* from equariem (IK) by muluplicaiion. 
adding and some algebraic manipulation, results in (21). 

Lemma, When 

(C.l) A, is a right divisor of >4^ 
then the polynomial matrices L and M in equation (19) alM) 
satisfy the implied reference polynomial matrix equation 

M, + Affl,-D.D, (23) 

where; 



Proof Eliminating N* from (19) by multiplication, adding 
and some algebraic manipulation, results in (23). 

Lemma. The polynomial matrices U and Z in (20) also 
satisfy the implied feedforward polynomial murra rquatton 

UA.^ZB, - A73, (25) 

where: 



Proof, Eliminating W* from (20) by inultiplicaiion. adding 
and some algebraic manipulation results in (25) 

Theorem 2 (main result). Solution ol the implied iwlynomial 
matrix equations (21). (23) and (25) unilcr the conditions 

YA^ ‘ stnctly pr()[K*r 
MAs ' strictly proper 
Z.4, ‘ strictly proper 

will uniquely determine the optimal controller matrices if and 
only if 

(C.2) A^UJ,, a and A arc proper rational 

matrices 

(C.3) The polynomial matrices A and H are left coprime. 

Proof. A prcKif of the result for the equations relating to the 
feedback part of the controller has been given by Hunt ei al. 
(l9K7b). Proof of the results for the tracking and fcedftirward 
equations follows; 

(a) Tracking equationx 13ic optimal .siiliiliun i.s charac¬ 
terized by: 

(N) =()<=>D* 'N* stnctly proper 

After some straightforward manipulation equation (]9h) can 
be written as. 

ma.'-d; w-d; ^h:xa,'g an 

By condition (C.2) and equation (9) A, 'Ci is proper. Since 
(fl,)=0, D* 'fl* is strictly proper. Thus, together with 
(N) =0, equation (27) implies that MA^ ' is strictly proper 
Thus, when (C.2) holds the optimal srdution is also 
characterized by 

MAs * stnctly proper 

Now, when A and B arc left coprime (condition C'.3) then 
= is coprime. Thus, using Ijjmma Al (see 

Appendix) there exists a unique solution L, M to equation 
(23) with AfAj' strictly proper. This unique solution, as 
shown above, is the optimal solution. 

(b) Feedforward equations. The optimal solution is 
characterized by: 

(W) = OoD* 'W* strialy proper. 


After some manipulation equation (2(lb) can be written as. 

Z4,‘ -f>: 'W-O; ^b:XA ’C; (2K) 

By amdition (C 2) A '( > is proper .SiiKe (f*,)^l). 
D* IS stric*tl) pix>pef Thus, logclbcr with (H ) 0, 

cquatjcm (2K) implies that ZA. ‘ is siricily proper Thus, 
when (C.2) holds the optimal Mduiion is also characterized 
by 

ZA, ' smelly pnqser 

Now, when A is coprime (condition 13) then 
A. ‘fl.^l^A» ‘ is coprime. Thus, using lemma Al (sec 
appendix) there exists a unique solution I/, / to cquaiioii 
(25) with ZA. ‘ strictly propel This unique M>lulion, as 
shown above, is the optimal solution 

Bemark Conditions (CM) and (C,3) state that all reference 
and disturbance modes musi also Ik present in the plant 
forward path For unMahle reference and disturbance models 
(those used to generate stc|is. ramps, shafie-dclcrmimstic 
signals etc ) these conditions must already l>e satisfied when 
the optimal control problem has a solution (see Theorem 1) 
‘Ihus, for a large and inqHUlant class of problems these 
condition.s will be satisfied 

(omlition (C 2) also dcjx'nds on (he class of reference and 
disturbance signals of iniercst It can normally he arranged 
that the transfer functions concerned are proper; this \% 
certainly the crise for Ihc unstable miHfels referred to above. 

Note, rinally, that whenever any of the conditions 
(C.I)~(l 3) do not hold all is not lost; wr simply revert to 
the pairs of coupled pHilynomial matrix equaiinns to calculate 
the controller 

5. Eiampif 

In this section we give an example which illusiriiles the 
results of Iheorem 2 ( onsidcr a prolslcrn with the following 
data 

H 2d iff (\ 

A I I 5d 4 () 5J' A, I 
(\ - A, -A', - 1 

U ^ 11, 4>^ ^ . ^ ip^ - ip, ip,., I 

It IS easy to verify thai condition (( I) and conditions 
(( 2) ((' 3) of Theorem 2 arc satisfied hy this problem 
definition Ap|x*aling to Iheorem 2 wc there lore expect the 
three implied equations alone to yield (he optimal coniroller 
lu verity this we priKCcd, foi each part of the controller, by 
first .solving the implied equation We (hen check the result 
hy solving (he lull coupled equations lor comparison. 
Performing the spectral faciori/iiiions (7) (9) we obtain: 

/7 2 91 0 (IHlby + (M72d\ 

I), I K I (IHr/4 I) 277r/' 

(. 1 h2 (I hlKd 

Wc now proceed to the controller calculations 
Ferdhack nmtrtdtrr Solving ihc implied equation (21) for 
X and V' under the condition VA,y' strictly proper wc obtain 

X - 5 25 4 \ lid 4 U.^m^d\ y \ ()H - U f»7Kd 

For comparison wc now solve the coupled equations (IK) 
under the condition ( V ) ™ 0 to obtain 

X - 5 25 4 ] 22d F l.f>K - i) h1Hd, 

V - 5.05J- 1.52d‘ 

and we observe that the implied equation has indeed yielded 
the unique opitmal controller 

Reference controller Solving the implied equation (23) 
under (he condition MA., ‘ strictly proper wc obtain 

E - 4 71 4 U 77Kd 4 0 lrifHi^ M - I 

Now .liolving Ihc coupled equations (19) under the condition 
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(J wc obtuin 

L - 4 71+ {HIM ^ 0 M ^ 

A/ - -4 \Sd - \ 45d^\ 

Again, the Miilution of the implied equation under the 
condition of '|■hea^cm 2 has yielded the optimal controller. 
Feedforward coniroUer, Siilving the implied equation (2A) 
under the condition /A. ' strictly proper we obtain 

V - 2.Ml 4 1. \4d. Z - I,?7 - il51\d. 

vSolving the couple of equations (20) under the ctmdition 
(W) 0 we obtain 

f/« 2.9) ♦ I.l4d. 7- 1 *i7 -0 571c/. 

W ^ - {) l^d\ 

'Iliis verihes that the implied equatiiin has on its own yielded 
the optimal feedforward controller. 

TTie results of this example arc in agreement with 1‘hcorcm 
2; the conditions in the Ihcorcm were satisfied by the 
particular problem data, and the three impled equations 
were therefore sulTicient lor the calculation of the optimal 
amtrollcr 

6 . ConclusioruK 

llic design of optimal controllers for multivariable plants 
subject to measurable and unmeasurable disturbances has 
been considered The optimal controller consists of 
feedback, reference tracking and measurable di.sturbanLX* 
feedforward In general, the optimal controller is determined 
by three pairsS of coupled two-sided (Milynomial matrix 
equations T'hcsc coupled pairs can be reduced to three 
single onC’sided equations, the implied p^ilynomial matrix 
equations. 

Tlic conditions under which the implied polynomial matrix 
equations uniquely dcierminc the optimal controller have 
been obtained in this pa|X‘r 
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AppendU. Polynomial matrix .solution 

Lemma A\. I..CI M, N, P be given fxilynomial matrices (of 
suitable dimensions, M square, del Af ~ 0) t hen the 
p<ilynomidi matrix equation 

YN 4 A M - P 

ptmscsscs a unique solution such that V'M, ’ is siriclly proper, 
for a left copnmc M,, N, given by 

M/N.^NM '. 

Sec Hunt ei al (19K7b) for a pri>of of this result 
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Parameter Estimation Aspects in Adaptive 

Control* 

F. GIRI 4 J M. DION.t L. DUGARDtS and M M’SAADI 

Key Word#—Adaptive control: paramcicr estimation; convergence, stability 


Abatracf—'Ilii.s paper provides a solution to the convergence 
of the parameter estimates to their true values in an ideal 
adaptive regulation context The key design feature consists 
111 the use of an asymptotically vanishing internally generated 
exciting sequence. 

1. /ntroduction 

In ntis papier, the following question is addressed given a 
known order linear lime invariant system, how dinrs one 
design an adaptive regulator which ensures the convergence 
of both the parameter estimates error and the system output 
to zero'* 

llic first objective (i.c the convergence of the parameter 
ostirnaic.s to (heir true values) can be obtained u.sing an 
external persistently exciting signal as in l^llioit ri al (19H5). 
Goodwin and Teoh (1985) and Anderson and Johnstone 
(1985) However, the second objective (i.c the asymptotic 
regulation of the system output to zero) cannot be obtained 
with such an approach lliis drawback can be removed using 
an asymptotically vanishing probing signal I'his issue has 
recently been investigated in C hen and (iiio (1987) and 
C'anudas dc Wit (1987) using an external asymploUealIv 
vanishing .sequence Such an approach requires extra-prior 
knowledge about the system to be controlled 

In the present papier, we propnisc an an.swer to the above 
slated question I'hc main features ot the underlying .solution 
arc: fl) It is carried out irrespective of both the parameter 
estimator and (he control law; and (2) It involves an 
asymptotically vanishing exciting signal. Such a vanishing 
properly is a consequence of the ideal framework wc are 
concerned with. Of particular interest, (he coii-sidcred 
probing signal is internally generated, properly exploiting (be 
parameter estimator propicrties. 

Intuitively, the basic idea of this paper is then to build and 
to use an internally generated exciting signal that tends to 
zero sufficiently slowly to ensure the parameter convergence 
to the true parameters 

Ihe paper is organized as follows. In Section 2 the control 
problem statement is given The adaptive regulator is 
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October 1989; received in final form 12 July 1990 I'hc 
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described in Section 3. Section 4 is devoted to the main 
results of the paper. 

2 Fomiuiatitm of the contn*l prohlrm 

2.1, Thr mrrm to he nmtrolled. let us arnsidcr linear 
time-invariant discreie-lime deterministic systems described 
by; 

')v(r)- ff(NV </ ')»(#) (2 1) 

where u(f) and y(r) luc (he input and output, resiieclively, 
Aih*, q ‘) and q are polynomials in Ihe backward 

shift otKralor q 

Aih\ q '4-4 

and W* IS a iimc-mvanani vector in 

(2 3) 

Further assumptions arc mack that 

Al: the system order zi is known and 

A2. Idel W.lAffil*. q '). /!(«•. q '))! .-»„•!) 

where M,{\. Y) denotes the Sylvester matrix corresponding 
to polynomials X and Y 

llic following equivalent representation of the system 
(2 1) (2 3) will he convenienl (or ideniihculion purposes: 

(2.4) 

with 

ip(r) I yf/ I). }'(f «)> 1, uff /i)|' 

(2..5) 

2.2 77if hmu' crwiro/ ,itru( rurr. We consider the following 
regulator structure: 

«(»•,,/ ')«(()-*.)(«',,/ '))■(()-It (2 ft) 

with 

/((/r.cf ')- l + r,(«‘)9 '-t ,(«•)<) 

.V(«*.<, ') = .V.,(«•) + ..,(»•)!, U.4.V, ,(«•),, 

(2.7) 

The ') and S(H’, g ') polynominK arc deter- 

mined according to a given uinirol design technique (e,g. 
model reference, pole placement, linear quadratic, lung 
range predictive, . 

More precisely, the correspondence K( ) between the 
system parameter ff* and the regulator parameter; 

,(ff) i(.(f^-)- J. (2.H) 

is continuous. For stability purposes, wc consider the 
following definition 

Definition 1 Given a control evaluation fuiKtion X(.), a 
subset D^ of .9?^^ is said to be admissible with respect to the 
function Ki ) if there exists a scalar p . 0 p < 1 such that for 
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m) 


M »tl). 

P{(t,q ') 5/»(»,</ ')«(«,!/ + </ ')S[H,q ’) 

“ 0 . :>\q\r-f,' \ a.q) 

and il there rxivts a positive constant such that for aJI 

I hc implication (2 9) means that the regulator (2 6) (Z.7) 
siabili/cs the class of systems (2 l)-(2.3j We will make the 
further assumption: 

A3 W* is an interior p<iint of /)„ 

It is worth noticing that a complete knowledge of is not 
necessary It is Huflicient to check that a given b belongs to 
using any stability criterion 

Fur example, when the jKile placement (resfxctivciy I, O ) 
control is used, ii is suftieicni to check that the model is 
sufficiently conlrollahlc (respectively siahili/able) 

'Fhe problem of concern is to design an indirect adaptive 
regulator which ensures the cxp4jnential c(»nvergence of the 
inpul'output signals to zero 

3. The indirect adaptive ref^ulalion al^itrithrn 

The considered indirect adaptive regulator is simply 
obtained by combining a parameter rslimalor with the linear 
control law (2.6)-(2 7) I'hc involved parameter estimator 
and the adaptive control law arc given below 

3 1 The parameter estimation ulf^onthm Instead of 
explicitly giving a particular ideniilkation algorithm provid 
ing the estimiiles ft(/) of fr. we sliiic three conditions to Ik* 
satisfied by the algorithm By doing so, it will he clear lhal 
these conditions are the only ones which arc crucial for the 
closed loop global convergence Such an approach has lx*cn 
followed in previous studies (Samson, 1982, Dc lairminai. 
I9H1) I’he involved conditions arc ihe following 

V\ hm 0(/)'(#(O I). 0 - (Ht) tr 

I •* 

C2 lim||()(t) ~ (Hi 1)11 0 

('3 ||fHo (^*11 converges to some value 

31ic above ciinditions ( I C’3 arc siriiighllorwiirdly inter¬ 
preted Roughly sfK*liking, condition ( I means lhal no 
difference cun be asymptotically observed between the 
system and its L-siimaied model (‘2 slates lhal the eshmaied 
m(Hlel IS more and more slowly lime varying. C'3 insures the 
uniform iKUiiuledncss of Ihe parameler esiimales ( omJilions 
f'l C 3 are salisticd by available idciililiealion algonlhms, 
e g. projection algonlhm, leasi stjuares. I S with covariance 
reselling (Cioodwm and Sm. 1984) 

3.2 The udaptn^e Cf/ntr<»/ Ian Fan any lime instant t. lei k 
be Ihc urmtue micgei salistymg 4fM - 4ri(ik I) and 
0, (t) be the parameler sequence defined by 

M. I/) A(N( r)) (3 la) 

where 

T ' max (i^r * 4^)1 and c f)J (3 lb) 


i^/) *=* ip{i)lmit) (3 2c) 

Noljcc lhal the above control law is implemcntable since, 
y{t), fiit) and m{t) entirely depend on information that are 
available at lime i. 

The mam features of the above adaptive control taw arc 
Ihe following; (Ij the controller parameter sequence f^, (r) is 
frozen over an horizon of 4n sampling periods as pointed out 
by equations (3.1a) and (3 lb) and is constructively 
admissible; and (2) an internal impulse exciting sequence is 
[lenodically added to ensure the parameter convergence to 
their true values as il will lx shown. Due to conditions 
C;i-C3. the sequence (/f(r)) is asymptotically vanishing 
infinitely more .slowly than the parameter esiimaics ax well as 
the estimation error convergence 
Tliough the considered exciting sequence is similar to that 
proposed in Kreissclmeier and Smith (19Kb) or Poldcrman 
(1987), It differs Irom the dehnition ol (/!(/)) Such a 
difference gives rise to the potential result of this paper, 
namely the convergence of the parameter estimates to iheir 
true values, via a vanishing exciting .signal 

4. Closed loop f^Uthal stability and convergence 

I'his section is devoied lo the main lesull of the paper, 
namely: 

Theorem 1 Consider the sy.siem (2 1)-(2.3), subject to 
a.ssumptions A1 - A3, m closed liMip with the adaptive control 
law (3.1) (3 2) I3icn lor any bounded arbitrary initial 
condition flfd). n(0) and v(0) one has: 

(i) limf)(/)- fr 

I ** 

(ii) the input output signals are exponentially vanishing lo 

zero V 

The mam mgrediems to cslahlish this result arc the 
following properties of Ihe closed loop signals 

Proposition 1 Ihcrc exists a ^vosiiivc conslani A',„ such lhal 
loi all /, one has 

mil f I)' K„,m{t) V 

The priHit is straighllorwanl (see fun ei al , 19K7ii) 

Proposition 2. t here exists a positive scalar tV such thai lor 
all / f .V. and for all unil vector w t one has 

|k ’()!>( 4/?/ f r)l ' t*)y(4ri/ 2/i 1) 

for at least one r c | 4ri 4 1, 1|. 

Ihe priKif of this 'nchness ' propcrlv is given m Appendix 
A 

Pnuff of Theorem 1. 

(i) Let I. k, 1 c 3 such that: 4riA *: r - 4n(/f + 1) - 1 and 
Kzi 4 2 T - - I One has: 

|0|( + t)'H(()| - r)| 

+ |0(( + + I) «(())! 

1 

X |0((+ .)'(((' +i)l 

I - Hn i 2 


Fhc adaptive law consideied in ihis pajK'r, is given hv: 
«(«.(/),</ ')ii(t) i q ')yu) tKnrnU) (.V2ii) 

With 

m(r)imi(t 1) 4 max (l|g)(r))l. 1}; (I* o<l, 

m(()) >0 (3.2b) 


where 



if r ' Ank 4 In - I 
oiherwise 


(3.2c) 



V |0(/+ /)'(}(/ +()l 


+ ^ ||«(t + I) - 4 ( - UllJ 

I - Kn ‘ 1 


■4 V 1)11 (4 1) 

where the second inequality follows using the fact that 
1. for all f 4 Otherwise, using Projwsilion 2, it 
follows that for al least one r'; "4n 4- 1 r ^ - 1, one has; 

10(4n* + r 2n - 1)||fl(0|| 

which yields; 

|0<J + (4n* - «) + r')'»(OI a - 2n - D ||e(f)l|. 

Hcncc. for all i. k ^ .3 . such that: 4nk ^i <4n(> 4- 1) - 1. 
there cxisis a r -Hn 4- 2 r - 1, .so that; 

|0(r t r)^(/)|4-tSy(4/iA - 2 zt - l)||ff(OII (4.2) 

Combining (4 1) and (4.2) yields; for all i, it e 3", such 



ttnei ^a}j»ei 


mi 


chat: ink s t s 4n(Ar -f 1) - 1. 

i ti 

2 ; 1 ^ 1 + !)"«(/ +1)1+ V ||»(,+ 1 ) 

I« Mm O i - tin f \ 

- »(t + i - l)|||/Ar(*fl* -2n - 1) 

“ 2ai ~ I) (4 :\) 

where the second inequality lollows from (3 2d), l.^smg 
conditions C1-C3 it lollows that y(n ns / which, 
together with (4.3), leads to; 



lim |lH(/)|l-() 

I .♦«. 


Tills completes the protif. TVr 

(li) The second part of the ihcorem is by now standard 
(Goodwin and Sin, 1984) since the sequences (ff(i)} and 
{p{t)) converge lo 6* and 0, respectively |scc (iiri ef al 
(1987b) for more deiails) 


Remark. In the nonidcal case (unmodcled dynamics and 
hounded disturbances) the alnivc results arc no longer valid. 


5. Cimcludinfz remarks 

Parameter estimation aspects have Ih'ch invcstigiiled in 
this paper An asymptotically vanishing internally generated 
exating sequence has been pcrKHlically added to the control 
signal, ensuring the asymptotic parameter error cimvergcncc 
to zero and henceforth the estimated model admissibility 
F'urthermorc, the asymptotic regulation of ihc system output 
to 7 x*ro is achieved. 
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Appmdix A : Proof of Propostskm 2 
The pRsof is done in three steps In step 1, a new closed 
kx>p state vector x(i) is defined and related 10 ^(r) 
Proposiiion 2 is iduiwn to hold for x(r), in step 2 It then 
follows readily from steps I and 2 

Step 1. Following Kreisselmcier and Smith (1986) the plant 
(2.1) can he deicribcd by the following conirxiUable 
rcprescntaiion. 

')«(()"«(#) 

, (nl) 

v(()-«(«*.</ 'm) 


where f(f) is an internal state variable. The substitution of 
(al) in (3 2a) yields 

v ')-'!(«•,<( ') 

+ .V(<J,((). 1 , ')||(ll-/(t) (a2) 

where /(r) =>/)(»)in(f). Dchning Ihc Male vector >(/)'■« 
||(r - 1) ^(r Zrt)|. equation (u2) can be equivalently 

written, 

4(9 4 I) M (;(/)^(/) (a3) 

where 



- v,(0 

,(n 

()" 

0 


“r 

0 


1 0 



<.'(/) - 

0 



k - 




1 

0^ 


(1^ 


(ti4) 

and y,(/) is the ctH:flicicnl of c/ 'm the left hand side of (a2) 
Substituting (ul ) in (2 5) yields 

^X/)' - \ '). . - 1 / ’"'Hitr.q '). 

Mtr.q ') . q "■'A(H\q ')l£(f- 1) (ii.S) 

.Since A(0‘.q ') and . q ') arc eopnme. the 

2/1 polynomials on the right-hand side of (a5) me linearly 
indcfK'ndcni over the reals As .<(0* ’ 
|Ii/ ' (/ 1), It lollnws from (a5) that there 

exists a full rank 2/i 2/i matrix H such that 


(pit) ^ Hxif) fab) 

Step 2 Following Kreisselnicier and Smith (19K(>), one 
obiain.s from (a3), after .some computations 

2n I 

^ y2r> i ,ff 4 2/1 - 1 )ji(r 4 A 4 / -t 2n) 

I • n 

- MU -I 2fi l)/ (< + t -t 2n I) 

.’n I 

♦ S Yix I i(f ■* 2n I) 

I 11 

y ! V (/(/ + In - I)' ‘\ii[t 4 A I / 4 In 1) 

" (/(( 4 2n 1 ))jr(f 4 A 4 / 4 2/1 1 )| (h7) 

where )v,(r) ^ 1. - 2/14 1 A 0 and for ail f, 


A^(D U. 




yi» i(0- r.(0 

y,(0 ■ ' ' n 

1 


FU)' ./(r4 2n - l)|. 


fa8) 

(a9) 


\.jc\ t 4fiA' for some A' f > From (3, la, b) it folkrws that 
the controller parameters r^ii), i,(r) (Otw ' /i 1) arc 
'frozen” over the interval \i, t ^ in - l| This impltes that 
for all r: f 4 1 s T -I r 4- 4/1 - 1. y,( r) ^ yA ^ I) aod there¬ 
fore, using (a4). Gfrl^Gfr-l) Hence, for all 
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k -2n 4 I k 0 and k ’ c A wc have 

2n 1 / / 

X X 4^2/1 IV' 

(.. ri '/-o 

' |ry(4fiA' 4 A f / 4 2n - 1) ■ (/(Ank ' 4 2n - 1 j) 

■ it (4/»A ' ^ k I 4 2/( “ 2)l}|l-0. (alO) 


where 1 h ai the (1 -ft)th entry and f{t) is replaced by 
P{t)m{t). Thus for at least one k : ~2n 4 \*:.kr^i\ and all 
k e -A": 

\v^M(4nk* 4 2/1 - \\F{Ank‘ 4- A + 2n - 1)| 

a^y{Ank ' 4- 2n - 1 )m{Ank ' 2ji - I) 

^ . .. ...—- ^ (a 13) 

V2n 


Lxl 1/ fye an arbitrary unit 2/i vector Premultiplication «>f 
(a7) by i'* and use of (aid), yields, for all k 2/i 4 1 < k -r, 0 
and all k 't X. 

In I I 

^ Yin i |(4/iA' 4 2n “ l)f;'vi(4/iA'4 A-4 / 4 2/i)| 

r-i> ' 

:r |1.'M(4/»A'4 2n - I)f (4nA'4 A 4 2n 1)1 fall) 

Using assumption A5 it follows from (3 la, b) that the 
controller parameters arc uniformly bounded. Then, from 
(ii2) there csists a p<Ksiiive constanl Ky such that for all 
t; |y,(/)| r.. I- . 2/1 1). I1iis logclhcr with (3 2b) 

yields for all A ; 2/i 4 I A r. 0 and A' t ,A ; 

S Yift I 4 2/1 “ I )i^V»:(4/iA' 4 A 4 / 4 2/i)| 

I 

In I 

^ KyrniAnk' 4 A f i 4 2/i) |i'Vit(4/iA' 4 A 4 i 4 2/i)| 

: 2nFyKtm(4nk' i 4n I) miot |i/'i(4/iA' 4 t)| fal2) 

I «. r 1 


Combining (all)-(a]3) it follows that for all A' c X: 
max |i' 'i(4/iA ' 4 t)) 

1 % r I 

Oj^y(4/iA '-4 2/t “ I )/7 i(4/iA ' + 2n - 1) 
2rty/2nA\A'y m(4nk' 4 4/i - 1) 

Using Proposition I and inequality (a 14) there exists a 
positive con.siunt such that, for all A' e X: 


max 

^ T *.4n 


|i''r(4/iA' 4 T)j . r 


c7^y(4nA ' 4 2n - 1) 
2/i\/2nK,KiK^ 


(al5) 


Step 3. Now let oj be an arbitrary unit 2/i'Vcctor and define 
the unit In veclor r' ~ * A/|| Using (ab) one 

obtains for all r and r 


|w'0(/ 4 r)| - |fi; V/.r(/ 4 r)| ^ |i/'i(/ 4 t) 1 (alb) 


where o„,„(//) -0 IS the minimum singular value of H 
l.etting i7;^,|o„„„(/f)|/|2/]\^/iA,', K , (al5) and (alb) 

imply for all A' e .V 


u.sing Proposition 1 for some [Hisilive constant A',, where 
Jt =« x//M. 

From (aK), Af(i) is an invertible triangular matrix with 
positive, bounded away from /.ero, singular values for any i 
Let a (visilive lower bound of these singular values 

F(4riA ' 4 A 4 2/1 I) 

r- |() • () I (I ■ ((|' {y(4/i* ' + 2fi 1 )m(4«/,' + 2/1 -1)1 


max |(j/' 0(4/1*' + i)|-* iSy(4/i*' + 2/i 1). (iil7) 

1-. r-v4« I 

Letting A' - j 1 it follows from (a 17) that lor all / e A': 

max jij/' (piAnj 4 t)| dyiAnj - 2n - 1) (alH) 

I 4n T ■ I 

which establishes Propi^siiion 2. VVV 
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Estimation Theory for Nonlinear Models and 
Set Membership Uncertainty’*' 

M. MlLANESEt and A VICINO* 

Key Words —Estimatmn theory, set membership uncertmniy; unkin»%yn but Nmnded noiM*; 
uncertainty mlcrvals; nonlinear nuxlcl 


Ahotncl—In this paper wc study the problem o( estimating a 
given function of a vector of unknowns, called the problem 
element, by using measurements depending nonlinearly on 
the problem element and affected by unknown but bounded 
noise As.suming that b<ith the solution sought and the 
mca.siircments depend polynomially on the unknown 
problem element, a methiHl is given to compute the 
axis-aligned box of minimal volume containing the feasible 
solution set, i.e the set ol all unknowns consistent with the 
actual measurements and the given bound on the noise 
The center of this b<ix is a point estimate of the solution, 
enjoying useful optimality properties. The sides of the Ih>x 
represent the intervals of p<»ssiblc variation of the estimates 
It is shown how imfsonant problems, like parameter 
estimation of exponential models, lime sc-ries prediction with 
ARM A models and parameter cslimaiion of discrete time 
stale space models, can be formali/eci and s<ilved bv using 
the developed theory 

I. Introduction 

In this paper the following problem, referred to as the 
(generalized) estimation problem, is addressed (/onsidcr a 
problem element A, for example the vector of parameters of 
a dynamic system or a time function We are interested in 
evaluating a vector valued function .V(A) of this problem 
element (for example, some functions of parameters of the 
dynamic system or parlicular values of the lime function) 
The element A is not exactly known and we have only some 
information on it In particular, we assume that it belongs to 
a set K of possible problem elements and that information on 
A IS given by the knowledge of a function / (A), representing 
measurements performed on variables dcjn-nding on A We 
suppose that exact measurements are not available and 
actual measuremcnls v arc corrupted by some* error f) 
according to the equation 

V - f (A| 4 p (I) 

The estimation problem consists in finding an algorithm 
(estimator) ip providing an approximation 0 (v)'‘.V(A) as a 
function of (he available data y and in evaluating a measure 
of the approximation error. 

Many different problems such as linear and nonlinear 
regressions, parameter or stale estimation of dynamic 
systems, stale space and ARM A models prediction, filtering, 
smoothing, lime senes forecasting, interpolation, function 
approximation can be formulated in a general unifying 
framework based on the abt>vc concepts. 

" Received 3 November 1988; revised .30 May 19H9; 
revised 13 March 1990; received in final form 5 June 1990 
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Thf: solution of the eslimalioii problem defKnds on the 
type of assumptions made on p Most of the investigated 
casc.s in (he literature on cslimaiion theory are undoubtedly 
related to the assumption that I he error vector p is 
.statistically modelled as an at least partially known 
probability disinbuiion Within this coniexi, the most 
important and widely used results are related to the theory of 
maximum likelihiHKl cslimalors (MLE). Dcspiic the large 
amount of iheorelical results developed on MTE, (he 
application to real world problems may not l>e appropriate 
due to a numl>er of pi>ssiblc drawbacks. J hese include; 

1 Actual computation of Ml.F. usuallv fcquircs a search 
iff the global extremum of functions which are in 
general multimixlal. Since general optimization algo* 
rilhms (including the so called global ones based on 
random search) arc not guaranteed lo achieve Ihe 
global extremum, the estimate oluained may In* far 
Irom lH‘ing an MLI/, 

2 Even though MLF are asymptotically efficient, it is 
diniciilt lo evaluiilc whether the available dala arc 
sufficient to ensure that the covariance matrix estimate 
IS '‘close’* to the ( raincr -Rao lower bound; 

3 For small dala sets, it is useful lo have lower and upper 
iHiunds of the estimate covariance matrix; indeed, tight 
upjxr Ixiunds arc difficult to evaluate Moreover, in 
this condition even the evaluation of the C ramer Rao 
lowei bound may be* not signilicani, 

4. It IS diflicull to evaluate the effect ol nonexact nuiiching 
ol the ussumed slalislicul hy|X)thcses on p In 
particular, (here is no theory for taking into account the 
prcsenix' m p of modelling errors 

In more recent years a new approach, referred to as 'kci 
membership error description” or “unknown but bounded 
error (UBBFi)”, has been investigated [sec Milanese., (1989) 
for a survey on the lopicj In this ca.se, Ihe error vector p is 
assumed to lx: an element of an admissible error set 
described by a norm operator as 

f (2) 

where r is a known quantity. A case ol great concern is when 
/., norms arc adopted; in this case, each aimponcnt of (he 
error vector is known to tx; bounded by given values. 
Motivation for this kind of error representation is the fact 
that in many practical cases the UBBF information is more 
realistic than statistical assumplions with respect to the 
measurement error (Jvchwcppt*. 1973; Milanese and Bclforie, 
1982). In this context, a po.ssihic ap[noach to (he estimation 
problem cimsisis in finding the set of values A'(A) [feasihlr 
soluium ir/) such that A is consistent with the meaHurements 
y and the error mcxlcl (2) Any element of this set represents 
a possible estimate, although the center or (he minimum 
norm element of the set enjoy inicrcsung optimality 
propcnics (Trauh and Wo^jiiakowski. 1980; Micchelli and 
Rivlin. 1977. Kacewicz et al , 1986; Milanese er al , 1986). 
The Mzx* of the set represents a measure of (he estimate 
reliability. 

Unfortunately, an exact reprcsenUlK>n of the feasible 
solution scl IS in general nol simple, since it may not be 
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convex and no( even connccicd. It therefore convenient to 
Unik for simpler, although approximate, descnptionfi of this 
ikct To this extent, the use of simply shaped sets, like 
axiS'uiigned fxixcs (referred to as boxes for short) or 
ellipsoids, ha^ been pro^Hised to apprtjxiinaie the feasible 
solution set (Milanese and Bciforte, t9H2. Fogel and Huang, 
I7H2) Idlipsoids may a|)proximatc the shape ol the feasible 
solution set better than boxes Unfortunately, algorithms for 
computing cilipsoidic approximations arc known for linear 
.V( ) and F(} only (Fogel and Huang, 1*>H2, Norton. IWT) 
Moreover, the obtained appn^ximations may not l>e light 
(Bciforte and Bona. 1^X5, Norton, I^HT), On the other 
hand, important information can be obtained by box 
approximation. In particular, the minimal volume box 
containing the feasible solution set (MOB minimal outer 
txix) has the following properties 

• The length of each of us sides along the corresp<mding 
rth ccKirdinute axis gives the maximum range of possible 
variation of (\(A))^ (called uncertainty interval Ulj. 

• riu cenicr of MOB is the (( hebyshev) center of the 
fcasihle solution set and hence it is an estimate ot A(A) 
enjoying several optimality propcrriies (Milanese i*/ al . 
Kacewiev ('/a/, 1*^86). 

For linear problems, (he MOB can he easily computed hy 
solving suitable linear programming problems (Milanese and 
Helforte. I‘^K2) Unforlimately, many practical eslirnation 
problems, even if related to linear dynamic models, lead to 
nonlinear A( ) and F( ) (see Section .M Several approaches 
have been profuiscd to evaluate MOB when F( ) is nonlinear 
and .S( ) IS identity In C'lcmeiil and Cienlil (B)HH) a solutKin 
IS found 111 the ca.se in which (1) represents model 
output-error equations, In Bciforte and Milanese (IMHl) a 
method of successive linearization is proposed to construct a 
sequence of boxes contained in the MOB, but no guarantee 
of convergence to the MOB is given. In Smit (1983) anil 
Walter and Piet l.ahanier (19Kb) opiimi/alion methods are 
used to consiruci the boundary of the leasihic solution .set In 
parlicular. the random search algorithm used in Walter and 
Piet Lahamer (198b) gener.iles a sequence ol Ixixes 
contained m the MOB and converging monolomcally to ii 
with probabiliiv one However, this convergence prnperty 
may not he useful in practice, because no estimate is given of 
the diManee of the iiehieveil solution irom the global 
solution 

In this paper we show that it .V( ) and h( ) are polynomial 
functions, a sequence of boxes contained in the MOB can Ih’ 
constructed, converging to it Moreover, an estimate of the 
distance of the estimated box from the MOB is provided at 
each Iteration It is also shown that the hypothesis of ,V(A) 
and F(A) polynomial covers large classes of problems of 
practical interest such as. for example, the identiticaiion ul 
rnulticxponential, AKMA and slate s|iaie discrete time 
models 

file paper is organized as lollows .Section 2 introduces the 
spaces and operators needed to build a general framework 
lor csiimalion problems In Scciion it is shown how some 
Mgmheuril estimation problems lead to jxilynomial ,S(A) and 
f(A). Section 4 presents an optimization algorithm whieh 
allows one to derive a guaranteed global solution for the 
class of polynomial problems mentioned atnive. llte 
efTeclivencss of the proposed approach is demonstrated by 
some examples rc|K)rlcd in Sceiion 

2, A jt’fncral lrumcwi}rk for estimation problems 

Let A he a linear normed zi-dimensional space on the real 
field (called the problem element space). C onsider a given 
ofwrator .V, called the solution operator mapping A into / 

^:A (3) 

where / IS a linear normed /-dimensional space on Ihe real 
held In estimation theory, the aim is to estimate an element 
,V(A) belonging to the solution space /. knowing approximate 
information ulioul the clement A 

llic available inlormalion on Ihe problem is contained in 
the space A and in an additional linear space V* which will he 
introduced below 'Fhe first kind of information, which is 


referred to as a prum informaiion, generally conmts in 
axsuming lhal A belongs to a subset K of A. In our 
dcvclopnicnt, we will deal with problems for which cither 
K ^ \ {i.t no £1 priori information is available), or K is given 
(AeA:||r(A-A,3)|lsl) (4) 

where P is a linear operator and A,, is a known problem 
clement Despite the above assumption, many of the resuli,s 
prcscnled in the paper hold also for more general structures 
of the set K Concerning the second kind of information, wc 
a.sKume that .some function F(A) is given; F. called 
information operator, is a map from A to a linear normed 
m-dimensional space Y (called measurement space) 

F A~^Y (5) 

Wc a.ssumc that Z and Y are equipped with (weighted) /, 
norm.s t 

In general, due to the presence of noise, exact information 
PfA) about A IS not available and only perturbed information 
y is given. In this context, information uncertainty p is 
assumed to be additive, i.c 

> F (A) f) (6) 

where the error term p is unknown but bounded by a given 
positive value ( according to an /.T norm 

(7) 

Notice that the use of an IZ norm in the measurement space 
Y allows us to consider different error bound.s on every 
mea.suremcnt. An alfioriihm (p is an operator (in general 
nonlinear) from Y into / 

0 K (8) 

which provides an approximation (/>(> ) of .V(A) using the 
available data v Such an algorithm is also referred to as an 
estimator. 

As a simple example of how a specific estimation problem 
(its into the general framework outlined above, consider the 
problem of parameter estimation of a lime function 
belonging to a finite dimensional space, using data obtained 
by sampling and measuring it at a number of instants. 
Roughly speaking, the problem element space is the space of 
the considered class of functions, identified as the space of 
the unknown function parameters; the space Y is the space of 
available samples (possibly corrupted hy noise); the solution 
operator is the identity operator and the information 
operator is the sampling operator 

Now. we introduce the following set, which plays a key 
role in the development of the theory 

r(y)- (At A'.||.v-F'(A)|i:sf ) (9) 

fhe set /’( v) contains all A compatible with the information 
F, the data y and the hound r on the noise; S{T{y)) 
represents the already mentioned feasible .solution set. Wc 
make some technical assumptions about this set. First, there 
exists a set Y^^%Y such that for each v t V,,. Tiy) is 
nonempty, i.e. the model structure is able to represent all the 
dala V l>elonging to the set Secondly, T[\) does not 
contain isolated (di.scrcle) points I'hird, T(y) is hounded; if 
this were not true. F(X) would be too poor to solve the 
problem with finite error, indicating the presence of 
unidentifiahility conditions in the problem formulation. 
Notice that the above hypotheses are almost always implicitly 
a.ssumcd in the great majority of identification problems. 

Algorithm approximation will be measured according to 
the following local and g/oha/ errors; 

1. Y-local error £( tp. y ) 

E((^. y)^ sup 115(A) - 0(y)|) (10) 

Ap T (V \ 

2. A-UkoI error A) 

E(0. A)- sup 115(A)-4>(v)|| (II) 

t A weighted norm, denoted by IZ, is defined as 

||yli;r= majt w, jyj. w, >0. 
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3. glohal error £(^) 

£(0)= sup A) (12) 

Algorithnis miJiimizing these types uf errors urc cjUled 
Y-iocaiiy. A4oc4iily and giahally optimal, respcetivcly 
Notice that the above errors, and related opiimality 
concepts, arc relevant to estimation problems In fact, ihc 
A'local error measures the maaimum unccnainty of the? 
estimates induced by the perturbation affecting the exact 
information F(A), for a given problem elemeni A On the 
other hand, the K-local error measures the uncertainty 
affecting an estimate of 5(A), for a given set of data v, A 
being unknown. The glohal error represents a wont coAr a>st 
function, in the sense that it measures the largest estimation 
uncertainty arising for the worst data realization and the 
worst problem clement in the set /'( y) of admissible problem 
elements. 

As already mentioned, the set /'(v ) plays a key role in the 
present theory In particular, if z' e / is the Chchyshev 
center of 5(T(v)).t the algorithm called the centraJ 
algorithm, defined by 

0‘(>) = z' (13) 

is known to be K localiy and globally optimal (Traub and 
Woiniakowski, I^Ht); Micchclli and Kivtin. In 

addition. A-locally optimality of 0, has been proven undei 
mild assumptions in Milanese rt al (I9K6). Kacewicz et al , 
(1986) for the case where 5(-) and F{ ) are lincar. 

Imporlanl information can be also derived from the 
knowledge of the quantities and z^, solutions of the 
following optimization problems 

= inf (5(A)),; /-!,,/ 

i.:nv) 

(14) 

^ sup (5(A)),; I I. I 

A. r (VI 

More precisely, wc observe that the intervals 

Ul,-(z;’. z,^|. i- I. ./. (15) 

represent the range of possible variations of the unknown 
solution components, fhe MOB containing 5(/(y)) is 
obtained as the cartesian product of the HI, 

MOB - (Ul, X Ul; X X UI/I (16) 


where u, and y art unknown real parameters and e(r) is 
unknown but bounded by a given e(ii 

ie(r)M. HD (19) 

Suppose that m values |>(f, ) , >3U)| known and the 

aim IS to eslimate paramcieis and v,, i^l./ 

Problems of this type arise* in many applications, eg, in 
pharmacokinetics and biomedical problems ((liHifrey, 1983) 
By .selling e i = I, .6 the sp«cx‘ A is the 

27-dimensiona) spaiv of A » |^i, . and 

/ A. and 5 is taken as the identity o|>C!atof Y is an 
m-dimensional space wlu>\c elements art |.v,. . v,,)' *' 

|y(M. . v(/^)|' 

Tile inlormatton operator h { ) is given by 


where ii is apparent that each component of f(A) is a 
polynomial (unction of )i, and Note ihal in this way 
variables i,,s arc considered instead ol the v,s t:stimaies nl 
the v',s and relative HI can be obtained by Inganlhmic 
transforinaiion o( the 4,s 

3 2 f\iramt'tcr esfimuiutn oj AHMA nimir/.v I.et us 
consider the ARM A model 

S , ■* ^ <’'> 

/I » 1 

where f\ and are unknown but Ixvuiided .sequenees 

l''J* f.. (22) 

To keep notation as simple as piissible, consider the case 
p-q Sup|H)se that m values |v,, . are known and 

the mm is In estimate parameicrs iS,, ff, A can he deliried as 
the Ip i rri I-dimensional space with elements 

A h'l,. .,1' (23) 

and the subset K ol A is delined by (22) / is the 

2//-iliincnMonal space with elements 

.' IA,. .2.,,, (,■>4) 

Ihe operator 5(A) is linear and is given by 


The central algorithm 0' can be computed coirqxincniwiNC. 
as Milanese and Tempo (1985) 

(^'(v)), - 2 ; = (;r + i,*')/2. I '_ ' (n) 

Unfortunately, finding global solutions of problems (14) is m 
general a diflicult task. If no further as.sumptions on 5 and F 
arc made, the use of general global optimization algorithms 
assures at most convergence in probability to global extrema 
More importantly, these methods do not provide any 
measure of how far is the computed solution from the glohal 
minimum (sec eg Pardalos and Rosen, 1987. van 
Laarhoven and Aarts, 1987) However, in many estimation 
problems 5(A) and £(A) arc polynomial functions of A (as 
shown in the next section) In these cases, ii is possible to dc,sign 
algorithms (as the one presented in Section 4) which ensure 
certain convergence to global extrema, and give at each step 
a measure of how far is the actual solution from the global 
one. 

3. Nonlinear estimation of dynamic models 
As already mentioned, the general framework presented in 
Section 2 can be used to deal with several estimation 
problems such as dynamic model parameter estimation, 
prediction, filtering, etc In this section wc show how to 
formulate some of them, leading to polynomial 5 and h 
3.1 Parameter estimation of exponential models. Let us 
consider the multicxponcntial model 

I 

<'H) 

1-1 

t 2^ is defined as sup lU*^ - zH = inf sup ||i - z||. 


MA) |/,,J0|A (25) 

where /^, is the idcniiiy matrix ol dimension {2p, 2/0 iiiul H is 
the null matrix of dimension (2/i, m 1) Y is an m p 
dimensional space with elements v ’ (y,,, 1 , . l„,|' ITie 

information operator /•( ) is given by 

/.(A) 

ri^U 

^yVr, ^ .^ ff.U,, 4 ■ ■ f 

. ^.^ 'V >4. ,44 

(26) 

As It can he easily checked, .VfA) is linear and /'(A) is 
polynomial (actually linear in and bilinear in R, and u,) 

It IS worth noting that the same technique can lx‘ used to 
deal with more general miKlcIs such as ARM AX, bilinear, 
quadratic, etc 

3 3 Multisiep prediction with ARM A models, ('onsider 
the ARMA model (21) and suppose that the aim is to 
estimate when past values (y,, >4,| are known (h-step 
ahead prediction problem ) This problem can be embedded 
in the framework of vScxiion 2 by defining all spaces and 
functions as for the ca.sc of ARMA parameter estimation, 
except lor A, / and ,S(A). f or the sake of notation simplicity, 
consider the case 6^2 TTic space A is a 2p A m 4 3- 
dimensional space with elements 

4 = [d, . .“1 .“m . I . <■«, , I . . j|' 

(27) 
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Z b the one dimeniionul vpace with elements z » 

11»e operator 5( ) in no longer linear and is given by 

,,, 

+ i + + (28) 

<«• I 

where 

A, ^ 0, for t ^p 

The operator .Vf ) is no longer linear and is given by 


where 


.V(A)- ^ (A,A, 

< - I 

+ i) + *>. I i)''-. ,, I + ; 

A, ^ 0, 0, 0, for i > p and d„ I. 


(28) 


Note that the evaluation of the cxprcHsion of A'(A) requires 
symbolic (ximpututions which for large h may become 
cumbersome. If necessary, such symbolic computations may 
be performed by symbolic manipulation codes like 
MACSYMA. RliDUC l:. muSIMI\ etc 
.1.4 DLscreif timt state space mode/.v. Let us consider the 
8 ih order linear di.scrclc time dynamic model 

»t. I py. 

y* = f'(/')•»* +'■a 

where the system nuitnccs entries are (xdynomial functions 
of physical unknown parameters p c H‘, i"* h known 

sequence and ih an unknown but Ixiundcd sequence. 

Suppose, for case of presentation, that the system is single 
output and that m values of the output | > ,, . . , y„,\ are 
known The aim is to e.stimatc unknown parameters p and 
.system initial condition i,, e llic problem can Ik 

embedded in the framework of Section 2 as follows ITic 
space A is identified as the / + /i-dimensional space of vectors 
^ ^ I AC ^ A (if no a priori information is available on 
physical parameters and initial condition); / - A and S is 
identity. Y i.s an m-dimensional space and f(A) is the 
m-dimcnsional vector function given by 


FM) 


rri I 

(■(/>)/)'"(/I)jt„+ V ((pjA .(/>)«(/Mu, 


(Atl) 


The operator T( ) is again polynomial in the parameter 
vector p and linear in the initial condition Jt„ Note that 
symbolic computation of the polynomial expressions of A-,(A) 
in (.X)) is required For large values of m, symbolic 
evaluation of (30) may become cumbersome due to the fast 
incrca.se of the number of terms m each component of / (A) 


4, An a/gtfrithm for the ex act computation of solution 
uncertainty inferi>rt/.v 

If aV( ) and F{ ) are jxilynomial functions, optimi/.ation 
problems (14) arc of the form 


subject to 


min (max) /,i( A) 
|/,(A)|s.(,, I - I.m 


where functions /(A) have the structure 


(31) 


Miffnommi programming problem (see e g. Ecker, 1980). Such 
problems arc in general not convex and may exhibit UkaI 
extrema. In the following we present an algorithm, due in its 
onginal version to Falk (1973), which guaranteeii conver¬ 
gence to the global extremum. Tbe iterative algorithm allows 
one 10 evaluate upper and lower bounds on the absolute 
extremum at each iteration. The sequences of upper and 
lower bounds converge monolonically to the global solution. 

A signomial optimization problem is defined as follows 


rnin (/i„(A) - g„(A)) (34) 

.subject to 

>i*(A)-g*(A)5^ I. A-l, . 2 m 
A, - 0 , i 1 . n 


where 8 ^(A) and g*(A) (A - (J, . . , 2m) are posynomials, i.e. 
polynomials with non-negative ciKfficienis such that 


^ «, lU;*" 

, *=(>, (35) 

ka(A)- X 

(* /^(A ) / "■ I 

where cxprinents u,, are real numlxTs, n, arc pMxsitivc reals 
and (A). A = t). . . 2m are sets of integers di.sjoini for 

each A. Note that functions 84 (A) and ^^^(A) arc in general 
not convex Nevertheless, we can introduce new variables x, 
with the aim of transforming 84 and into convex functions 
of the variables x, 


A,-e‘'. 1 - 1 . (36) 

Equations (TS) become 



(. /,(* ( 

(37) 

where ( 

It /?|A 1 

. ■) denotes inner product and a, - , 



Problem (34) is transformed into the equivalent problem 

min (A/„(.x) - 0’„(.v)} (38) 

.subject to 

H,ix)- G,{x)'^ 1. A - 1 .2m 

vSince H^ix) (and O\(.0) are convex functions, it follows that 
if T(A) - 0 VA, then (3H) is a convex problem and the original 
problem (34), called a p()synorniul problem, is equivalent to 
a convex program, 

The algorithm given below generates a tree whose nodes r 
are a.s.socialed with convex problems ()" which approximate 
the signomial problem (38) (called P) Problems Q' are 
obtained by suitable linear overestimates ol (/*.(x) as follows. 

Suppo.se that a priori upper and lower bounds and x'^ 
of a global solution x* of (38) are given 

r;-; /--- 1 . n (39) 

and that 

r //n(A*) - f^i*) 

is the global minimum of (38). Let ./ ^ be the set defined as 

- {x : r] s (a,. x)z%R], i e /^(A)) (40) 

Variables r' and R] arc recursively computed using the rules 
of steps 5 and 6 below, starting from the initial values 


f,W « (32) 

k^\ 


^ S min i t l.(k) (41) 

/-I 


For example, in parameter estimation of exponential 
mixtcls of Section 3.1 one of the problems to be solved is 

minp, (33) 

subject to 

.v(<,) - X ^ f(0. ) “ 1.m. 

’Fhe above optimization problem can be transformed into a 


/?,' V max (a„x7. i e y,(A ) 

/■" 1 

Approximating problems Q ^ arc of the form 


min i//o(*) “ 

subject to 

jH 4 (x)- L;(x)=< ). A - I_2m 

1 T," S S X,**, >=1. „ 


(42) 


(43) 
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4U/ 


where 

LUx)^ 


k \ 

2 

3 4 

5 

6 

7 

H 

9 Id 

u 0.75 

y. 7.39 

15 

4.09 

2.25 .3 0 

1.74 0,097 

6 0 
-2,57 

9 0 
-2.71 

13 U 
-207 

17,0 

I 44 

210 25 0 

-0 9H OMi 





Set 

c- 

* , 

‘ ‘ - (a,. 

/ff'" 

-k;. Vif/.(4'), 

•' - k;. 


I # I ‘ 


(M») 


I t iL) 

Note that aincc ihe (enns are linear and funciionN 

arc convex, problem.s convex. Global solutions 

X* for these problems, with minimum KiU') ~ /-lA'). 
can be found by any convex optimization algorithm Also 
notice that Ll{x) ^ ^ and consequently if 

then v'^^fr 

The algorithm generates new approximating piroblems, by 
selecting an existing mxlc r, according to step 3 of the 
algorithm below, and refining the linear approximation of the 
corresponding problem Q \ according to rules of steps and 
6. Only two problems arc generated at each stage, so that 
after stage s has been completed, problems Q', Q‘, 

, ' * arc generated. 

l.xrt J{s) be the set of all nodes r which have noi been 
selected as branching nodes at stages preceding stage .y (sec 
step 3 of the algorithm below). Define V' and f/' as 

V' =« min i>* (45) 

f «/(j) 

U'^ min (/y„(x') ~ r;„(x")) (46) 

T - I . Zi I 

Note that approximations of functions C/\(x) arc performed 
by amstructmg linear envelopes, so that the minima of the 
two approximating problems generated at each stage \ arc 
larger than the minimum of the problem which generated 
them at stage .r - I Tliis guarantees that the sequence ot 
lower bounds V"*' to the global minimum never decrea.scs 
Moreover, the way in which the upper bound.s U* arc 
generated ensures that they form a non increasing sequence 
More importantly, using the results in Soland (1M7I). it is 
shown in Falk (1973) that the .sequence Ji ’ contains a 
subsequence converging monotonically to the global solution 
X* and 

lim V’ = lim V' - f*. (47) 

.1 .r* I 

Tlie algorithm consists of the following steps: 

Step 1. Initialization. 

Generate and solve Q\ obtaining x', r‘. V\ (/'. Sci 
.1-1, r^-l.y(.)- {!) 

Step 2 Check for .solution 

If V U* then a global solution of problem P is 

x'-x'; (4H) 

Otherwise go to Step 3. 

Step 3. C'hoose a branching node r. 

^Icct T e J{s) such that v ' ~ V 

Step 4. Choose a term of G^(x) to he approximated. 

Select e (0, 1. . . . , 2m) maximizing /.J(x*) - H^{x') 
Select i* eAfA*) maximizing i^/(xO ~ cr,f 
Step 5. Generate problem 

Set 

r^ = r:, = >^ieUk^), r#.* 

Hft = ia,.,x'), rf:^r;.. 


Step 7 Soli*e problems 0"* and ’ 

Solve problems (7^’ and obtaining i ^ i'"*. r*\ 

M*’'' V C'otupuic I*’’. ' auxirduig U> (4^) and (46) 

Update ihe set ^(.f): add the two mnies r Zv. r Zi ♦ I and 
delete the iuhIc t selected at Step 3 Set .v * v f 1 and go to 
step 2 

We tx>ncludc this .section by making wimc considerations 
on the estimation algorithm propifscd above 

Remark I Compulation ol (/' may fn* improved by using in 
(46) a U>cal solution to the line problem P, ciimpuled by an 
itcralivr algorithm starling from x*. instead of using 
(//Mx*) (.„(.l')j 

Remark 2 1310 cxmdilion >0 in (.34) is not a serious 
restriction In fact, it is possible to bring the set 7'(y) in the 
first orlhani of A by means of a suitable translation of the 
origin of the problem element space Another way of dealing 
with this problem is to express unknown sign variables ns 
diflcrcncc.s ol auxiliary strictly positive varoibles. 

Remark 3 Ibc ninvergcncc speed of the algorithm is in 
general quite sensitive to Ihe sizes of intervals x^ - >7* In 
solving any of Ihr 21 optimization problems (14), information 
gained by the .solved ones can Ik used to shrink as much as 
pirssihlc such inlcrv'als llus is particularly simple for 
parameter estimation problcmA where z, - (5(A)), A, In 
fad, the following heuristic strategy can Ik used for handling 
this problem A certain number of runs of the 21 optimization 
problems (14) are performed, stopping the algorithm after 
few .stages s (say .f 5), without waiting for convergence of 
upper and lower hounds When solving the first problem of 
(14), i.c finding ^7 mT- can he derived by a 

priori information provided by the set A', When .solving the 
second problem, i.c. computation of z^ in (14), we can sci 
(recall (36)) x7 * It^ i'l- where V', is the lower bound of z'l' 
obtained by the preceding run of the algorithm slopped at 
stage s. In solving the third problem (compulation of z7). we 
can set x^ =- In If, if is the upper bound of provided by 
the preceding run of the algorithm stopped at stage and so 
on. This pnxedurc is iterated until it is able to tighten the 
Ixmnds x7 or x,*^ Suaessivcly. the limitation on the nuiniKT 
of stages is removed and each extremum problem is solved 
by letting the algorithm reach convergence 

Such a shrinking procedure has been used in working out 
the numerical examples reported in the next section, and 
proved to Ik very effective, leading to considerable 
computing lime reductions 

5. Numerical examples 

Example I Parameter estimation of a multiexponential 
model 

The following model is considered 

y(i)-M,f (51) 

'Die data used arc reported in l abic 1. They have been 
generated from (51) with the following nominal parameter 
values 


Step 6 Generate problem ^ ’. 


V, -^ 0.4. HO, Vj-O I. (52) 


Tabi>. 2. Uncertainty inH'Rvai s and c entral imimati.s k)R i xampm 1 



M, 



V;j 

UIs 

|l7,2,2#i.91 

|0.30.0 49) 

[-16.1,-5.41 

10,077.0.136) 

Central estimates 

22.05 

0,395 

-10.75 

0 1065 
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Tabu- 3. Data htr exampi h 2 


k } 2 3 4 5 6 7 8 M 10 I! 12 

n 0.19 -0.72 -0.82 -0.22 0.88 0.80 -0.20 -0.88 0 31 0.32 -0.33 -0.63 


TABIJP. 4. UnC.’ERTAINTY INTItRVALS ANr> (T-NTHAL PRI IJirTK INS FOR FXAMPLI: 2 



.Vn 

.V-M 

Yis 

> 0 . 

Uls 

(-0.53,0.56) 

I--0.33, 1.21] 

(-0.875, 1 19] 

[ - I 75,0.87) 

Central prediciion 

O.OI 

0 44 

0 16 

-0 44 

Nominal prediclicm 

0.04 

0 45 

0 11 

-0.28 


The hounds on measurement errors arc supposed lo Iwc; 

|f(rj|3i 0.05 |y(/J|> 0.1. (.S3) 

A priori information set K is defined hy the following 
inequalities 



60.0 

0 .0 V, 

1.0 

-.30.0 5. p, 

-1.0 

0.0 < V , 5m 

0.5 


31ic estimation results obtained are reported in Table 2. 
They refer to convergence within 2% of upper and hiwcr 
bounds of the signomial algorithm for each extremization 
problem (14) 

1lie total computing time of the algorithm, using the 
shrinking procedure outlined in Remark 3 of Section 4, is 
about 10 minutes on a VAXH8(K) computer. Convergence 
within the mentioned tolerance, without using the .shrinking 
priMTcdure, has not been reached after a computing time of 
about one order of magnitude larger. 


Example 2. Mullistep prediction with an AH model. 

Tlic following AR(2) mcxlel is considered 

,v*“Aiy* i + AiV* i + y* (.ss) 

llic data used, which arc reported in Table 3, have been 
generated from (55) with the nominal parameter values 

« 0.3, dj = —0.69 (56) 

assuming e^ uniformly distributed and such that 


|rjs(),5, (57) 

Multisiep predictions from 1 to 4 steps ahead have been 
computed by considering as a prion information the set K 
defined by the following inequalities 


0. 0.4 

-O.H '^i^,?- -0,51 


m 


llic uncertainty intervals in (58) have been obtained hy a 
preliminary analysis of maximal and minimal feasible 
parameters of the linear model (55) by means of linear 
programming. 

The results obtained arc rcptirlcd in Table 4. llicy refer lo 
convergence within 2% of upper and lower bounds of the 
signomial algorithm for each extremization problem (14). 
ITie last line of Table 4 reports the predictions (called 
nominal predictions) obtained hy the minimum mean square 
predictor of (55) with the nominal parameter valuCvS (.56). 

The total computing time for obtaining these results is 
approximately 3 minutes on a VAX88()0 computer. 


6. Conclusions 

A method has been proposed for parameter estimation 
and prediction in a set membership uncertainty context, 
when dynamic models are nonlinear in the variables to be 
estimated. A procedure has been presented which allows one 
to compute exact uncertainty intervals of the estimated 
variables for the ease when measurements depend polyno- 
mially on model parameters. Some examples have Ix'cn 
worked out to show applications of the proposed 
algorithm. 

Arkmovffdgemrncf—This work was partially supported by 
funds of Ministero della University c della Ricerca Scicntifica 
c Tecnologica and Camera di Commcrcio di Ibrino. 
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Ab«tr»ct—This paper poinis oui ihc mathematical inconsis 
tencics traced in the litcniturc on the idcniihcaiion prtihicm 
of linear timc-invarianl distributed parameter systems via 
orthogonal functions, and proposes lor the same problem a 
unified identification approach based on the concept of one 
shot operational matrix for repeated integration It presenis 
identihability requirements for the blivck (mlsc functions 
approach while suggesting a linear indcjHrndencc test for the 
full column rank of linear algebraic system arising out of the 
system miHlcI up<m the application of orthogonal functions 
Finally, it illustrates system identilicaiion with a numerical 
example 

1 Introduction 

I'kI: aim of this paper is lo develop a general and unified 
idcntificaiion approach using orthogonal lunctions (Of ) lor 
the estimation of parameter'', inilial conditions (l( s) and 
boundary conditions (BCs) til linear time invariant single 
input single-output continuous lime dislribulcd parameter 
systems fDPS) modelled by 

c3*v(i, 0 L?‘v(,v./) 3v(x,i) 

a„ ^ u,, ^ u, 

L?r jt Ji 


from Its input output records available over Ihc reguui 
X 6 [x„, aj. f f tf\. Although stiriic .iHcmpts have alreadv 
been made on this problem in Ihc pasi, ihcy si em to have 
the following malhcmalical inconsislencies. 

As It appears, Paraskcvoptnilos and Hnunas tld7H) were 
the first authors to investigate this problem via Walsh 
functions (W'F) l o estimate ihe parameters with the U s. 

^ Cb (a. f) I 

fix) - v(a, ij, g(A ) I 

'■/I I, ^ 

and the HC's 

^''>'(a\ I] i 

</(n - r). r(l) 

Jx !, 

they integrated (1) twice with respect lo i and twice with 
respect to t to obtain an integral equation, approximated all 
the functions in a and/or f in finite W'alsh scries, and arrived 
al the following matrix algebraic equation (rom the integral 
equation by employing the integral operational prof>criy of 
WF 
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a„{h l) ) 1 t Yt , 4 ,j.(A I) >7:, 

ri I 

+ <1.f; Yt: + .)(/•:.' ■ «„( A,; )■' V I A,,, 

« S.-ll 

I y I 

X ‘/.A, ,,/:;' (f'.'i'V /I, A,,, ,f, 



iL “.A,,, ,/■, /■; V ,, A, 

.. f-it 

-- ( f; )*'/;/.; 

with h(i)= u„g(0 ♦ M(») ' cH(a, and ir(r) ‘ 

u,q(/) 4 4 w,, J'^ <y( T) dr llien they rewroU* the 

above algebraic equation m the lorm ol Afp - v and 

aliemptcd to estimaie (he augmeiilcd pariimeicr vector p 
from the least square technique l e p lAf*Af| ‘|Af‘i'), 
Here it is inqHirtani to note that Ihe columns of M 

corresponding tf> h, ami a,,w, terms (shown with h broken 
underline m the matrix algebraic equation) are apparently 
linearly dependent Due lo this linear depi*iu1cncc of 

columns of M, an inverse ol |Af'A/| docs not exist making 
(he ideniilication im^HisMble lienee, it may be concluded 
that the algorithm descrilK-d aNnc is not always suitable lor 
the ideniicalion ol (1). Jha and /amun (I9H5) used ihe same 
algorithm for identification using l.aguerre polyiiomiitls 
(FaP) Recently. Horrig ci ul. tl9Kh) investigated the 

idenlificaiion problem o) liisiorder DPS via shilted 
(hebyshev fxdynomiitls ol the lirst kind ((PI) Most 
recently, Mohan and f)alla (I9KH.I9K9J luive explored Ihe 
potentialities of shilled Ixgendre |>olynomials (LeP) and 
sine-cosine lunctions (S(T) in DPS ideniification 

Having seen the slate of affairs, it ap|Knirs to the authors 
that the problem of gcneial second-order DPS idenlilicalion 
has not yet been studied via block pulse lunctions (HPF). 
( PI and (’hebyshev ('Kilynoimals of the second kind (('P2). 
IV- concept of the one shot operational matrix for repeated 
integration (OSOMRI) (Dnbehauen and Kao, I9HT) has 
recently been cxicnded to shifted IxP and S( F and used, 
owing to Its siq>eriorily, (oi the identification ol Dl^. by 
Mohan and Dalla fl9KH, 19K9) OSOMHIs of ( PI and C*P2 
arc not yet reported. A comparative study ol all OF 
approaches In assess Ihc relaiivc merils and dements of each 
approach in Dl^ identification is also mil yet reported in the 
literature 

In this paper, by taking all the aforementioned |>oint.s into 
con.sidcration, an investigation is therefore made on Ihe 
identification problem of DPS to eliminate the lacunae ol 
existing methods and lo ininKhict a more general unified 
identification approach based on the concept of OSOMRI. 
Tins paper, presenting some important results of (hi.s 
investigation, is orgariir^cd as follows In Sc'clion 2 some 
mathematical preliminaries including O.SOMRI of CPI and 
CP2 arc prevented In Setnion 3 we present a unified 
identification approach for any class (elliptic, paralwlit or 
hyperbolic) of DPS Section 4 discusses the Kicniifiabiliiy 
requirements, which arc followed by a demonstration of the 
proposed identification scheme and a comparative study of 
all OF approaches by an iilustralivc example 
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2. Mathematicai prfUmmaries 

All the finite range orthogonal polynomialA Kuch as (PI, 
CP2 and IxrP are orthogrinal over z e [ 1, 11. The shifted 

polynomials, orthogonal over f € tf\, may he obtained hy 
setting 


z ^ 2(f tj/itf - ~ I (2) 

It is well known that a two variable function fix, t) 
Kijuarc intcgrable m the region ji c [Xf,, xA, t f \t^^, t^\ can be 
approximately expanded in a series of (Jh as 

m ] n \ 

fu. n - X X (3) 

i-ti / - () 

where s|;(a) is an m'dimcnsional C)F(hasis) vector m x, ^(/) 
is an n-dimcnsional basis vector in t and h is an m y n 
matrix, commonly known as a spectrum of fix, f), whose 
elcincnls arc given hy 

fif f 1^.' [ [ w,(jr)w,(r)/(«. im>Sx)<t>,it) ii4 d/ (4) 

ft) Oi, 

in which k',(jc) and arc the weight functions of 

orthogonal system and c, and i > arc the constants Weight 
functions ) and consliinlH r arc different for different 
orthogonal systems |sce for instance Unbehauen and Rao 
(19H7) for HPF and (’F*2; Horng rt al (l‘^Kfi) for CPI ; Mohan 
and Datlu (IVHH and 1^8^) for l eP and S('F; and Jha and 
Zaman (I9H.S) for LaP| 

Since for CPI, w,(x) and w,(t) are singular al the end 
points, one may have to use open quadrature formulae, e g 
the Gauss- C'hcbyshev lirsi kind open quadrature formula for 
the compulation ol I'his requires explicit knowledge of 
fix, i). In the actual situalifin, fix, t) is known either 
continuously or at some discrete pwiinls (preferably 
cquispaccd) in (he region ol measurements. When the signal 
fix, I) is purely dclerminisiie and is available only al some 
points, computation of /,, is still possible hy interpolating 
fix, t) at the zeros of C PI used in the numerical integration 
Flowcvcr, when fix, t) is corrupted with noi.se computation 
of is not possible as mterpolalmg noisy signal is 
meaningless. 

Using the concept of (TSOMRI wc have 


llfl 


fix, r) ih‘ dr’ ^ (.S) 


where and aic m x m and n x n OSOMRIs of 
and ^(r) rcsj>celively. f , and F,, are the well 

known inlegnition opi^ralionul matnees of the same 
dimension (Unbehauen and Rao, 1987) I'he derivation of 
OSOMRIs of BPF, LeP and S(‘F is given m Unbehauen and 
Rhu (1987) and Mohan and Datla (1988 and 1989) For 
Lap, OSOMRI is the same as the conventional repeated 
integration operational matrix 
OSOMHI of shifhui (PI ami ('P2 Merc wc present the 
expressions for generating the elements of OSOMRI ol ( P2 
Shifted CP2 have the following recurrence relations 

2(( + 2)<),t/)- |-^i(O0l"(()/2+0!'.’,(O|(/, (6) 

0,(()0,(r) - 0, ,(f) f 0, , i»l (7) 

and 

0,(7,,) - ( IV(/ + I) (8) 

Integrating (h) twice with respect to r gives 


and 



0,(t) dr* 


= (t, - /,y(-20„fr)/3 - .S0,,r)/12 + 0,(0/241/4 


Similarly, following in the same lines, it is quite possible to 
arrive at the similar set of expressions for CPI also 


3. Unified identification approach 

Depending upon the values of parameters a„, a^^, a^,, the 
system (1) may become elliptic, parab<ilic or hyperbolic We 
first obtain an integral equation by integrating equation (1) 
twice with respect to t and twice with respect to /; 
approximate all known and unknown functions in x and/or t 
in a finite set of OF and introduce the .same m inlcgraJ 
equation; make u.sc of equation (5); and simplify to obtain 

(9) 

where 

Q = |vcc (f.'.V', I vec (VE,,) I vcf (£.'yt,) | vcc (K.'.yi,) 

I vcc (£] y£',j) 1 vcc I - vet (f.'.Aii) i ■ ■ ■ 

I - vec(£:,'.A„|) I - vec(A,,f;, 2 , | ■ I - vet(A,^,£,,, 


I - vet A||£‘,, I - vcc (£'';,A,| £,) | • • • | 

- vcc(£;jA,,£,) 

I - vcc(£.'A,,£,.) I ■ • I -vcc(£.'A, „£■,,)) ■ , 1 ( 1 ) 

*=- u.., a„. a,, a,, o,, ,, 

• ^ 1 * I . * • ^l|. - ■ ■ I • -'ll- ■ I I (II) 

V - vec (.(7/v,.) (12) 

- U„>'(i„, /„), / - a„l,. q, - a„q, (13) 

hix ) - a,, d/(.i )/dj -l- a,f{x ) (14) 

.v(/) ^ a,,r(r) f fi,, dr/(t)/clt 4 a^qil) (15) 


o - m, n, m, d *- n, A,, is an m x n mairix having 
(i, y)th element unity and all other elements zero, and vec(') 
i.s the vector valued function of matrix (') Since there are mn 
equations and (7 4 a 4 t y 4 (^) unknowns in equation (9). 
the rank of Q must he equal to the number of unknowns to 
determine If from 

»-K->'C>l 'IC'»I (if>) 

Otherwi.se identification is not (^M)ssihlc Once 8 is obtained, 
the initial and Ixiundary conditions fix) and qit) can also be 
obtained from the equation (13) For finding the other 
ICg(x). wc obtain an integral equation by integrating 
equation (14) once with respect to x. approximate all the 
functions in x in tiniie set of OF and introduce the same in 
the integral equation, make use of integration operational 
property of OF and simplify This results in 

j?(t)^-0'(«H|l'- Ml + u.-If-.') 'I'e, -■ (17) 

with 

c, “ 11,0. . . . , n)’ - an m-vccior. (18) 

In the same manner the other BC r(/) m equation (15) may 
also he obtained from 

r(»)^ (|i' - a,q'l + a„[re,' - q'|f, '0(')/fl,. (19) 



0,(0 dr’ 


+ A, 4> _ 

4i(i 4 1) 


(ty - t,,)' j(~;l)'(i 4 1) 

4 I 1(14 2) 

2j(i a2) 4(1 4 DO 4 2) 


0„(o+2S:,‘i,^i<') 

1 for i ~ 2, 3. 4, . . 


where (7) and (8) arc used for simplihcation For i = 0 and 1 
wc have 



0u(T)dT’ 


- 0^ - /„)1O.f)250.,(O ^ 0 .S0,(r) 4 0.1250,(1)1/4 


with 

e, 11,0.0]' - an n vector (20) 

’Mtus the present algorithm is capable of estimating 
parameters as well as ICs and BC's of the system (1) This 
approach may be applied via WF and all classes of 
orthogonal polynomials. Since WF have to be chosen on the 
basis of 2*^ where A is a positive integer, identification via 
WF normally becomes computationally laborious In order to 
apply this algorithm via BPF and SCF certain terms in it 
must be redefined in the manner as discussed in the following 
two subsections. 
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Tabu: 1 CoNOiTutNS isnuur w«at BRF ArPHiiAOi works 


Condiiion 

c 

f{M) 

«(a) 

AU) 

V(0 

^(0 

sit) 

I 

P 

a 

a 

a 

a 

a 

a 

2 

a 

P 

a 

P 

a 

a 

a 

3 

a 

a 

P 

P 

a 

a 

a 

4 

a 

ii 

a 

a 

P 

a 

P 

5 

a 

a 

a 

a 

a 

P 

P 


a ^ ah!icnl; p ^ prc&cnl 


3 1 Identxfiaitum \na HFF In this approach «ym 
and P n always For i 1, 2. . m malru A,, musi 

be replaced by A,, which is an m x n mairix coniamini;; all ah 
row elemenls unity and all other elements zero Similarly, lor 
/ - 0, 1. , rt. matrix Aj, must lx* replaced by A^ which is 

also an m x n matrix but having all yth column elements 
unity and all other elements /erii In the column 
corresponding to c term in equation (II) matrix A,, must bo 
replaced by A,, which is again an m x n matrix but 
containing all elements unity V^'cetors c, and e, in equations 
(IK) and (20) must he considered as ~ 11, 1. , , 1|' and 

e, - [I, 1. . . 1|^ with the same dimensions 

To determine 6 from equation (16). the rank of Q must be 
equal to 7 -K 2(m + n) This clearly shows that the si/c ot 0 is 
very much dependent on m and n which need not be so 
always in other OF’ approaches as the si/c of 0 is decided by 
a, fi, y and <V This |>oiiit may lx- considered as the drawback 
of BFF approach. 

3 2 ItivnuficaiKm viu SCI It is well known that the 
Fourier series expansion ol any square intcgrablc lunclion 
contains 2n I terms (n cosine terms i (n I) sine terms) 
for a chosen n Hence, the dimensions ol all vectors and 
matrices in Section 3 must be accordingly taken care of 
Owing to this over dimension, the rank of Q in this approach 
mu**! be equal to .Vf 2(a + /l4 V't assuming that 

n ^ fC- Y Moreover, this over dimension also 

makes idcnliliculion computationally laborious compared to 
other OF approaches 

4 Practical limitations of unifit'd identification approach 

It was stated in the preceding section that must have its 
full column rank I'his condition sometiines lails as the 
columns of Q turn out to lx linearly dependent under certain 
circumstances Fo investigate this important aspect we¬ 
re write equation (^0 as 

M|W| (21) 

where A contains all the columns corresfKinding to system 
parameters and H contains all the remaining columns of (7 

Now the rank of Q is always less than its number of 
columns if there exist at least two linearly dependent 
columns of A or B. Since the linearly dependent columns ol 
A may only occur due to Y. it must be tested essentially with 
respect to the output signal y (.i , r) No general conclu.sions 
can be made in this context. 1 o study the linearly dependent 
columns of fl, the complete structure of B must tx known 
first. This depends on operational matrices F,. E,. and 
E ,2 and the values of a, ft. y and rV Since B is totally 
independent of input and output signals, for the chosen 


orthogonal s>T*icin and a, ft. y hikI d values, H must be 
icsied separately before pfccmling to the idcntihcation. 
LKicnsive coinputatHxial expcnincniation has revealed that 
there arc many possible amtbinatnrnii ot a m, ft n, 
Y’^ m and 6 n (or wbich B and thereby turn out to have 
less than ihcu luii a>lumn ranks, making the uleniilication » 
failure Therefore, ideniificalion via WF, any claims of 
orthogonal polynomials or St'F must be pixrccdcd by a linear 
indepernknee- test on H 

Owing to the fact that n y m and ft ^ d *■ n, it ik quite 
possible to say something alMiui the linearly dependent 
ailumns ol H in BPF approach ( undue ting the lest on 
out of all jxissihlr aurihmations of a, ft, y and A. five 
combinations only turn out to tv tavoriihle for ideniilkuiion 
(see Table 1) 

Condition I is quite obvious ns B ci^ntiuns only one 
c'olumn Conditions 2 1'' can be proved in simple 
malhcmatical terms Operuttoiud matrices, f,. E,. ^ and 

Ef 2 arc always non.singular Consequently, the ctilumns 
airrespondmg to /(i) fi(i) q{i) oi >(/) in equation (11) arc 
always linearly indefvndcni. proving the conditions 3 and 
Conditions 2 and 4 may be proved by lormulating the 
columns of /? and using ihe Ciauss reduction method with 
column operations in each case 

It IS well known that liaar fuiuiioiis and WF can lx* 
expressed as linear combirujiions o( HI*F niercfoie, 
identifKaiion via Haar functions or WF is not ^sossibk when 
the following iwo conditions are simultanrously met: (i) The 
numbcf of basis functions is exacilv the same as that of BTF 
while meeting the rcquiicmeni of 2* where k is some |xisiiive 
constnnt, and (ii) C'ondilions shown m (able I are not met 

-V Bills trail VC example 

SuppHise it IS required to esiimale the parameters as well as 
1C' and H( oi the system (hyperbolic) modelled by equation 
(1) with - a,, I) when the inpiii m(i. t) (u)' (ir f 
l)(ji 4 r) and the oulpul v( i. r) are available over the region 
i,/r|f), 16] 

By employing the unified identilicaiion approach with 
m n 3 and y S - I. all Ihe parameters mul 1C' and FFC' 
are estimated via all the classes ol OF I he estimated results 
arc as shown in Fable 2 It may be observed that the 
estimates are very much impioved when the value ol rri and n 
IS increased from 3 to 12 in S('F approach, see the second 
set 

6 ( oncluMiffw 

A unified approach for the idenlilicaiinn ol DTS via any 
class ol OF IS pre.scnted with its praclical limitations 
Disiegardmg the computational ellort, all the clasHcs of 
orthogonal txiJvnomials seem to be powcrlul m DBS 
identification Owing to the larger dimension and (xiorcr 
convergence of Foiinei series of nonsmusoidat signals, SC'F 
approach is %<‘en to be cornpulationally lalHirious. On the 
whole, the computational requirements in DPS identification 
via any class of OF are highly demanding 
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Tablk 2. E.stimatks oi- i»ARAMr: rr:k.s K' and BC 


Approach 

^.i 



a 

v(i,0) 

>•(0,0 

Actual 

BPF 

-0 5 

O.A 

0,5 1 

failed due lo the presence of IC and B( 

1 

1 

CPI 

-O..SO()(M)3 

0.4999987 

0.49999H7 

1 (»00007'i 

1 

1 

CP2 

-().50f)0039 

(I.499W 

0.499999 

1 .(KJ0O0H9 

I 

1 

LeP 

~0.49<m9 

0.5(KKHK)2 

0 MXKMXC 

0,99^>997H 

l.0(K)0(K12 

I .(KMMKKr2 

UP 

-0,4994676 

0,4993234 

0.4993234 

I.000663 

0.9<I82402 

0.9982402 

SCF 

-().!><)()689 

0 49HOM9 


1.0046791 

1,135037 

1 135037 

-(1.5(^04474 

0.4999774 

0 499<n74 

1,00062.^1 

1.027W39 

1.0279839 
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Ahftract—lilts paper deals with the identification of linear 
constant dynamical systems when formalized a.s u rational 
approximation problem. The criterion is the /' norm of the 
transfer function, which is of interest in a sKKhaslic context. 
The problem can be expressed as nonlinear optimizution in a 
Hilbert space, but standard algorithms arc usually not well 
adapted. We present a generic recursive priH.'edure to find a 
local optimum of the criterion in the case of SL:alar systcm.s. 
Our methods arc borrowed from diflcrcntial theory mixed 
with a bit of classical complex analysis. To our knowledge, 
the algorithm described in this paper is the first that cnsurc.s 
convergence to a local minimum. 

1. Introduction 

In this paper, we approach the problem of identification 
within the framework of Hardy spaces by considering this as 
a rational approximation problem. We re.slnct ourselves to 
lincai con.stanl strictly causal single-input singic-outpul 
dynamical systems (in .short, systems). We first consider the 
case of a discrete lime .system Let /»./:, ./^. . . . be its 

impulse respon.se. Identifying the sy.stcm usually means 
recognizing the sequence (/^) as the Taylor cxH:fbcients at 
infinity of a proper rational function whose denominator 
degree (in irreducible form) is then the order of the system. 
But since such a sequence might not exist, in practice one ha.s 
to be content with finding a rational sequence (r^) that 
resembles (/^). This, of course, ha.s no definilc meaning, and 
some criteria has to be chosen. Such criteria can iKcur in 
connection with stability. Assume, for instance, that the 
system in /^-stable for some k ^ 1. that is 

i 

m 1 

One can then look for some (r^) which is close to (/^) in the 
/* sense. Since increasing the order of (r^) arbitrarily is 
unacceptable, it is also reasonable to bound it from above by 
some number n. Note that the identified model (r^) will then 
automatically be stable. 

Our assumptions have as an cfTeci that the transfer 
function 

/u)= i Lz 
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paper was recommended for publication in revised form by 
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as well as the mlional funmon 

are holomorphic for | 7 | > 1, and one can ask in which sense 
they arc dose lo each other from an analytic viewpoint In 
general, there is no completely salisfaciory answer A partial 
result in this direction involves the fto-c'alled real Hardy 
spaces H where thai we n<w define If h is 

analyiic mr \z\ • I and p • I is a real number, define a 
function 6,, on the unii circle 7 by putting 6^,(r'^) 6(pr'*'). 
By definition. will txmsisi o( those h vanishing ai inhmty, 
assuming real values for real argument.s and such that 

^up ||6,,1|,, 

M “ I 

where |i ||,, is the norm in /.*"( / ) li is then standard to show 
(Fuhrmann, 1981), lhai h has u radial limn h* almost 
everywhere on 7” which lies in whose Fourier 

coeSicienis arc real and those of non-ncgaiivc rank do 
vanish Moreover, we have 11^*11,, * »up^, 
Conversely, any member of 1/'{T) with Founcr coefficients 
as above is ihc radial limit of M>mc unique clement of 
One can then identify h and 6* and consider || ||^ as a norm 
un //^, that defines ii as a Banach space. 

Now, if k' is the conjugate of k (1/k i \jk' 1), the 
HausdorfT" Young theorem (Ouren, 1970) gives 

when 12. H/H. ^i( i , (I) 

SO that /belongs lo li^ whenever {f^) t>clongft lo /*, and that 
lo be close in the .sense for impulse responses implies to be 
close in the //^ sense for transfer functions; and 

whcn2r.*i.», ( X I/-.!*) (2) 

»*1 I 

M) that lo be close in the //« sense for transfer funclinns 
implie.s to be close in the /« .sense for impulse responses 
Of course, there may be other reasons for being interested 
in rational approximation, even if 2< k\ The norm, for 
instance, is the operator norm Ncvcnhclcss, rational 

approximation in is demonstrably relevant to idenlifica- 
lion of impulse responses only if \ ^ k'-^^ 2. 

Clearly from Ihc above, the case where k^k'^^2 is 
particnilarly nice. ITie conjunction of (1) and (2) is just 
Parseval'.s equality: 

ll/llr (i l/.r)' 

fc -1 ' 

and Hi is a Hilbert space with scalar prcNluct 
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I>llCI I 2t|A.I 


which in turn can he converted iniu a line integral 


Let us define the (unction ^ holomorfdiic in 1/ by putting 





In the rent of thi^ paper, we shall rcKtrici ourselves to rational 
approximation in Hj which we phrase a.s follows: 

For / «• A/ 2 . minimi/c ||/ - r\\j where r ranges over all 
rational functions in H^ of order at most n. 


Note (hat a rational fraction r ^- p(q belongs to if and 
only if dcg(p)' dcg(i/) and the roots of q lie inside the unit 
disk f/ 

I’hcrc is a probabilistic interpretation ol this criterion in 
identification; If f is the transfer function of a stable system 
driven by u white noise /i, the output y - is a stationary 
process. If the latter is to be modelled by a rational function 
piq of order at most n, and if we pul y - p/q^, the 
minimization of the covariance of y -■ y is achieved when 
11/ P Iff Wi minimal 

In this paper, we present an algorithm to find heal best 
approximants of a given order n, which procced.s recursively 
by numerically solving diffciential equations over a rompacf 
suhRCt ol H” This procedure is the first one, to our 
knowledge, for which convergence i.s guaranteed, at least 
generically We then present a convincing experiment, and 
we finally list some open questions Most prcMif.s arc just 
.sketched, since our main concern here is not technical hut 
rather to describe the procedure 

Lxt us first list a few known results concerning this 
question It cun he proved |sce e g Haratchart (1986), 
RiJckebuM’h (1978) or Walsh (l%2)| that the problem staled 
above has a solution This solution is not always unique, hut 
generically it is (Huraichart, 1987), though there might be 
lots of local minima. One can show that if /is not a rational 
function of order less than ri, a case which will be implicitly 
ruled oul in whal follows, no local mmmumi can be of order 
less than n (Ruckchuscli, 1978) In other words, one should 
always take advantage of all parameters at hand 

lliis observation lead.s to the conclusion that it is enough 
to minimi/c the norm over the set of irreducible fractions of 
//> of order exactly m. Since this set is a manifold, it is 
possible to use clussical IihiIs from optimization, like steepest 
descent algorithms. However, due to the shape of the 
gradient vector field and to the non-compactness of the 
domain over which we optinu/c. these methods may fail to 
converge In this paper, wr develop a different approach, 
which is based on the elimination of some parameters and 
gives rise In a much nicer geometric picture. 


2 The fundion 

Let P„ be tlie set of real polynomials of degree at most n. 
and the subset of monic (Kilynomials of degree n whose 
roots are in the disk U, of radius r. 

We liHik for 


min f 
ru q 


(3) 


where p fc , and q e C onsider the n-dimensional 
linear subspace of //. delincd by V'^ ~ Jq. For fixed q, 
the minimum in (3) is obtained when pfq is the orthogonal 
projection n AJ) of / onto V;,. If we define a polynomial 
/.„(</)€ P^ 1 by the formula L„{q) - we arc thus led 

to minimize the function 


dcfined by ( 1 /) - If 


IA<I) 


Hie polynomial L^{q) must satisfy by definition 
V,M). n-l. 

\ q q! 

that IS to say 

for any complex polynomial u of degree at most n-l. 


g(z) -/(l/z)/z (4) 


Define further q ^ P^ as z^qil/z). The rrjots, possibly at 
infinity, of q are th e in verses of those of q. Similarly, we shall 
also denote by LJq) the polynomial z” ‘/.^(</)( I/z) With 
these notations, our integral equation becomes 


1 

iiJt 



q / q 


whenever uj^ complex polynomial of degree at most n-l. 
Since g ~ L„{q)/q belongs to the Hardy space H.iU) of the 
unit disk U (Duren, 1970), the residue theorem ^^plics 
giving that the above i-s .satisfied if and only if g - L„{q)lq 
matches zero at each riKit of y^^counling m^pliciiics, 
namely q should divide gq - L„{q) Thus, L„iq) is the 
unique polynomial of degree at most n ~ 1 interpolating gq 
at the zeroes of q, that is to say: 

Proposition 1. The polynomial L^iq) is the remainder of the 
division of gq by q. 


A well-known integral representation for our remainder 
(Walsh, 1%2) is 




2ijrJ, q{^) ^-z 


(5) 


where I' is any contour contained in the domain of 
holomorphy of g that encompasses the zeroes of q As usual, 
the independence of the integral from the conlour follows 
from C auchy theorem 


3 , Extension of the domain of snuKuhness 

A monic polynomial of degree n, q(z) z" 4 , 2 " * 4 

■ 4 £j,i can be identified with the vector 

(a„ I, 2 .allows for .¥^1 to be 

considered a.s an open subset of R" 

So far, has been defined only on 1 ^', Now, if we 
assume that /is holomorphic not only for |z| ' 1 hut also in a 
ncighborhiMHl of the unit circle T, we shall be able to extend 
to a smooth function defined on a ncighlxirhood of the 
closure, in R”, of I'his closure will be denoted by A„, 
and clearly consists of all real monic polynomials of degree n 
whose riKils are in the closed unit disk li Our hypolhc.sis on 
/, which will be assumed hereafter, is equivalent to requiring 
that g be analytic in the disk (/, of radius r lor some r * I that 
will remain fixed in the sequel. 

Proposition 2. The map extends to a smooth function 

Proof, If q t the properties of the orthogonal projection 
show that 





-(/./)- 



(h) 


Since the contour F may be deformed within the domain of 



Fig. 1. The set A. of points (fl,.a„)eR‘ such that the 
polyiKimial z‘4-fl,z 4 o,, has all its rotils in the closed unit 
disk 
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FUr. 2. A representation of and its houndary 

aA, = (z + 1)A,U(; - l)Aj U +lir + 1)A,. 

» If ( I . I ) 


holomorphy of ji; sc3 as to surround any n-iiiplc of jHiinls in 
U^, the inic|;ral representation (,S) obviously yields a smtwth 
extension of /.„ to a map f*„ , Note that L„{q) is still 
the remainder of the division 

f^q I'f^ ^ LJq) (7) 

Having this at our disposal, i( is now suHicicni by (6) to 
extend smtxithly for every k, q {/, Iq) to fins can 
be done similarly by pulling 



which again allows for q to lie in 0 F.l) 

Wc now turn to A„. 11 is plain u> sec lhai A,, consists S4ilcly 
of the point 0, and A, of the segment |- I J| II is easy lo 
check that A^ is ihe triangle with vertices ( 2, 1), (2, I) and 
(0, -1) (see Fig. 1) ll is more difficult to sec what A^ kniks 
like (sec Fig, 2). In general, A„ is topologically a ball, as is 
proved in Baratchart and Olivi (I^KH), and wc .shall 
concentrate here on its boundary t3A„, which is homcomor- 
phic lo a sphere ITiis set consists of polynomials in A„ 
having at least one root of modulus 1, Among such 
polynomials, one can distinguish between those having i 1 as 
a rcHit and those having no real rcK)t of modulus 1, but which 
arc divisible by some polynomial of the form 4 2xz 4 1 
with X6(“l,l). lliis means that is the union of 

(z “ l)A„ (z 4 1)A„ |, and (z '4 2 x 2 4 1)A„ > for 
X e (“ 1. 1) In other words, 3A„ is made from two copies of 
A„ I and infinitely many copies of A„ As is already 
apparent when n equals 2 or 3, the boundary (?A„ is not 
.smooth, namely there are corners The smwth part of c?A„ 
may be characterized as the set of polynomials in A^ having 
exactly one irreducible factor over R with rcHits of modulus 
one, Alternatively, they arc interior points of the copies of 
and A„ introduced above Tlie crux of the matter is 
the following lemma describing the behaviour of on 

Lemma 1 Let q € (3A„, and suppose q - q^q, where q^ is 
monic of degree k and has all its rrKits of rntnlulus 1 while q^ 
is interior lo A„ llicn 

Proof. From (6), it is sufficient to prove that l.„{q)- 
inverse and conjugate agree on 7, wc 
have - ±q,^ and the result fallows from (7). Q.E.D. 

Let us denote by the gradient vector of at the 

point q. Later we will use the following consequence of 
Lx^mma 1. 

Corollary. \jci q, as in the previous lemma, belong to the 
smooth part of 5A„, and be such that q, is a critical point of 


A„ I (note that k I or 2) Then r^ti/) is ortbogoiMil to c>A^ 
and points outwards 

Prtxif From lemma 1. we see that the piojcciwjn of V^(q) 
on 3A^ is just so that V„{q) is orthogonal lo t?A^ 

Moreover, it canwot point inwards Isecauju: this would imply 
that ^}fq^ w^ich is rational of order n ■■ k, is 

locally a best approximani to / among rational functions of 
order n. heiwf thi.t / itself is rational of order < « O F 0 

4 A generic algorithm to find a /(M at mmi/wum 

As said before, the minimum value of 4*,, on A^ can imly 
lie taken at some iiUennr point of A„ since / is not ralitmal of 
order less than pi by hypothesis Av a amsequena', such a 
point q must be a mtical point of and has to satisfy 

Wc shall make two extra a,sMimptionN in what follows First, 
we shall assume that does not vanish on ^A*. for 
1 A PI Second, k given as above, wc shall ask all iritical 
points of in lo Ik nondcgencruic, ce. to have a secxrnd 
dcrivalive that is a nondegenerate quudralic form These two 
properties hold genencally, that is for alnuisl every / in some 
sense, and wc refer the reader to Banilchart and Olivi (IMKH) 
lor Q precise stalcment They ensure in particular that critical 
points in are finite m number 
Taking this for grunted, wc are now able to describe a 
procedure to dciermine a local minimum of 'F^ We first 
define one more bit of notation i( ^ f A* tor some A s n, we 
define 'F(r/) to be simply 'FaIi/) ITiin new notation enables 
us lo compare q i: A^ and q' i . hut wi shall siill use 
when referring lo ihc iKhaviour on A* only 

The algoriihm proceeds as follows ('Ikhisc vomc interior 
point of A„ as an inilial condition, and integrate Ihe vector 
field I'here are iwo possibilities; Fither we teach a 

critical point or we reach JA„ In the former case, if the 
critical poini is a local minimum, we iire done. (.)lherwi.se, 
since It IS nondegenerate, the enlical fH>ini will be unstable 
under small fieriurhalions, (liciCby allowing us lo continue 
the priKcdure Since 'F„ decreases, wc cannot meet the same 
critical point twice, and because such |>oinis are finite in 
numbe^r, we eventually .succeed or wc reach ^A^ 

If we meet </^ c 3A„ (sec Fig 3). wc decomptific it as q,^q, 
where q,^ has all its riHils of iiuhIuIu.s 1 und q^ has none From 
LvCmma 1. we sec lhat 'Ffc/,) Moreover, the degree k 

of 1 ^^ IS nonrero, for M/, is a consiani funciion whose value 
ll/ ll; IS the maximum of on A„ 

Now, q, lies in the interior of A^. so we can begin all over 
again with n replaced by k and (/„ by q^ Since k decrcascH 
bui remains strictly positive, wc are fpouiid lo reach u U»cal 
minimum of 'F^ for some m salislying I ’m^n, ui some 
interior point q^ ol A^ 

C onsider now Ihe point q^ - q„^[z 4 1) of c^A,„,, It lies in 
a smcKUh region ol Ihc boundary, so that ,,(</)) is 

orthogonal lo 3A^ ,,, and poinls inwards by ibc corollary lo 
Iximmu 1 ITicrclorc, integrating ,, starling from q^ 
(sec Fig. 1) leads us lo penclralc into Ihc interior of A^ < 
so that Ihc whole prrKcss can l>c carried over again, with pi 
replaced by m 4 I Since decreases cotUinijou.sly, wc never 
mccl twice the same critical |>oini of lor 1 k r; pi. and 
this ensures that the procedure eventually comes lo an end, 
An end means precisely that wc have reached the desired 
Itiail minimum of 



Fig. 3 Sketch of the algorithm for pi 2 and /(zj- 

- 42 ' 4 2 \ 
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S. The C(mtmufm% time caxe 
Sc) far, wc have only dealt with rational approximation in 
he Hardy »pacc of the di^k. a^ related to the identirkcaiion of 
iiNcrelC'time hVdbk transfer functions In practice 
owever, continuous-time systerns mainly occur A treatment 
similar to that in Section I uiuld he given, hut we just 
idicatc briefly how the above technique applies. Ixt us call 
continuous-time system //^-stable if its impulse response is 
in x| "Phe Palcy Wiener theorem (see e g Dureii, 
970) asserts that the Laplace transform is an isometry 
>clwcen '* \ and the real Hardy space Jlty of right-half 
tlanc consisting of functions f holomorphic for lM(z) >(J, 
atisfying the rcaincss condition f (i) - Tiz), and .such that 

supj |f' (x -t ly j|*'dy - X. (K) 

Icrc, the squared norm ||A'||*ir, *he supremum in (H) by 
Jehnition. In other words, the set of transfer functions of 
/-stable systems is precisely /fV The rational approximation 
problem in this context consists in looking for 

min /' ■ ' 

‘i II 9llwj 

vhcrc piq ranges over all rational functions of order '..n in 
Note thal such fractions are exactly transfer functions of 
table systems of order at most n 
A possible interpretation of the // criterion is as follows 
«.ssume an L'’ system is driven by a white noise, so thai the 
ulput is a stationary stochastic process 

5(0-I /i(< t)dW(r) 

/here W is a Wiener process I he variance of which is 
dependent of t. is equal to \\h\\i (Doob, 195,1) If h„ is the 
Tipulse response of a system of order at most n. and p/q its 
unsfer function, and if we put 

s«(0 - I hjl T)dW(T). 

1C variance of i is |lh h„\\i, which is also equal to 
h' - p/q\\"^.,, where A- and p/q arc respectively the Laplace 
^anslorms of h and /i„ f herclorc, if we want a model of 
irder at most n for the process, we minimi/.c the covariance 
f the error by solving the above rational approximation 
foblcm 

Now, the c|ueslion comes back to the one investigated 



(i 4. The transfer function / (continuous line) and its best 
approximation of order 7 (dotted line). 


above Indeed, if we pul 

jjp . , _ * and Of F |f z ) = 2\/jt - - . 

2-1 2-1 

it turns out that O is an isometry between ^ 2 ' 

is plain to sec that O preserves rational functions and their 
order Therefore, putting / -Off) brings us back to the 
discrete-time ease 

h Numerical examples 

Until now, wc have assumed that the transfer function of 
the system under consideration exists and is perfectly known 
to us But in practice, of course, this is never so. The system 
certainly exists, hut the transfer function may not he defined. 
And even if it does, il is only known to us through a finite 
number of experiments, whereas the function / to be 
approximated in //, has to be completely defined if wc 
actually want to run the algorithm In fact, the definition of / 
from a set of experimental data is an arduous problem that 
wa.s entirely bypassed in the above development. 

For instance, if the transfer function F of a continuous¬ 
time system is computed through frequency resp(.insc 
experiments, wc are given its value at a certain number of 
points of the imaginary axis, .so that / is only known at a 
finite number of points on the unit circle. To estimate its 
Fourier coefficients, the best we can hope for, in general, is 
to have a convergent procedure to estimate ‘I>(F) when the 
number of experiments increases This is in the style of 
Baratchari (I9H9); however, wc shall not go into further 
details here. We shall instead present examples where this 
step has been earned out by ad hoc methods. 'I'he procedure 
has been implemcnicd on a computer, using a standard 
package for the numerical integration of ordinary dilTerential 
equalion.s. Wc chose the b d.f. method Lhe computation of 
the gradient is done from explicit division formulas, which 
wc do not derive here due to limited space, and can be 
carried out using the Luelidcan algorithm since g is a 
polynomial in practice. This also implies that exists and is 
smooth on R''. All along the integration, a control is made 
on the fKimls of the path to verify that they lie in A„ by 
computing the nnils of each corresponding polynomial. If we 
go outside we use dichotomy on the stcpsize, to 

determine accurately the crossing point on the boundary. 
This gives the initial condition of a lower order integration as 
descrified m Section 4 

Several sets of data have been treated, most of them 
obtained from experimental measurements of an aircraft’s 
high-frequency modes Figures 4 and .S show an example 



Fiti. 5 The transfer function / (continuou.s line) and its best 
approximation of order 10 (dolled line). 
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Fi(i 6, Integral curves of the vector lield V, for 
1/47 ' 4 ’ ' 


selected as being difficult to approximate, where / is 
descTihcd through an estimation of ns first 2IM) rouricr 
cocfficicnis. Since the maximum error occurs when UM- 1. 
we choose to represent the functions hy the 2-dimcnsional 
plots of their values around the unit disk I’hc function t 
(continuous line) and its best approximant (dotted ime) of 
order 7 arc plotted on Fig 4 The compuliilion time on a 
SUN station 4/110 was 13 minutes I'hc resuli is not 
completely satisfactory and one has to gf> up lo order 10 to 
gel a better approximation I'his lime the computation lime 
was 17 minutes Figure S shows the corresponding 
approximation 

7 ContiiL'iiorvi 

At this point, it is only fair lo say that the piocediirc 
described ab^ive docs nol Cjuile answer the original quesiion. 
since it only ensures that we rneci a itnal minimum, and not 
necessarily a one This dehcicncy is (ni/./,hng for there 

may l>c lots of IcKal minima Figure h shows already 3 local 
minima, when n is only equal to 2 and / is the simple riitional 
function of order 3 1/47 ‘ 4 7 ' 

Further invesligaiions on this problem may he envisaged 
from two different viewpoints On one hand. 11 is |>os.sihle to 
consider this difficulty as intrinsic and cope with it. trying lo 
find the global minimum at any eosi One may think ol 
initializing ihe algorithm al enough points of the compaei scl 
A„, to reach all local minima and compare between them 
But the precise meaning of the word enough ' depends, ol 
course, on /and n, and wc are nol able to give an u priori 
bound for it. Consequently, more efficient Mraiegies should 
be investigated For instance, wc can restnei ourselves in 
initial |Xiinls lying on provided n is large enough 

(Baralcharl rr a/ . l^^'X)) In examples we have met so lar. 
imtiating the algorithm from K>cal minima on JA^ is in lad 
enough to exhaust the set ol local minima in Since liKal 
minima on clA„ are solutions of the citrresponding pnddem 
in A„ , and A„ .. thanks lo lemma 1. ihis allows one to 
proceed recursively. Wc do nol know , however, whether this 
property holds in some generality 

On the other hand, the lad that there are several U>eal 
minima may cause discrepancy in identification For msiance. 
there arc situations (Ruckebush, U^7K) when two distinct 


rnimnaJ funciions of order n, say r, and n, arc boih 
approximanis to / 1lK>ugh iheaai* sifualions arc exccpUonal 
(Baraichart, the / * identification pn>hlem at order n 

IS not wtil-posed in the neighborhiXHl of such an /, furcausic 
Jiggling It slightly vicUls a best appioiimani wfiich rs eUsse 
r, or Tj allernatively Whcihci such a phenomenon is due to / 
or rather a consequence of inappropriate » value' for ri is not 
yet dear. Ihis siggests that the phyvical meaning of the 
difficulties explained above should be further analysed In 
particular, it would be of interest to derive ixindiiioin. imi / 
ensuring there are no hx'al minima except the global one, at 
least for n sufficiently large. A subduss of Stii ljes fundioiis. 
for instiince, has been shtmn rrecntly to have this property 
(Baratchan ei al . unpublished data), but a lot of work 
remains to be done in ihis direction 

A related problem is Ihe Ischaviour ol as n ♦ * For 
instance, it is pos.vihle lo prove* (Baralcharl d al , 1^>M0) that 
all CTiiical peiinis of converge to / in H, as n ^ Bui Ihe 
rate of convergerux' is likely 10 depend on the nnlure of the 
piunts (Middles or minima), and such questions are wide 
open 

Finally, in order to apply in a meaningful way lo .sysiem 
theory, this technique has lo be extended to the multi input 
nuilii-oulpui case, a question which is m>t vri settled Ihe 
mam difficulty is to find an analogue to Ihis 

generalization is ixirrcntly under invesiigaiion 

As a conclusion, let us express mir jxiini ol view that 
rational approximation has .something to offer in system 
theory and that ditfrreniial IihiIs ure useful in smiMiih 
siiuHlions like the one arising here The idrove algorithm is 
intended to l>c a modest contribution to this range ol ideas 
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Technical Communique 

A New Result on Relative Gain Array, 
Niederlinski Index and Decentralized Stability 
Condition: 2X2 Plant Cases* 

MIN-SEN CHlUt and YAMAN ARKUNt^ 

Key Wofds—Decentralized stability; relative gain array; Nicdcrlmski Index 


AMnct—This note discusses the decentralized stability 
condition fur a 2<hannel decentralized control system where 
each channel is a smgle-input-singic-ouiput (SISO) control 
loop. Stabilization of each individual loop (with the other 
loop open) is not required, which had l>ccn the case in 
previous work on the Relative Ciain Array (RGA) and the 
Niederlinski Index (NI). Therefore this new result is u 
generalization of previous RGA and NI stabili/aiion 
conditions. 


and 


Vi 1,2 


( 2 ) 


where ) is allowed to he unxtahle which implies IcHip i 
(i • 1, 2) lo t>c urisuihle by itsell It is clear from (2) that 
ha.s to sulisly 




1 


1 


A? 


h 


1 . Intruduction 

Fok a 2-channcl decentralized control system where each 
channel is a single-input-singlc-output (SISO) control l<Hip, 
decentralized stability condition can he related to the 
steady-state gain of the open knip system u.sing the Relative 
Gain Array (RGA) and the Niederlinski Index (NI) 
(Grosdidicr et at , 19H5; Niederlinski, 1971) Both of these 
quantises have found wide applications in priK'css control in 
particular. In the derivation of these' results (e g. sec 
Grosdidier et al., 19K5) the stability of the individual Uxip 
(with the other Im^p open) is assumed Although such an 
assumption can be justified based on practical grounds like 
reliability, it is not a general theoretical result Therefore in 
this work this assumption is relaxed and new siabihiy 
conditions related to RGA and NI arc obtained. 

2 Preiiminanes 

Assumption 1 hold.s in the following development. 


to ensure the integral actum ol both loops Fatei we make 
use of this equivalence between Ihc decentralized feedback 
and IMC siruciure lo prove the rcsulis, 

The Relative (iain Array (HCJA) was dcvelo|>ed by HriNlul 
(19bh) Given the steady-stale gain ol G’(v). i e (7(0) - |)tf[J| 
for I.; 1.2 where is real. RC»A is dehned as 



^ 1.2 

(3) 

where 



. II 



1 ^ 11' 
A, , - A t; ~ ,j 

ru 

0 Ii 

(4) 

Afilif.!; 



A,; - A;, ^ 1 • A,, - 

1 ■ A,;. 

(5) 

In the 2x2 plant cases, the 

Niederlinski Index 

(NI) 

(Niederlinski, 1971) is defined lo be 



nil ... ... . 


(b) 

j"| ^\\ 



A.ssumpiion 1; 

• The plant is described by G(i) [g,^(.v)| for 1.2 
and C/(.i) is stable, strictly proper or semi-propcr. 

• Decentralized controller 


has two SISO l(X)ps and each loop contains integral 
action. 

Under Assumption 1 the decentralized leedhack amirol 
scheme is shown in Fig. 1. The correspt)nding decentralized 
internal model control (IMC) structure is given in Fig. 2 with 
the following equivalence: 

= diag(^„(.v)l Vi » 1.2 
CU) = diag(9.(.v)| Vi ^1,2 (I) 

* Received 5 February 1990; rcvi.scd 6 August 1990; 
received in final form 10 September 1990. Recommended for 
publication by Editor W. S. Ixvinc. An earlier version of 
this paper was presented at the BILCON Conference, 
Ankara, Turkey in July 1990. 

t Sch<x)l of Chemical Engineering, Georgia Institute t)f 
Technology, Atlanta, GA 30332-0100, USA 

3 To whom all correspondence should be addressed 


Undci Ihc a.shumption that the individual IcHip (i.c lixip I 
or 2) IS xtahlv when Ihe othci Ump is open (i.c. lixip 2 or I), 
ii i.s proved ihal A.,, *0 (or NI *0) is the necessary and 
sufficient condition for decentralized stability (GrostJidicr et 
al , IMK^). However, a priori .st a hi I i/.a I ion of individual ItKJps 
IS not a prvqumtf for the Niahiliiy of Ihc decentralized 
system. Therefore in this work I his requirement is relaxed 
and the following questions arc answered: Is there any 
restnclion on the number of unstable cU»scd-liK)p poles of 
l(K)ps I and 2'* If yes, how many unstable closed-l(M>p poles 
can one assign to l(Hips 1 and 2' 

3. Siahility ronditions 

llic next proposition states the decentralized Stability 
condition for a 2 >< 2 plant. Denote 

Alt) --- I - gi7(.v)<;i(.t)gj,(.t)(/,(.v), (7) 

Proposition 1. Lxt Assumption 1 hold. The necessary and 
sufficient condition for decentralized .Htabilily is that A(.v) 
docs not ccjntain any RHP-zeros. 

Proof Ixi Q{s) t>c the Youla Parametriz^tjon as defined in 
Youlari aJ (1976) 

Vi./-1.2 

where (for i, / - 1,2) arc mhle semi-proper or strictly 

proper rational functions. 
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Fio. 1. Decentralized fecdh^ick control scheme 


Under Assumption 1, the decentralized viability conditions 
are (ManouHiouthakiv, I9HM) 


*■ Vji(0«izO) 




(H) 

(V) 


ITie dcccntriilizcd IMC controllers in this note and the 
dcccntrali/cd lecdhack controllers in MunouHioulhakis 
(1989) arc related by the following equality 

cno(/ ■ u;,(.v)cnv)) ‘ - (/ Qisxn.s)) 'QU) (lo) 


It is noted thill the decenirulizcd stability constraints on 
[( 8 ). (9)1 will render the right hand side of (10) a diagonal 
matrix. 

After some algebra (10) yields 


9i(0 


9ii(V) '921(0 


92(0 


9^;?(0 ^ 912(0 

92i(')xu40 9m(0;^i2(0 


Tlicrcforc, from (7). ( 8 ). (9), (II). (12) 


(H) 


( 12 ) 


A(.v) 


I 

I - 92|(0ffl2(.0 


(13) 


^92|(0^'i4'0) 

den ( 9 ;,( 0 a'i 2 ( 0 ) “ num ( 92 |()) 


(14) 


et at. (1985), one of the fallowing holds when A,, (or NI) < 0; 

(i) /i,( 0 )< 0 . ^ 2 ( 0 ) < 0 . dci(//( 0 ))< 0 ; 

(ii) /!,(()) > 0 . /i 2 ( 0 )> 0 . dct(W( 0 ))<(J; 

(iii) either one of /i,( 0 ) and /i^fO) is negative and 
del(A/(0))>0 

where ^ 4 ^) - 1 = 1,2 and H{s)=^ 

G(.r)diag K(j)Ui .2 

Since dct(//(0))>0 iv only a nemiury condition for 
decentralized stability for 2 m 2 and larger systems while 
/ 14 O) >0 is a necessary and sufficient one for the stability of 
the individual loops, (la) follows from (I), (lb) from (ii), 
(Ic), (Id) from (iii) □ 

The next proposition follows directly from Lemma 1 . 

Proposition 2. If Assumption I holds and the stability of the 
decentralized control system is required, then one of the 
following conditions holds; 

1. A,, (or NI)< n, one ol the Imips I and 2 has to be 
unstable; 

2. A„ (or Nl) >0, b<nh loops 1 and 2 have to be unstable; 

3 A^^ (or NI) > 0, fMJth liHips 1 and 2 have lo be stable. 

It is noted that (3) of Proposition 2 was discussed in 

Cirosdidier et ai (1985) and Nicderlinski (1971), while (I), 
(2) of Proposition 2 remain open This is not surprising. Ilic 
assumption that the individual kn^p is stabilized in Grosdidier 
et ai. (1985) and Nicderlinski (1971) precludes the discussion 
of (I), (2) in Proposition 2 I'he next section gives the main 
result of this note. 

4 Mam result 

Theorem I Let Assumption 1 hold Lhe necessary and 
sufTicicni condition for decentralized stability is either one of 
the following conditions; 

(1) If k„ (or Nl)-^:(), one of the two loops has only one 
unstable closed-liKip pole, while the other loop is stable; 

(2) If A„ (or NI) >0, both loops have to be stable. 


where num ( ) and dcn( ) denote the numerator and 
denominator of ( ) respectively. Since both ‘»^d gi^f.v) 

are stable rational transfer functions, it can be concluded that 
A(.v) does not contain any RHP zeros and the proof is 
complete. [1 

The next lemma relates the stability conditions of a 2 x 2 
decentralized control system to KCiA and NI 

Lemma I. If Assumption I holds and 

1. (or NI)' (I, then one of the following conditions 
holds; 


Proof. The proof is by contradiction 
(1) If A„ (or Nl)*:0, one of the two loops has to be 
unstable from (I) of Proposition 2. Suppose that one can 
avsign more than one unstable pole, say two unstable proles to 
kxip 1 (the same rca.soning applies in a straightforward 
fa.shion to more than two unstable jxiles cases) 


</i(0 = 


ri|U)n4.v) 

(v - Pi){s - P 2 )d ,(.0 


Re 1/1,} >1), i -1.2 


li’ be any stable, proper, rational transfer function 


(a) the liKips I and 2 and the system are unstable; 

(b) the liMips I and 2 are stable, but the system is 
unstable; 

(c) only one of the loops I and 2 is stable, but the system 
is unstable; 

(d) only one of the loops 1 and 2 is stable, but the system 
is stable 

2. A„ (or NI) >0, then one of the following conditions 
holds; (la), (Tb). (Ic) and 

(a) the loops 1 and 2 and the system are stable, 

(b) the loo|>s 1 and 2 are unstable, but the system is 
stable. 

Proof We only show the prtwif of part 1 , since the same 
reasoning follows directly to prove part 2 From Cirosdidicr 



FTo. 2. ITeccntralizcd internal model control scheme 


where Re (■} denole.s the real part of { }, d,(.v) is a 
polynomial with only LHF-zeros, and n,(A). n 2 (.v) arc the 
ixdynomials such that f/|(v) and q,'(-v), detined below 

are proper qi(y). 9^(0 arc designed such that A(i) of (7) 
satislies Proposition 1 . Nevertheless the following design also 
stabilizes the plant; 




n 1 U) 

is - />,)di(-v) 


9^0) 


- p. 


9,(^) 


because 9 i(y) 92 (.v) = q'iis)q'As) and hence A(.v) = A'(.r). 

But then this contradicis ( 1 ) of Proposition 2. TTicreforc 
one has to destabilize any one kx>p with only one unstable 
closed-loop pole in order to stabilize the plant. 

( 2 ) If A., (or NI)>(1, one possibility is that the two loops 
have to be unstable from (2) of Proposition 2. Suppose that k 
and rn un.stable poles are assigned to loops 1 and 2 
respectively, i.e. 




d.is) 


n (^ -pj 

t-A 


, _MO_ 

^ » I m+2 

ii u-p,) 
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where Re (/>,} > 0 for I ** 3 - A > m ^ 2 and d^(s) arc 
pofynomiah wiih only LHP-zctos n^(Jr). n^U) and are 
ihc polynomials such that 


n (i - Pi ) 




and qX^s) 


(3) Ujop 1 IS siabk and ItKip 2 ts unsiaNc with one unsiabk 
pole qlls) IS of (I M and 

-, >0 ( 20 ) 

“ 1 ^ fS 

nuiti(A*u)>-aniM*% (f 0 nvi'^ sas (2!) 


arc proper, q'iis), q^is) arc designed such ihai A'ls) of (7) 
satisfies Proposition 1 But then the next design also 
stabilizes the plant 


lire necessary and sulhcjcnt condition tor (21) having 
LHP-ieros onJ> is 

f -Oil (22) 




d4^) 




n u p,) 


c/:(A) 


It IS iniciesiing lo sec ihc physical micrpiciation of the 
stability mnsiniini, (22) From (2), (20) Ihc Iccilbacli 
conindler of liH>p 2 is given by 


CtlA I H ) 

I \ 0 111 ' 


(23) 


because </J(j)<^ 2 (j) = AV) ™ A*(i) However 

this contradicts either (2) or (3) of Proposition 2 Hence (2) 
of Proposition 2 is false and one has to stabilize both hxips 
for achieving decentralized stabilization □ 

The next example illustrates 'T'heorem 1 
Example 1. 

CiV^ L [ I 

1+ 0. IKslo KS 0 (104 


It IS checked that Nl < 0 and three different designs arc 
discussed. 

(1) I^ips 1 and 2 arc stable; for example, chiwsr 

qi{s)~\ (IS) 

I 4 (). Il.\ 

i/iCO = 2S() - f ’ 0 (16) 

1 4 (S 

llien the numerator of A(.v) is 

num (A(.r)) - es^ + (V ()9f I ),v - S31 HIK (17) 


It is obvious that (17) has a RHP-zero for any positive r 
and (7(.r) can not be stabilized. 

(2) Loop 1 is stable and knip 2 is unstable with two unstable 
poles. is the same as (tS) and 


l-fO.lly 

i/;(cl- 2S(J . c. (p >i) 

^ (-1 + f.v)(-l + 0 i) 


(IH) 


It is routine to calculate that 


num (A'(i)) - (). 11 r 0.T' + f f - n 11 f - 0 11 jp ).v' 

- (r + (p -0,11)1 - SH.S, (19) 

Again. r#(.y) can not be stahili/ed by any piisiiive f and 0 


Thcrclorc the feedback gam is limited by (22) ll should be 
tuned below 27 S/0 II - 250 ti> guarantee the stability of 
(iis) 

5 ( Vmr/u.oon 

A new dcecninili/ed siabilit) condition rciHicd to R(iA 
and Nl without requiring the stabilization of the iiulividuiil 
liKips o given Hus result .should be viewed as a 
generalization of previous work on K(iA and Nl llie result 
is limited to 2 x 2 plants under multi loop SLSO control and 
should ho|Ktullv motivate further development for larger 
systems 

Ai^noH/rdji»rmenh“ Ihe authors would like lo thunk Prol. 
M Moran for his helpful comments on the piiiamelri/ation 
of stabilizing conlrollcrs Hie financial support of National 
Science LoundalKm is gialcfully acknowledged. 
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Passivity Properties for Stabilization of 
Cascaded Nonlinear Systems* 

ROMEO ORTEGAt 

Key Wofds—Nonlinear sysicms; stability; input-output stability 


Ahilracl—'We study the problem of global smcxith 
stabilization of ca,scacle compositions of nonlinear globally 
asymptotically stable systems. Our main result is that global 
stabilization can be achieved if we can render the first system 
strictly passive for an output which spans the ‘unstable part” 
of the vector field of the second system. This result 
generalizes earlier stahilizabiliiy conditions foi the casi^ when 
the first system is linear. Also, it provides .some insight on 
the (“energy dissipation") properties of the dependence of 
the second system vector field and the first systems output" 
needed to achieve global stabilization. 

1. Iniroduaion 

A PROBi.EM of current interest in nonlinear control theory is 
the establishment of sufTicicnt conditions for global smooth 
stabilization of cascaded nonlinear .systems of the lorm (see 
Fig. 1): 

i-/(4. ?), ifR' (la) 

^m(£-) 4^ C;(^;)li. u e (|h) 

where /;M” '' and arc 

sm(K)lh (i.e. of class C ") functions and assuming that 
(Al) the system 0), a t P/', has (I as a globally 

asymptotically stable (GAS) equilibrium, or for short, is 
GA.s, and 

(A2) the system ? - mfi;) is also GAS 

It has been .shown in Sonlag (198K. I9K9). that the cascade 
connection of two GAS sysicms docs not yield, in general, u 
GAS system However, if the stronger requirement of input 
to state stability [Definition 2.1 in Simlag (19K9)| is imposed 
on the second system (Ta), then the cascade is again CiAS. A 
further refinement to this result was recently established in 
Seibert and Suarez (1990) where the weaker “small input 
bounded output" condition is shown to lx: siifticicnt for 
stability. On the other hand, motivated by the recent results 
on input-output linearization (see c.g. Isidori. 1989), 
Kokolovic and Sussman (I9H9) and Saberi e( ai (1990) have 
studied the particular case of the problem alxivc when the 
first system (lb) is a linear controllable system. 

7'hc construction of the stabilizing law in Kokolovic and 
Sussman (1989) is a variant of the canccllulion prtxedurc 
used in adaptive control (sec e g Narenda and Annaswamy. 
1989) Tliis cancellation is possible if wc can define an 
"output" y = such that; (i) the transfer function u y is 
strictly positive real [equivalenlly the map w—•> is strictly 
passive, (Dcsocr and Vidyasagar, 197.S)|, and (ii) 'Hie 
"unstable part" of the nonlinear system vector field belongs 
to the span of this output, i c if /(x. c) -/(a, 0) f 
span(yi. .Vm) ^ characterization of the passivity 
condition in terms of the transfer function leading Markov 
parameter and its stable invertibility is given in Saben ei al 
(1990) lilts variant of the Kalman-Yakubovitch Popov 
(KYP) lemma allows the authors using dynamic compen 
saiors, to extend the result of Kokolovic and Sussman (1989) 
to a larger class of systems and to provide an inicrprciation 
of the required dependence of x and £ m terms of the linear 
system zero dynamics 

•Received 27 June 1990; received in final form 29 
September 1990. Recommended for publication by Editor H. 
Kwakernaak. 

^National University of Mcxict), DEPfT-UNAM. P.O. 
Box 70-256, 04510 Mexico, D.F. 


In this paper wc extend the irsuli of Kokolovic and 
Sus.sman (1989) to the case when both systems aic mmlinenr 
Wc follow the pnxedurc of Kokolovic and Sussman (1989) 
described above to explore the "energy dissifiation" 
properties of the depemlence of / on 5 so as to insure 
stabilizabiliiy of the interconnected system W'c show that 
global stahilizjition can he achieved if wc can render the first 
system strictly passive for an output which spans the 
"unstable part" of the vector field id the second system. 

2. Mam result 

The litllowirig definition of strict passivity will lx used in 
the sequel 

!)rfimnon 1 Consider the state-space nonitnear system 
A -/(a) + C;(A)rG a((I) - i,,( u f V - /i(a)€ We 

say the mapping H:u is ,wnrr/v pwtxnr rcliitivc to the 
functions V (0 and i) iff E( ) R** >W[ is a powlivc 
delinile function of the stale, ) is u cla.ss 'M' 

function and for aU u. i, y solutions of the system equations 
and lor any f • 0 wc have 

I v'udi V|jr(l)|- I (J(|i|)ilt, 

.1(1 •'(» 

Hrmurk I We have included in our definition of .strict 
passivity the functions V'(i) and /f(A). vScc also Hill and 
Moylan (19H(I) for a less rcMrictivc. but siinilai in spirit, 
definition 

Remark 2 Notice that if i 0 is an equilibrium then the 
strict passivity condition implies that » /(a,I)) is CiAS. 

C onvcrscly, if i “ fix, t)) is CiAS wc can define an "output" 
such that the strict passivity condition is met, e.g 

V ■- r, VMa )*(j'(a ). wiih CTa) a strict Lyapunov function for 

A-/(A.()) 

We are in position In present our main result, whose priMif 
IS given in the next .section 

PntpoxiUim 1 Phe caM.'ade ainncclion (1) with HHsumplion 
(Al) IS ,sm(H)lhly slahilizubic if 

(A2’) llie system (lb) defines u strictly passive operator 
H :w-*y for an "output" y » h(^);W which sati.sfies 

the spanning condition 

/(*, V £) (2) 

for some .smtMilh functions/,; R" x M " R”,; 1. . m ■ 

Remark ^ In view of Remark 2. (>ur proposition shows that 
the cascade connection of two GAS sysicms can be made 
GAS if the "output" 

y :« V,V,(S)'G(^) 

satisfies the spanning property (2), for some )-slricl 

Lyapunov function of £ m(^) 

Remark 4 Similarly to Kokolovic and Sus.sman (I9H9), 
stabilization is also achievable if the spanning assumption (2) 
is expressed as the existence of 0. . . , , m so that 

m 

fix. g) -7 „(a. 5) ^ yjjix, S) 

/. 1 

Notice the dependence on £ of /|, In this case, the condition 
of GAS of i ^ fix, 0) should be replaced by global stability 
of i - fix, 5) for each fixed value of To complete the 
proof of (he propositirm an additional argument based on 
l^.SaUc’s invariance pnnaplc is needed For further details 
see Kokolovic and Sussman (1989) 
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Fi(i. 1. iJUx'k diagram rcprcrM^niatlon of (Ij in tcrmfi of 
operators X,: 6 j: for (la) and X; ^ for (lb) 


з. Proof of Proposition 1 

I’o explain our approach we refer to the operator 
rcprciienulion of (1) depicted in Fig I Our proof is ba.4ed 
on the idea of determining a feedback control uii, $) that 
will make (I) a feedback interconnection of two strictly 
passive operators. CiAS of the closcd-ltxip system will then 
follow from strict passivity of the feedback loop. 

f'o this end, define first for system (lb) an operator 
; u - ♦ y as 

‘ I y “ /ifS) 

which, under a.Hsumpiion A2', is strictly passive, i e for all 

и, X. y .solution of ( 3) and for all r :> 0 

[ y'uilr.-V,|5(/)|- (4) 

with Vy, fii positive dclimic and class Jf functions 
respectively 

Keferririg to Fig I, we notice that is the composition of 
X^ and the output function h( ). 'f'hc question is now whether 
we can dreomposf' X( inio the composninn of hi ) and a 
strictly puasive operator. If this is t><^ssiblc, we can. chcxising 
the control equal to the output of the latter operator, obtain 
the desired feedback interconnection ol rwo siriclly pa.ssivc 
operators 

'Fhc spanning condition (2) and the (IAS assumption A1 
allow this dccomptisition since, under this condition we can 
define for (la) an operator H,: v -* 2 ;»- Ui. . ' 

H,:] ■* *** ^ 

1 z,- V. ».';(< )/,U, if), y-1,2 - m 

with V|(.r) a sthci t^yapunov function for r/(.r. 0), I'his 
ofHsralor can also be shown to be strictly passive To this 
end, evulmite 

f v'.<lT ^ V fy,V,y!/,0r- [ |V, -V.V,'/(»,0)|clT 

- I .^11 J(l 

V,(.1(0)1+ [ f<,(UI)dt (.S) 

Jm 

where /f,( ) is a class -/f function whose existence is 
guaranteed by the siahiliiy assumption A I 
Now. sciting the control 

7 -1.m (M 

we gel a feedback interconnection of strictly passive 
Of>crators {see Fig. 2). I'o prove that the overall system is 
(jAS we cimibinc (4), (.S) and (f>) to get 

+ V'.li:«)|+- V,|j:(0)| + V,|J:(0)| 


- [ ^,(|.i|)Ur - [ /),(|ir|)0i 

•'ll -'ll 


which, invoking the arguments of llicorcm h in Hill and 
Moyliin (I^HO), completes the proof, ■ 

Rrmark 5. It is easy to show that the control law 
construction de.scnbcd ab<ivc reduces, when the first system 
is linear, to the one proposed in Kokolovic and Sussman 
(1989) as follows In this case (lb) is dcscril>cd by f 
i4$ f Hu. Now, chiHJSc a stabilizing control u - Kx and stilve 
the Lyapunov equation {A -i- 8K)'P P{A 4 HK)^ - CL 
Cf >0, llie theorem insures <^tahilization if (la) satisfies (2) 
with V * P^. 



i 

- -1 -- ^ H-- 

Fk; 2. Hlix'k diagram representation of the closcddoop 
system 


4. Example 

In this section we apply our stabilization prcKcdure to the 
following example 

x-xix^^^^-\) (7a) 

g- t' + gu (7b) 

It can t)c shown that even though each independent system is 
CiAS, e g. i ^ -1 and g ^ - g. the cascade amncciian is not 
becau-sc (when u - 0) the set ji'y' - I is invariant. T’hercforc, 
Irajcciorics starting in the set jr"v’^ 1 cannot converge to 
zero. See also Seibert and Suarez (1990). 

Following the design prtxrcdure above let us calculate 
fix, g) fix, 0) for (7a) which gives 

/(jr.g)-/(4. 0) -x ‘g*\ 

The question is whether we can find an “output” y ~ /i(g) for 
(7h) such that the operator H, w—^y is strictly passive and 
satisfies 

x"^^ - g)v- 

for some /,(.*, g) lo this end consider Vj(g):'- i,‘‘V2, whose 
derivative along the tnijcclones of (7b) yield 
V. - - g* 4 g‘'u. 

I’hcrcfore, setting v “ g' and /,(a. g) i ’ we attain bi^th the 
spanning anil strict pas.sjvity conditions Fhc stabilizing 
control is obtained from (h) as u - 

Ai'knowledf>emeni .\—The author would like to express his 
gratitude to Professors P. Kokolovic. R Suarez and E. 
Sontag for having provided him with early versions of their 
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Technical Communique 

An Elementary Derivation of the Maximum 
Likelihood Estimator of the Covariance Matrix, 
and an Illustrative Determinant Inequality'" 

SEPPO KARRILAt^ and TAPIC) WESTERl.UNDt 

Key Words—Maximum likclihiKid cslimaiion; csiimuiion, dcicrminanlN, iiplimi/JiMon, Icusi-f^quarrH 
estimaiion 


Ahstract—'Ihc unique muximum likclihixKl csiimatc of ihc 
covariance matnx of normally disinbuled random vectors is 
derived by use of elementary linear algebra leading U> simple 
scalar equations In addition the application of a determinant 
inequality, also derived here, shows that a standard 
“derivation' ol the maximum likelihood estimate is 
fallacious. 

iniroduction 

In somi tcxthiHiks on estimation theory (for example 
Cimidwin and Payne p 4K| the maximum likelihood 

estimate of the covariance matnx of normally distributed 
random vectors is obtained by matrix diflcrcnlialion results 
for general matrices, not resiricnng the covariance matrix to 
being symmetric positive definite (SPD) or even just 
symmetric. A Malionary point of the likelih(K>d function is 
obtained—the stationary point is then observed to be SPD 
and It is concluded that this must be the unique solution lo 
the maximi/ation problem in the smaller domain ol SF’D 
matrices. Although the solution is correct its derivation is 
not, and some confusion may arise since the likelifuHid 
function attains arbitrarily large values when the covariance 
matrix is not restricted lo being SPD Naluriilly the 
stationary p<iint obtained for general matrices was in (act a 
saddle point, and some further insight about the situation is 
provided by the monoionicity result presented for detei 
minarits here. 

The maximum likelihood e,slimate 
I'he likelihood function of A' independent normally 
distributed random vectors e with n real components is given 
bv 


Ihc maximum likclihixKi estirnHtc of N is given by the rtx>i 

{*) 

The saddle fxiinl naluie of this symmetric rixvi is seen an; 
follows We jK-rturh the inverse solution with a real noiucro 
skew-symmetric injitrix H - H^. 

H ' ■ '4 AH (S) 

where A is a rciil scalar Observe that the trace within the 
exponential in equation (I) is unchanged by this periurbii' 
lion, since the trace ol a sum is the sum of traces, and the 
skew symmetric real matrix KlfE' has zero diagoiiul 
elements whereby tr (K' LH) (i (EHE^) » fl Therefore 


/.(K 


')- /.(R '»(' 


' + AIIIV'''' 
IR '1 ' 


«») 


Also the dctermmunl inequality 

|R ' + AH| -IR 'I (7) 

holds lot all A ^ 0 as it 'is SPD (see ihc Appendix) M) lhal 

/-(H ') -/.(R ') (8) 

The likelihiMxl function will thus be inerea.scd (monolonically 
with rcspi'ci In (A|) by pcriurbuiions about Ihc stuiionary 
point With skew symmetric mutnccs, and Ihc stationary p<»inl 
given by equation f4) is only u saddle psiini (for general 
matrices as the domain) 


/. = (2;r) '|H ' exp | - Ur (K'KR ‘)) (I) 

where R is the unknown covariance matrix T he matrix I' is 

formed from the observations according to 

E'^-|e,.e.Cvl (2) 

The standard way of obtaining the maximum likclih«HHl 
estimates is by differentiating the logarithm of the likelihsNKJ 
function with respect to the estimated parameters using 
matrix difTcrcniiation rules for general matrices This gives 
[see Goodwin and Payne (1977). p. 4H. cqn .1..^ 1()| 

' + !h 'k'kr (.7) 
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A simple voluiion 

The maximum likelihiKKJ eMimatt can be obtained 
rigorously by using dilfercniiaiion rules for symmetric 
matrices (Cirayhill. 19KJ). However, the following elemen' 
tary and concise approach is more appealing especially for 
cla«vsnKmi uu- 

( onslram R to be SPD and u.ssumc E^E is invertible no 
that It IS also SPD Then, square nxiis of these matrices arc 
defined (uniquely by requiring them lo be SPD) Define Ihc 
matrix 

A - (E^E)''^R '(E'E)*'* >0 (9) 

and note that it has the same trace as E'ER The 
determinant of A is related u> that of R by 

|A|»||UE||R '|. (10) 

Now maximi/alion of equation (1) is equivalent to 
maximizing 

/ - lAl'^'^cxp (-5 ir (A)) (11) 

With respect to A where A is SPT), 

1,^1 A, . be the eigenvalues of A—being SPD A 
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can he diagcmali/eJ anil all iLs cigcnvalucM are positive. Tlten 

f - (f I ' «p I - !• i )»A f 12) 

(I hiK cqualion would he equally valid for general Hymmetric 
mainces A (or K) and connidcring negative A,, clearly %hows 
that no global maximum would ever he attained. | The 
Hlatioriary pfiinl is now obtained from the Iasi expression by 
considering the factors separately; 



For the allowed eigenvalues i |0, the unique solution ol 
rquuiion (11) is 

A, - V/ (14) 

Since ihe derivative of each factor changes sign just once, 

from fHisilive to negative, the stationary fioinl obtained is Ihe 
global maximum (within Ihe domain con.sidered). 

Now all (he eigenvalues of A arc equal Note that the only 
matrix similar to a multiple of the identity is that multiple 
Itself, and 

A - A/I... (»;'K)H (I.S) 

Ihe unique SHI) maximum likelihood estimate of R is 
the re I ore 

k (ih) 

N 

/h'vr M-wiofi 

All elementary proof (or the maximum likelihood estimate 
of the covariance matrix, for normally distributed random 
vectors, was prcsenlcd 1his proof, it is hoped, will 
siqxTsede the less rigorous but more complicated proofs in 
some current textbooks Aside from the main theme a 
delerminarii inequality, (hat (he authors hiive not managed 
to find in the litenilure, is derived in (he Ap)H‘ndix and used 
lor illustrating the im|>oriance of proper consideration of the 
domain m ojuiiiu/alion problems 

Rvft'ri’mn 

(iootiwiii, Ci i' and K, I Payne (1M77). Dvnamu .Sv.vreo 
hlxpenmvniul Design urul Data Anu/v.vw 
Academic Press, New- York 

(irayhill. I A (I'lfS.l). Mairurw with Appluatutm ir 
\ V\'iidswoi(h, ifelmoni. C A 


Appendix 

I^t S be a real symmetric positive definite matrix and H be 
some nonzero real skew-symmetric matrix (H= -H^). Here 
we show that 

|S + AH|>iS( (AA) 

for all values of the real scalar A^^O. and in fact 
monotomailly increases with the absi>lule magnitude of this 
perturbation parameter. (The reader may observe that the 
same priK)f is valid for the skew-Hcrmiuan periurbation of a 
FIcrmitian matrix in the complex ease, provided that absolute 
values (}f the determinants arc taken). 

Observe that 

S + AH - S'"(I 4 AS *^'HS '")S''' (AD 

and by (he pnxJuct rule for determinants 

IS + AH| - |S| • |l4 AGl (A.3) 

with 

G-S ‘"'HS (A.4) 

Since G is skew-symmetric its eigenvalues are purely 
imaginary, and these are shifted by unity when the identity 
matrix is added: 

|S4 AH| = |S| i] (1 + < AA,). (A .S) 

I 

where , lA^, 7 - 1, . , n arc the eigenvalues of G and 

i - \/- 1 Hie product on the RHS is pure real .since the LHS 
IS, so taking the absolute value will at most change the sign. 
.Shifting the absolute value to ihe factors of the product gives 

|S| n V"iTa-^’, (A.6 ) 

which obviously is monotonically increasing with |A|, strictly 
so since at least one of (he eigenvalues is nonzero. f3iie to 
continuity with rcsjxct to A the RMS of (A.5) cannot jump 
to negative values as A moves away from zero; thus it stays 
fHisitive and taking the absolute value docs not even change 
sign. This proves that the IJiS of (A,-^) is also monotonically 
increasing with respect to the absolute value of A. The 
weaker result 

|S + AHr>|S| (A.7) 

for all real A / (I. follows from this strict monotoniciiy. 

O E 1) 
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Real-time Computer Control: An Introduction* 

Stuart Bennett 
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This hckik is much hciler than I expected it to (>e 1 was 
sure that it was another b<H>k on control al^onthms. 
emphasizing now and then the necessity ot very rapid 
computations. Fortunately enough, this was not the case 

I think that the hixik presents a nice collectiim ol 

knowledge areas, necessary to spt^cifv. design, implement, 

dehug and test a real-time computer control system Ehc 
depth of presentation is suitahle lor the audience intended 
for the hiHik—the final year iindergraduale students and 
practising engineers. Still, I lend to think that an engineer 
can learn more from this IxHik than a student; implicit 

connections between different knowledge areas may he a 
little hit difficult to discover without a practical c<mirol 

system background 

fn the followang, the hook is reviewed chapter h\ chapter 
and subjective merits and deiiutils are listed (or ciich 
chapter. 

C hapter I, Iniroduciion to Real-time Systems, is pcrleei, 
especially the interpretation of real-tinie - in most cases 
real-time means (hat two or more systems (one being a 
computer-based system) with tlilTcrcnl inner lime eoruepts 
are forced to cooperate by providing a common uiulersland 
mg of lime It was so refreshing to see that the widespread 
misconception of leal-timc as being almost e(|uivalcnt to 
super-jHrrformance is no longci taught to students 

Chapter 2. C oncepts of (Omputcr ( nntrol, seems to be 
not quite balanced, I’hc aUcnlion has been biased towards 
explaining different control strategies (sequence control, 
direct digital control, supervisiiry control), whereas the 
problems of control system as a whole (eenlrali/ed eornpuier 
control, hierarchical control system, dislnhuicd control 
system) arc discussed superlicully In addition. I am not 
quite happy with the notion of distributed system in the 
b<K)k It IS interpreted more like distributed computing I 
would personally use the term 'distributed control system' 
as a common name for a system that may contain both 
hierarchical control and distributed cuirnpulmg clemenis 
7'his chapter would have been a suitable plate for explicitly 
stating how the following chapters are related to each other 
in the process of building a control system However, there is 
no such statement in the biKrk. 

Chapter (nmpuier Hardware Kei|Liircim’nis for 

Real-time Applicatums, is a very giKid explanation ol how 
computer hardware functions (including also process 
interface and data communication in distributed system) 
The content of this chapter is closer In the de.scriphon of the 
slale-of-lhe-arl of computer hardware than to the require¬ 
ments. I would have expected more thorough discussion ol 
standards, 24 lines is certainly not suflicieni, 

Chapter 4, DfX' ( ontrol Algorithms and then Implemen¬ 
tation. IS another excellent part of this fxiok The reader is 
systematically introduced to the differences of coding a data 
processing algorithm and programming a real time system 
Slightly out of line of this hixik seem to lx: the details ol 
DDC algorithms, c.g improved forms for integral and 


* Real-time Computer ('ontrol An IrUrodurtion by Sluarl 
Bennett, in Senes in Systems and ( ontrol Enffineennfi (Senes 
editor: M. J Grimhle) Prentice Hall International, Hemcl 
Hempstead. U K (IW8). ISBN U 1.V7624KS 9, 162 pp. 
$82.95. 


derivative calculations, : iriinslorm Example 4 5 contains an 
error (nexlSainplclntcrval pro nexiSamplc I ime) 

C'hapicr 5. Design of Rcul-tiine System, gives a leaMuiahle 
survey of the hot topics of software engineering eiivirvm 
mcnis for aimpuier txintrol syMeiiis I cannot fully agree with 
.separating hardware and software designs Ix^foie require 
mcni.s anah'sis, pKrrhiip,s ii would be Ix-ttei to prove 
eonvisiency and lumcontradiction of the system dclmiiion 
(requirements) first In mtiny cases ii would Ix' difliculi to tix 
a feasible hardware Ciinfiguration before we have complete 
requiremciUs on the system behaviour Also, in conliol 
systems it may ollen hap|xn that it is iiccessarv to impicmciil 
some pari of software by using dedicated hanlware and 
again, this kind of a decision dej^nds on (he control 
algorithms and on the plant dvniimics I doubt (hat (he 
system definition (sec Fig 5 If and Ihe indicated inicraclums 
(see Fig -S I and Fig. 5 2) aic sulficieni for that At least 
these problems should have been meiiliimed in this chaplet 

Another problem worth mentioning in this cliaplei is 
connectcil with the multiple use ol Ihe sy.stem/sollwaie/ 
hardware absiraci mcHlcl I ladilionally the alnliacl model is 
used lot providing a belter survey ol the system/soilwine/ 
hardware to the designei m a ho|H' that he/she can find 
di.wrcpaneies or crrois in the dewriplion lodav the use of 
formal methods lor divcovering errors gains more and more 
|x>pularity Application of formal rnellaKls to system 
deseriplums, m their turn, imposes new requirements to 
abstract models ITiis problem Is run discussed in (he Ixiok. 

C hapter 6. OjK'rating Systems, gives a good explanation 
ol the basic parts ol Ifiesc systems This ex|>liination is 
necessary and sufficient loi undeisiandmg the lunciioniiig ol 
a real time system A large pari ol (he miormation obtained 
Irom the design dcM.Tiplion (sec the (uevious chaplci) is 
often used to determine or modily some ol the operating 
system properties (e g schetlulmg, queue lengths, etc) The 
summary of this ehaplcr just mentions the problem I think 
sliidenl.s would need a more detailed dissusMon ol tins 
subject 

( hapter 7, C'oneurrcni programining, gives a piaginatic 
overview of parallel execulion of jirograms desenbed are 
methods and primitives neccsKary lor implementing miilli 
tasking (mutual exelusion and iriterlask eommumealion 
problems). Presentation ol mclhiKls and jinmihvcs i,s clear 
and underslundubic atul is supplied with a number ol 
examples Ifie given amount of miormation is sufficient !oi 
building not km) demanding control systems. However, some 
of the pracii.sing engineers may have encountered more 
sophi.slicatcd concurrent programming problems, e g timing 
problems m intertask eommuniealion. or really concurrent 
implementation of some of the algonlhnis. For those it 
would be useful to know that concurrent programming 
means much more than i.s presented m (his chapter. 

'Hit* heading o( Chapter H, ReuEtime Languages, is quite a 
confusing one. Not much is said alxmt real time languages m 
II, III fact, the next chapter handles them mure thoroughly 
Hus chapter is alxiut requirements to languages foi 
programming large systems, 

('hapter 9, Programming l.anguagcs. surveys some of the 
languages used for implementing compiiier control systems 
(Basic. Fortran, Pajw;al. Coral fi6. R1’I72. Modula r, Ada) I 
would have added PE.ARL to the list of surveyed languages. 
PEARL IS used on the European continent and has a nice 
design supporting system (E POS) - it provides a gixxl 
example of systematic approach to the development ol 
real-time .systems. 

On the whole the bixik presents a well-balanced collection 
of topics important for designing and implementing computer 
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cimtrol Aysieim ll is readable and ihc prencnlation clear 
Tlie basic drawback of the bcxik is that it dix;s not merge the 
diffcrcni areas of human knowledge into one; this is left for 
the reader, I am afraid that this task is not sio easy for an 
undergraduate student. 

In spite of this drawback the book is one of the l)csi 
textbooks introducing rcaJ^iime compuici control that I have 
read. 


Aboui the rrviewtr 

Leo Motus has Ph D equivalents in stochastic control and 
software engineering He has been Chairman of the IFAC 
working group on Distributed Computer Control Systems 
since 1987, is a Vice-chairman of IFACTC on Computers, 
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Computer Control of Machines and Processes* 

John G. Bollinger and Neil A. Duffei 


Hevtewer: C SC'HMID 

Ruhr-lJnivcrsitill Bochum, IxhrMuhl fUr EIcktrischc Sieucr 
ung und Kegelung, F'oslfach 1()2I4H, D-46.^) Hiichum I, 
Federal Republic of (iermany 

'I'tiis tUKiK is an excellent one for undergraduate and 
graduate students til all engineering disciplines interested in 
computer control, as well as being a sujKrb reference book 
for industrial people attending refresher courses on this 
subject One of its striking features is that little prior 
knowledge is demanded from its reader/user. Its spectrum of 
topics, which arc of special importance in computer control, 
is indeed exceedingly broad I he iKMik has naturally evolved 
from courses presented at the University of Wisconsin 
(Madison) by Ihc authors since the mid-l^fbOs 

In its more than MK) pages, the book covers all the relevant 
aspects of computer control. Ilic twelve chapters essentially 
give a nonmathematical introduction After the brief 
intriKluctory ( haplcr I. which sets the rest of (he bcKik in 
projicr perspective by dealing with the hi.story of computer 
control and the explosion in the application of electronic 
technology since Ihc I96(K, it goes on to present chapters on 
elements of discrete time modelling, system response 
generation, discrete-controller design, control computer 
hardware and software, computer interfacing, sensors, 
command generation, sequential logical control, process 
modelling, analysis and design. Mnally, the fxiok closes with 
an appendix on the state-variable approach 

C’hapier 2 starts with a discii.vsion on basic process typos 
and develops the idea of representing comp<incnts of 
closed-liM^p systems using difference equations and discrete- 
time transfer functions, wiihoul applying any transformation 
techniques (which will Ik* first inlriHluccd towards the end of 
the bixik in C’haptcr 11) After reading this chapter, one is 
(»n the level to understand system input -output iKhaviour 
and to analyst the stability of u syslcm However, the 
discussion of stability is different from Ihc standards of 
control theory! As the stability analysis is based on the rtmis 
of the characteristic equation in terms of the backward-shift 
operalor, all tliscussions about .stability arc treated in a 
domain mirrored at the unit circle. Itiis may cause the novice 
reader to be cHinfiised when reading other books 
rcctimmcnded in Ihc bibliography attached to this chapter. 
Two fundamental concepts arc introduced in Chapter 3: The 
sampling of signals generating time series, and the use of the 
lime-shift operator to gentrale and determine system 
responses The lirsi design of a simple conlrollcr can be 
found in Chapter 4, which fcKuscs on the desired closed-loop 
responses to sficafic inputs. The discussion about the 
selection of the sample period and the dCvSigii of feedforward, 
cascade and noninieraciing control in interactive plants 

* Ct^puier Coritml of Machines and PriKesses by John G. 
Bollinger and Ncil A Duffei Addison-Wesley. Reading, 
MA (1988). ISBN 0-20l-U)64^S-0. S^3 7.S 


completes the first pari of this book. These four chapters give 
an excellent introduction to discrete-time control 

The .second part of this book deals with the computer. 
Chapter 5 is dedicated to computer hardware and si^ftware. 
It presents important a.Hpcets of computer architecture and 
operation in a way that i.s independent of computer 
manufacturer or model This includes binary logic, basic 
computer hardware, the concepts of instructions and data, 
input/oulpul, interrupts and programming at the a.s.sembly 
language level. A set of high-level language procedures is 
defined such that the principle of closed-liHip computer 
control can be shown at the end of the chapter. ITiis chapter 
a)ncludes with a discussion of how closed-kxip control 
functions can be organized on a control computer The 
material and examples are well elaborated and their 
.sequence reflects the various levels of abstraction in which 
designers of computer-control systems must carry out their 
work, Linking to external devices is the mam topic of 
Chapter 6. The range is from analogue conversion Id address 
dccixJing, device .selection and interrupt interfacing. Tlie 
short discussion here draws on a simplified computer 
architecture und is sufficient for understanding. Chapter 7 
describes a spectrum of sensors that arc often found in 
computer control systems for machines and prix'cs.se.s. 
Chapter K adds stimc nonesscnlial aspects of command signal 
generation in control. The implementation of logic control 
and the Mdution of Brxilean equations are discussed in 
Chapter 9. Ladder diagrams, which are the means to 
describe the solution of logic on a computer, are treated In 
addition, a number of design methods for logic control arc 
described—including the use of flowcharts, switching tables 
and stale diagrams. This chapter gives only a rough sketch 
about the principles of .sequential control and the use of 
programmable logic controllers. Chapters 1-9 can he 
covered in one semester at an introductory level. 

The third part of the btxik portrays more control 
techniques, the crucial point being the application of more 
sophisticated system techniques to computer control. 
Chapter 10 reviews a number of approaches to process 
mixlelling—from physical modelling to a mathematical one. 
Stcp-re.Hponsc and least-squares techniques of process mixlel 
identification are used. Through Chapter 11, where he can 
find the ha.ses of transformation into the frequency domain, 
the reader will be able to gather much more insight into 
dynamics. The concepts of ideal samplers, hold elements and 
the representation of a sample sequence are also introduced 
here. After the analysis section in Chapter 12, the design of 
controllers in the frequency domain is discussed both for 
continuous- and discrete-time systems, illustrating their 
similarities and differences An appendix gives a brief review 
of state-variable mcthtxJs for the analysis and design, 
including state estimators for a)ntinuou.s- and discrete-time 
systems. 

Throughout the textbook, technology-based information 
has been strictly avoided. The simplified computer hardware 
which is used allows fundamental concepts to be illustrated. 
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and al&o aflow!i syviem-level issues lo be dincusscd without 
describing too complex computer architectures The authtws 
include PASCAL programs at many locations in the text to 
illustrate the use of computers. TTic programs are greatly 
simplified to improve the illustration of important ccmcepts 
Various manufacturing-related examples of processes arc 
used to illustrate the analysis, design and implementation 
techniques that have been introduced Most chapters sian 
and/or dose with an example, the layout being uniform 
throughout the book. Also, each chapter starts with an 
introduction which contains a precise description of the 
goab. At the end, a more complex, but still illustrative, 
example comprises the e.ssentiaJs of the chapter which are 
additionally highlighted in a special summary section. A 
bibliography is attached to each chapter, and most of its 
entries arc books which, although not referred to directly in 
the text, may be used to supplement the hi\ok if additional 
information is required. In order to become more engaged. a 
well-elaborated list of many further interesting examples can 
be found at the end of each chapter in form of exercises 
llic printing is of high quality, and the figures arc 


enlightening where they should explain and illustrative where 
they have to drscrihe a real obteci Tlie whole W'^uk sdiows 
the great reaching cipentnee id the uuihoi^ on this 
sub}ect—towards wKk'K of aHii>c. Mudents' leedback enpiys 
great credit 

Tile book is highly rcadaNe and well organized h may he 
concluded that this lexthiHik is intended where there are 
great difTcrences in the iicadcmii hackgri>und of stuilents 
who enrol in cxmipuicr control aiur%c‘S 

A^H>ui thr rrvtrHYr 

Dr C Schmid received the Dipl Ing degree in 
mechanical engineering from the Dnivcrviiy of Siuttgarl in 
1972 and DrTng. dcgicc in eiccirical engineering from the 
Ruhr-University Bochum in where he has been a 

lecturer since 19H(i Uis main teaching activities are 
simulation techniques and computer-aided ixinliol system 
analysis and design, and his research iiiieresis are in adaptive 
aintrol and the practical aspects of ('AD of control systems 
He IS the author of a well-known mdiistrial CAD system 


Industrial Control Electronics: Applications and 

Design* 


J. Michael Jacob 


Reviewer: H. RAKE 

Institute of Automatic Control, Aachen University of 
Technology, Aachen, Germany 

As IN many other di.scipline,s of our world relying on science 
and technology, a noticeable gap has developed in control 
engineering between (control) theory and (electronic) 
practice. TTie present btxjk. by J. M. Jacob, intends to bridge 
this gap. Written for clcctncai engineering technology 
undergraduates it .seems to be well .suited lo introduce 
control engineers who arc not electronics sf>cciali.sis to the 
innards of the electronic hardware which they will have lo 
use in order lo close control lixips 

TTic btKik’s 585 pages arc divided into eight chapters and 
three appcndice.s. About three quarters of the pages arc 
devoted to material suggested by the biKik’s title, and thi.s 
material is presented in profc.ssional breadth and depth Ilic 
remaining quarter of the book i.s far less rccommcndable 
It seems lo have been written for the benefit of the electrical 
engineering technologist lo provide some in.sighl into the 
world of control engineering From a control engineer's point 
of view, this cannot be rated as a success. (By the way, did 
any reader encounter a “Bod6 Plot ' in theory or practice.' 
The reviewer, remembering the American H W. BcmJc, did 
not.) 

If treated as a one-way bridge, namely from control 
engineering lo electronics, the book deserves much praise. 
The fascinating subject of transducers is covered in a 
well-structured chapter giving valuable details about almost 
every type of some significance. The reviewer found only the 
coriolis-type mass-flow transducers missing, which seems to 


* Industhai Coziirof Elecrronics'. Applicanons and Design 
by J Michael Jacob. Prcnticc-Hall International, Hcmcl 
Hempstead, U.K, (1988). ISBN 13-459322-7, 131.95. 


be a minor shnritoming Signal conditioning and iransrius 
.Sion IS treated including the |H*vuliiiritirs ol eonvericis, 
i.solHiion ciicuiis and cabling Design priiuipk'N of analog 
controllers arc explained in such a way that the working of 
these devices including derivative overrun, integral windup 
and humpless transfer Irorn manual to automatic o|K'riilion 
hccomc iranspureni Ihe corresponding chapter on digital 
control gives very detailed and valuable inlorrnation about 
A/D- and D/A-eonversioii while the rest of the chapter 
IcKiks rather sketchy and a few pages devoted to 
programmable controllers could have lK‘en orniiicd Power 
interfaces arc the last ckeironic devices needed for closing 
the cxmlrol )(M>p .Switch-mode ampliliers and thyristor 
devices are descTibed m useful detail, showing how to make 
low-power .signals effeclive in a world o( high voltages and 
high currents cximpciled to energy eflicieiuy 

In concluding, the reviewer highly recommends the bixrk 
lo all those members o( the control community who are nor 
UK) familiar with electronics and want lo know more about 
the how and why of electronic devices and systems Itiey will 
surely benefit from the .strengths of this IxKik and be barely 
irritated by its (perhaps inevitable) weaknesses 


About the reviewer 

Heinrich Rake graduated in mechanical engineering from 
Hannover technical University. He received his Ph D m 
1965 for a dissertation on self-adaptive controllers. Working 
at the Institute of Automatic: ( oniro) of Aachen Technical 
University rince 1966. he was appointed head of this institute 
and Professor of C ontrol Engineering in 1977 Main areas of 
research arc model-based adaptive switching control, control 
of air amditioning plants and industrial rob<its, modelling of 
discrete-event systems, identification and parameter estima¬ 
tion methods and application of automatic control principles 
to a variety of industrial poKCsscs 
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Power Hydraulics’ 

Michael J. Pinches and John G. Ashby 


Reviewer II RAMON 

Aulomalti ( ontrdi LaNirarory, Slate Univers'ly of (ihent, 
(irotcsiccnwcg NoortI 2, B-9710 Gcnl Zwijnaardc, Belgium. 

Ai lucjufiii I'kiMinvi hydraulic power (control) goes back to 
ancient times, it was (he (hcorciical work on hydrostatics of 
(he f renchman Pascal, published in 1648, that opened new 
|Krspcc(ivc's m power hydraulics. Tlie first practical 
realization of Pascal’s l.aw was devised more than a century 
later by Bramah, who demonstrated the working of a simple 
hydraulic press From that moment on, fluid p<iwer 
applications were growing constantly, with a temporarily 
diminishing growth rale at the end of the nineteenth century 
due to the nsr* of electrical power transmission 

However, only since World War 11. with the introduction 
of servovalve technology, have modern developments in 
hydraulic power control expanded enormously Starting from 
early applications in airplanes, lighters and missiles, it spread 
over almost the whole field of mechanical engineering and 
mechatronics: from mining, shipbuilding and the steel industry 
In aulomativc engineering. rotHilics, aeronautics . . . This 
expansion can mumly be explained by the unique features 
of hydraulic (Kiwer, such as: the high safely and simple 
maintenance of the hydraulic system; good dynamic 
characteristics with fast starts, slo|>s and speed reversals; high 
stiffness properties of hydraufic actualtirs which give little 
drop in sp<’ed with increased load; and the versatility of its 
usage, e.g. m compact and light devices that can develop 
hydraulic p<iwei varying from a lew kilowatts (o several 
megawatts; hydraulic fluids which act as lubricants and carry 
away superfluous heat, generated during action, to a heal 
exchanger (both ol these properties resulting in a low wear of 
comfiiinenls) 

In many industrial applications, the positive features of 
hydraulic systems greatly surpass their disadvantages, which 
include; low elTiciency, (he high cost of hydraulic parts and 
their high sensitivity to dirt and contamination in (he fluid 
which gives rise to damage or silting of exfK'nsive 
components 

During the last three decades, fluid power hydraulics 
evolved Irom a more empirical science, with emphasis on 
fluid mechanics, to a highly technological and inierdiscipli- 
nary subject in applied science It asks from the designer, 
iHvsidcs an intimate insight into component design and 
component interaction, a good working knowledge of 
engineering mechanics, hydraulics, electricity and electron¬ 
ics, classical and modern control theory, instrumentation and 
computer science 

It IS clear that a complete b<H)k ' about all aspects of 
hvdraulic p<iw'er systems would result in an issue of 
thousands of pages Therefore authors have to make a logical 
selection between some topics of these disciplines and join 
them together in a coherent and readable work, llic choice 
lies between two extremes, and depends on the target group 

rhe first extreme includes all btKiks which keep 
mathematics and calculations as simple as possible, hut try to 
give a clear physical insight into the operation and 
interaction of all accessories in hydraulic circuits (pumps, 
valves, actuators, filters, conduits, ai'cumulators, hydraulic 
fluids etc.). To be aimplclc in their domain, they should also 
dcscnbi* rules and practical hints for hydraulic system design 
and maintenance Consequently it should make them not 
only useful as an intrixJuclory course for junior students, hut 
also of help to practising engineers and even to craftsmen. 


* h)wer Hydraulics by Michael J. Pinches and John (i. 
Ashby. Prentice-Hall International. Kernel Hempstead, 
U,K. (1988). ISBN 1C687443-6, $76.1)0, £39.95. 


In the .second extreme, all recent and advanced topics in 
hydraulic power system design should gel their turn. Iliis 
certainly starts with a mathematical representation of the 
dynamic characteristics of different lumped and distributed 
.system components such is valves, pumps, motors, actuators 
and transmission lines. Since most of them show a highly 
nonlinear behaviour, a nonlinear analysis seems inevitable 
beside a linearized description These models are not only 
useful for accurate simulation purposes^/ which can he 
employed in design siudic.s, hut also to predict and detect the 
undesirable behaviour of some devices under certain working 
conditions. 

The next important topic concerns the use of modern 
system theory in power hydraulics Due to their excellent 
fcature.s, hydraulic devices are utilized more and more in 
complex mechanical control systems, e g. in vibration control 
on clastic structures, extremely precise position, speed- and 
force conrni of flexible robots, active and scmi-activc 
suspensions in auloniobilcs; these ask for advanced control 
algorithms For this reason, state-space and multivariable 
frequency domain techniques, nonlinear-, digital- and robust 
control, adaptive- and self-tuning control, model reference 
control and (on-line) .system ideniificution, arc becoming 
indispensihle methods in hydraulic p<iwer control. 

It is evident that the ability to apply thc.se techniques 
together with their advantages, restrictions, and shortcom¬ 
ings should he described rigorously in close relation with 
hydraulic system characteristics. As a consequence this kind 
of hook would be of interest to (undcr)gradiiatc students, 
interested researchers and practising engineers, who need a 
profound knowledge of the subject. 

Turning to the existing literuture in this held, one notices 
that there mainly exist two categories of book. In the (irst, 
the material is handled in a descriptive way (Banks and 
Bunks, 19KK; Rexruth, 1981, 19K6, 1988, 1989a, b) while in 
the second, most authors treat the subject at an intermediate 
level. I’his means that they try to give a well balanced 
compromise between a descriptive and a quaniinuivc 
approach in which design calculations are normally based on 
a linear analysis and classical conlri)! theory (Merril, 1967; 
Stringer, 1976). Sometimes, more advanced topics arc 
discussed in a small part of the hook (Anderson, 1988; 
McCloy and Martin, 1980). However, a con.sisteni and 
rigorous Ireaimcnl of advanced theory through the whole 
text i.s rather exceptional (Walton, 1989) and most of the 
time the specialized reader has to he satisfied with articles 
and PhD dis.sLTlations (Dietz, 1988; Faulhaher, 1985; 
Feuscr, 1983; Quclting, 1982) 

The present btx)k, Power Hydrautics by Michael J Pinches 
and John (j. Ashby may be considered as an excellent 
contribution to fluid p<jwer hydraulics. In 4(H) pages it 
demonstrates, from a practical view|^K)int. the simple 
culculaiions, circuitry and component selection involved in 
system design. 

Chapter I starts with a very short introduction to hydraulic 
principles, followed by an explanation of the most important 
hydraulic symbols. C'haptcrs II, III, IV and V discuss the 
projKrtics, operation and construction of hydraulic equip¬ 
ment (pumps, hydraulic valves, actuators, tillers, hydraulic 
fluids, lubes and accTcssories). Chapter VI establishes design 
critena based on elementary' formulae and rules. Reservoirs 
and accumulators arc treated here, and two detailed design 
studies arc presented. Chapter VII handles in depth several 
procedures and actions which benefit good maintenance, 
together with a guidance on trouble ,shooting. illustrated with 
six examples. In Chapter VlII, linear models of valve and 
pump servo systems are derived and their response to step, 
ramp and sinusiudal inputs arc calculated. At the end 
proportional valve technology is stated and compared with 
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servovalves. Finally, there is an apfiendis with exercises and 
solutions 

In the hm seven chapters the authors describe in a well 
stniclured and almost encyclopaedic way different types of 
components with their principles of operation, repeatedly 
illustrated with figures and hydraulic drcuiis The number of 
utilized formulae is kepi to an absolute minimum and simple 
algebraic compulations arc restricted to the many interesting 
examples which clarify design rules in the text 
No previous knowledge of hydraulics or calculus is needed, 
except in the last chapter which presumes an elementary 
knowledge of ordinary differential equations and Laplace 
transforms. Each chapter is interlaced with numerous tables, 
diagrams and hundreds of practical hints which make the 
i%>ok invaluable for practising people in the field As a 
txmscqucncc, the aim of the authors to cater to a broad 
public of equipment purchasers, craftsmen, practising 
engineers, lecturers and students, is certainty reached Tlie 
hixik is also carefully edited, only Sl-units are used, and the 
choice between a hard cover or a low cost student edition is 
possible. 

Since nothing is perfect, it is normal that the bcKik displays 
some shortcomings, The weakest link is certainly the chapter 
about pumps. For a few types of pump, the explanations with 
corresponding figures arc nol clear enough to understand 
well ihcir working principles (the Iniernal gear pump of p 19 
and the geroior pump of p. 20). llic drawing of a radial 
piston pump is overcxaggeraiedly detailed, which is noi 
relevant to the text, and Fig 2.6 of an axial piston pump 
seems to be incorrect. 

I want to finish with a strictly personal remark: it is a pity 
that the authors did not speak of the so important valve 
coefficient (flow gam, flow-pressure cocflicicnt. pressure 
sensitiviiy), pressure sensitivity curves and dynamic charac¬ 
teristics of servovalves with the aid of Bode diagrams ll 
would fit perfectly in chapter H and would make the book 
even more valuable as an "introductory” university course 
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Random Signals and Systems’ 

Richard E. Mortensen 


Reviewer: J. F. BARREIT 

Department of Mathematics and Statistics. Paisley C ollege of 
Technology, Paisley. Renfrewshire PA12BE. Scotland, 
UK 

Thh PURPO.Sfc of the book as slated in ihc preface is to serve 
as a textbook at the University of California ai Lx>s Angeles, 
for either a senior level undergraduate introductory cour.se in 
stochastic processes or for a first year graduate level 
follow-up course. These courses are prerequisites for 
graduate courses in control and communication systems 
engineering 

For the rcquircmcni of the undergraduate course, the 
book aims to bring computcr-oricnicd students, familiar 


• Random Signals and Systems by Richard E. Mortensen 
Wiley, Chichester, (1987); hardback and paperback editions 
available. ISBN 4718 43644, £31.4(1 


mainly with discrete rnalhematicK, lo grips with the more 
abstract style of mathcmalics used in current electrical 
engineering rc.vcarch Such students will follow chapters 2, 4. 

6 fi.c Gaussian disiribulion.s, discrete random sequences, 
Gaussian pwesses, filtering, fxiwcr spectra) with a selection 
from other chapters (eg multidimensional (laussian 
distributions, Volicrra senes, Markov processes) 

For the requirement of the graduate course there is, in 
addition lo this, material on applications of Hilbert space 
theory to random variables and Ihc Karhunen-IxKrvc 
expansion (Hclsirom, 196(1). which serves as a preparation 
for a more thorough course in measure theory and functional 
analysis Supplementary topics such ^is estimation theory and 
state-space theory are available 
Tbe b<X)k IS planned to include a range of topics for 
flexibility (a ".smorgasbord” as the author puls it) with 
illu.straiions taken in the main from radar and communica¬ 
tion theory, ll is written in an informal and discursive style to 
help maintain the students' attention. Exercises arc available 
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at the end of the chapters though without an«wcrfk. A 
detailed analysis of the contenu folium. 

In Chapter 1, DiurusuKion of Probability and Stochastic 
Proceuiei. the basic ainceplK of probability arc assumed to 
be partly familiar to the student from a previous course 
According to the preface this chapter does nut form part of 
the cMcntial course material and .so presumably is 
background material to be used at the lecturer's discretion. 

The normal abstract definition of probability is given as g 
trio (U, j4, P) consisting of a sample space U, an algebra of 
admissible subsets s4 and a probability measure P over ji. A 
slight notational ambiguity is present in that no distinction is 
made between a set and the event that a random variable 
takes a value in that set. The following vection.s introduce the 
basic definitions of probability theory in a concise and clear 
way. An interesting feature is the introduction of the Hilbert 
space of random variables which gives a geometrical insight 
into the abstract concepts. 

'I'he final section gives the basic dcfiniiion.s for a random 
process, a Markov process, and a Gaussian priKcss. Iliis is 
rather jumping ahead and these definitiun.s would fit more 
naturally into later chapters. 'Hie definition of a random 
process as a family {X,\t^T] of random variables all 
defined on the same probability trio (£2, P) is inadequate 
(strictly speaking of course), the probability distribution 
being required over the whole prixJud space 

In Chapter 2. The Guu.ssiun Distribution in One and Two 
Dimensions, after recalling the mam facts of the one 
dimension distribution, the two dimen.sionul density function 
is quoted in terms of its covariance matrix f, j and its inverse 
.iij. ITic remainder of this short chapter works out, in a 
numerical ease, the integral of the two-dimensional density 
function over the p«isi(ivc quadrant, the object of the 
exercise being to provide practice in important elementary 
techniques such us completing the square and the use of 
polar coordinates. 

Much basic material has been omitted. The student has 
presumably met simple least squares and regression 
previously. Should this not now be put into context with the 
two-dimensional Gaussian distribution which would also 
clarify (he role of the conditional probability density function 
and prepare the ground lor the more complicated 
multidimcn.sional ease treated in (he next chapter? The 
Pearson normalized corrclulion coefficient p in terms of 
which the two-dimensional density is most frequently 
exprCvSHcd is nowhere mentioned. Surely also it is worthwhile 
to calculate the characteristic funciion (for both tine and 
two-dimcnsionul ciises) and make use of it to lind moments. 
'HiivS is in fact done in a piecemeal way ihroughoul the bimk 
in the exercises Another relevant topic would be the 
sSymmciric two-dimcn.sional distribution and the associated 
Rayleigh distribution—very important in communications 
and also used in tbc FOR TRAN program of Appendix 2 

C'haptcr .1 is titled The Multidimensional Gaussian 
Distribution. It deals with the multidimensional den.sity 
function, the bivariate ease, and the Bayesian estimation 
theory, and provides optional extra material. 

The multidimensional density having been defined, it is 
shown how the Gaussian quadratic form may be reduced to 
diagonal form using the transformation of Ap|xmdix 1. The 
chapter continues with ii.s main idea which is the derivation 
of the conditional density function /(.v/v) fur a bivariate 
Gauasian vector (.v, y). I n this end there is given a detailed 
derivation of the inverse of the bivariate covariance matrix 
using a matrix extension of the Gauss-Jordan method, 
well-known in elementary numerical analysis. 

This is certainly an interesting, easily understandable, and 
stimulating exercise extending the scope of known methods. 
It is however quite lengthy and should perhaps give way to 
more essential material. A byproduct of this calculation is 
the Matrix Inversion Lemma, well-known in Kalman theory. 
Tbc calculation is then used to complete the compulation of 
the conditional density f{x/y) and so finally to find 
conditional mean and variance to be used for Baye.sian 
estimation. 

Bayesian estimation is treated in the next section. The use 
of the word "Bayesian" is nonstandard, an estimate 


^ of one random variable in terms of another being 

called Bayesian in view of the fact that X and Y are taken to 
be both random with a joint density function ffX, Y). Surely 
the point of [he Bayesian view is (hat X is estimated, not by a 
single value X but by a probability distribution? Tlic single 
value estimate occurs in the point estimation theory of R. A. 
Fisher (1925) proposed as an alternative to the Bayesian 
theory. The book is therefore using a hybrid version of these 
two theories 

The chapter continues with determination of the optimum 
estimator to minimize a loss function L(X-X) of the 
estimation error X - X, the most important ease being that 
when the loss function is the Euclidean norm giving the 
Minimum Mean Squared Error Cnicnun. Tbe known result 
is then proved that the optimum MMSE value of X given Y 
I.S the conditional expectation of X given Y. The prcnif is by a 
nonlinear extension of the aimpleiing-the-squarc technique 
which is more incisive than the common calculu.s of 
vanations method. 

The final part of the chapter deals, very briefly indeed, 
with the all important Gaussian ease where we find the 
standard multidimensional regression formulae (although 
they arc not called by this name) I'his approach bypasses the 
conventional least-squares theory which is unfortunate in 
view of its importance and the fact that it ties up .so well with 
the Hilbert space emphasis of the htnik 

Chapter 4 di.scusses Finite Random Sequences. According 
to the preface, it forms one of the core chapters. It aims to 
introduce computer-oriented students to the concept of a 
finite Gaussian sequence in a way suitable for the computer 
generation of such sequences. The two main sections have 
the titles "'Hie Successive Viewpoint and “The Simult 
ancous Viewpoint’’ The first has in mind the successive 
generation of values of inde|>cndcnt Gaussian random 
variables and the formation of their linear combinations, i c. 
it leads towards the concept of filtered Gaussian white noise, 
which is then drscussed, its values being thought of a.s being 
generated by the algorithm given in Apfumdix 2 (which is 
actually of course, (iscudo random) 1 he notion of an 
ensemble of pos.siblc realizations is considered and finally it 
is shown how u Ciaussian sequence having :i given covariance 
matrix (’ may be generated by faciori/ing C in the form 
LDL* as in Chapter 2 using the values of /.. which is lower 
triangular, for multipliers of the while noise for causal 
generation of the required sequence. Ibe following .section 
introduces the contrasting “simultaneous viewpoint" in 
which the sequence is viewed as a whole and represented by 
a random vector having a given mean and covariance matrix. 
In this way the student has been prepared lor the concept of 
the infinite random vector i.c. stochastic process, discussed in 
the next chapter 

This is a novel approach to the teaching of random 
pr(K*csscs suitable for a mathematical laboratory class. It is of 
course limited to Gaussian sequences and it should be 
cmpha.sized that other processes exist The Gauss-Markov 
procc.ss and autoregressive scheme would have fitted rather 
naturally into this chapter; they arc mentioned later. The 
insertion of a few graphs would aid (he imagination. 

Chapter 5, Stationary Random Sequences, deals with 
discrete-time random prcxcsscs. m particular linearly filtered 
white noise and its second-order properties of covariance and 
spectrum. 

Ibe previous chapter has prepared the way for the 
definition of a random priKess as an infinite vector 
There follow the usual definitions of mean and covariance. 
For a stationary process the covariance becomes the 
autocovariance function of the time difTcrencc. An extended 
example discusses the properties of filtered white noivSe 
including calculation of output autoawariance and, for more 
than one process, cross-cxivariancc. Power spectral density is 
defined by the direct method as the Fourier transform of the 
auUxxivanancc function, its positivity being demon.stratcd by 
a quotation of Bochner's (1932) theorem. After a digression 
on aspects of linear system theory, input -output relations for 
spectral densities are derived and finally the spectral 
factorization of rational spectral densities is discussed. 

All this calls for little comment except possibly for a 
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remark on the deAnitkin of spectral density The definition 
by Fourier transformatiofi of auiocovariancc function doc* 
not make clear either the phenomenon of aliasing or the 
signihcancc of spectral density for the analysis ol signal 
records. Since the hook inicnds. according io ihe preface, to 
provide basic knowledge for signal procTessing, some 
explanation of these very important ideas would be in order 

Chapter 6—ConiinuouS'Tlmc Stationary Gaussian ami 
Second Order PrcKcsscs—extends the concepts of the last 
chapter to continuous-time systems It makes sense 
educationally to treat the discrete case hrsi as the dchnitton 
of the continuous-time process can readily be accepted once 
the discrclc-timc pniccss has been umlcrslood ITicse follow 
sections on the definition of second-order quantities 
including spectral den.sily. the Ijiplace tTan.sform and linear 
systems, and input-output relations for linear systems 
leading to those for spectral densities After a note on the 
Palcy-Wiencr criicrion, there follow sections on crgodiciiy 
and the frcquenc)' interpretation of power for finite signals 
All this is rather standard The interesting topics for 
comment arc spectral density and crgodiciiy. 

Power spectral density is dctinctl, as m the discrete time 
case, directly as the Fourier transform of the autoci>variancc 
function, its positivity being demonstrated by quotation (d 
BcKhncr's (1W2) theorem. Iliis is the mclKml of dclinilion of 
Khinchin (1931) and m usual in the mathematical statistical 
literature. In electrical engineering the traditional detinition 
i.s ba.sed on the frequency analysis of rccord.s of length T as 
7'—This IS C’arson's method used later by Rice. 
Middleton and closely related to Wienei's work Although 
less tidy mathematically than the Khinchin mclhixj, it does 
have the advantage of relating s^'icciral density to frequency 
analysis of data records Getting back to the ( arson 
definition from the Khinchin definition is not very difficult 
but is a “must ' in view of the importance of the frequency 
analysis mterprclalion for signal analysi.s 

The section on crgodiciiy makes difficult reading In view 
ol the b<K)k’s method of introducing random processes 
through computer algorithms a quite sugge.stive picture of 
the typical crgodic behaviour could no doubt have been 
given by considering the behaviour of simple numlwr* 
theoretic algorithms of the type used to generate 
pseudo-random .sequences. The traditional treaimcni of 
crgodiciiy in mo.st textbooks is certainly not especially 
enlightening and. as a result, the lopic ol crgodiciiy usually 
has an air of mystery The thoughts on this subject originutc 
mainly from the Wiener l.ee school ai M I T Wiener 
himself was much concerned with the mm hematics of 
crgodiciiy and his ideas on the subject (notoriously difficult 
to follow in the original!) have passed into folklore The 
reviewer believes that the significance of his ideas is 
commonly misinterpreted For it is implicit in Wiener's work, 
even if it is not slated in so many words, that the non.singular 
stationary Gaussian priKCss, i c hitcred stationary while 
Gauiisian noise, is in fact ergodic being derived from 
Brownian motion This being so, the ergodic assumption is 
only necessary in other situations, e g. when the Gaussian 
theory is applied to processes with assumed second-order 
stationarity. Since the theory deals so much with nonsingular 
Gaussian pr(x:csses (as in this bwik) the crgodic assumption 
IS usually unnecessary 

Chapter 7, Nonslationary Continuous-lime Processes, 
describes slate-space rcprc.sentation and its extension to ihe 
nonstationary case, an extension which, as is known, goes 
through with ease. 

Firstly, a linear system having rational transfer (unction 
His) is represented by equations in state-space form whose 
solution is denved The general time-varying state-space 
equations arc then formulated and solved. The cxpt>si!ion is 
somewhat brief. Some of the basic facts about systems of 
linear dififerential equations would have been relevant 
leading to the semigroup property used in the derivation 
Turning to the noise case there is given a detailed calculation 
of output covariance matrices for white noise input. T'hc 
calculations aivcr 34 sides and although quite .standard they 
would doubtle&s look formidable on first encounter by a 
student. They could well be simplified with quotation of 


some of the equations wnce no appftcatkm %% made of them 
In fact some Ulustratnm is needed to motivate Ihe equations 

Chapter 8—AddilKinal Topic* in the Study of l?oniinuous- 
Time Processes—is descried lo cxpuimons of lime functiom 
on a finiic lime micn^al and ihcir applicalians with emphasis 
on the use of llilhen space ideas IV two types of expansion 
considered are those of Karhunen-l^ievc and Fimricr Ilie 
chafucr slam with a description of the Hilbcri space of 
functions on a finite time mlers^al with a cimcise explanation 
of the idea oi a self-adjoint integral operator. TIh^sc ideas are 
applied to the Karhunen-Loeve expamuon and illustrated by 
the case of Brownian motion which actually results in a K T. 
expansion which is a Founcr sine aeries A more inleresiing 
case IS provided by the Gaus^s-Markov prmess which is 
briefly intRiducrd as an example at the end of the chapter 
Aftci .some further discussion between the K-L expansion 
and Ihe Fourier expansion, the Uieoretical ideas are 
illustrated by Ihe impiuiiinl example of dcaHlmg a binary 
sequence in noi.se A further illustiation of ihe K I 
expansion discu.s.scd is the work of Landau uiul PolliKk 
(I%1) relaiing lo the time frequency uncenuinty priru'iplc 
where the kernel in Ihe K L iniegial equiiiion is Ihe sim 
function 

The earlier part ol the chaptci rends very well, the section 
on the seli-adjoint operator l>cing especially well done The 
two illustraiionN however need careful following, the fii*l 
l>eing decidedly technical and the streond of necessity 
omitting all details Ihe use ol communication problems lo 
motivate and iJIuslriite Hiltvert spnec ideas is one of ihe 
appealing aspects ol the liook 

('hapicr 9. linear Systems in (dnjuiu.iiA^n with Memory- 
less Nonlinear Devices, deals wiih ideas originating in radar 
signal detection, the mam part discussing the inlriHluction of 
instantaneous nonlinear operations into linear systems 
theory, and the remaining part the iiidar uncertainty 
principle. Ihe chuptei Marts with the description of the 
recovery of an amplitude modulated signal by u S 4 )uarc-law 
detector followed by a lineiu low-pass filter Lhe theory is 
given lor the deterministic case and then the sliK'haslic ciisc 
is considered Here there is a curious error It is staled that 
wc run into trouble if. with M{t) as a stiitionary mevsiigc 
process, we try to take the spectrum of a process 
(1 f A7(/)) cos rj>r because it i.s nonslationary Now the same 
criticism would apply to a single sinusoid which certainly 
pos.sc.sses a spectrum; the trouble is due not to 
nonstalionanly but to nonergodicily Wc mu.si work with 
lime averages- when this is done, the troublesome term 
cos luj r ct>s tu, m equation (4) of page 147 becomes 
time-averaged to give i cos ni, (r .v) Ihcn taking the 
spectrum wc find Ihe double hum|>cd form which is derived 
in the further development by Ihe ad hix assumption ol page 
I4H *lhc account given in pp IM) l‘)2 could no doubt be 
simplified 

The difficulty of finding output probability density when 
nonlinear operations are present leads on lo the topic of 
Wiener-Vollcrra senes which is illustrated by the previously 
discussed square-law detector and then more generally by the 
miHlel ol a linear system followed by a mcmorylc.ss 
nonlinearity, with expressions for the kernels in the case of a 
.saturating nonlinearity A Mimcwhal more interesting 
illustration would have arisen in the standard representation 
for a receiver—linear system plus memorylc.ss nonlincuriiy 
plus linear .system. 

The remainder of the chapter dcal.s with ideas due lo 
Gabor (194fi) and others on complex signal reprc*ciilalion 
and the radar uncertainty principle The Hilbert transform 
theory used here is tricky even for the expert and in 
attempting generality the book fails to give a readable 
account. The suitability of this subject must Ik open to 
doubt The actual derivation of the radar uncertainty 
principle is however quite Htraightlorward given the 
possibility ol complex prcsciHalion 

Chapter 10, Nonstationary Random Processes, deals with 
the Ciau.ss-Markov proce.ss. generalizing it succcsHively from 
scalar to matrix case and from .stationary to nonslationary 
case. The scalar c^sc with which the chapter starts cxiuld well 
have been discussed earlier in Chapter 4 where it logically 
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belongs. The interesting fact about it for the present chapter 
is the posHibilily (»f putting it m matrix form which leads on 
to the generali/.ation to vecior-valucd .sequcnce.s Tliis is used 
to mjIvc the general recursive difference equation and to 
calculate means and covariances, llie .state-space equation 
with white noise forcing is linally discussed in its time-varying 
form. The chapter is quite straightforward: it is systemati¬ 
cally developed and well written. It only lacks some 
interesting illustration of the theory. 

In Chapter II, Discrete-fime Kalman Filtering, the stated 
aim is to give an initial acxjUHintancc with the Kalman biter 
without going into all details or its C4imputer implementation, 
as well as to introduce some related concepts. 

The problem is formulated in general terms for a scalar 
message process The LDl/ factorization algorithm of 
Appendix 1 applied to the covariance matrix ol the sequence 
of observations is used in it.s recursive, form to calculate the 
innovation corresponding to a new observation From this 
the updating half of the Kalman theory follows. The other 
half, the propagate formula, follows in the usual way from 
the Markov model There follow some further comments on 
the LDI.^ factnrizution in sequential form and on the 
Kalman filter equations, the standard formulae for the 
difference equations for the covariance matrices being 
derived. 

The use of the lT)l/ iransformaiion makes this an 
interesting nonlraditional approach though limited to a scalar 
message process. It might be expected to have computational 
advantages over the normal approach hut these are not 
mentioned. Perhaps it would have hclpK:d to have clarified in 
detail the relation of the method to the traditional 
orthogonal projection method, especially in view of the 
Hilbert space interest of the book. As u lirst acquaintance 
with the Kalman filter this chapter would he tough going. 
The Kalman filler is not un easy thing to understand In 
teaching it there is much to he said for following the 
traditional approach illiistraled by simple examples and not 
avoiding numerical illustrative examples which can help to 
give tin initial understanding 

Of the Appendices, the first proves that a positive definite 
symmetrical matrix (' can he rcpre.senled as LDl/ where L 
is a unique lower triangular matrix having 1 on the mam 
diagonal Moreover the factori/alion of C into this form can 
he performed .sequentially T he result is a generalization ol 
the known faclohzalion into upper and lower triangular 
matrices. It is a useful result for systems analysis which does 
not appear to have been emphasized el.sewhere, 

The .second appendix collects together a numher of 
Statistical ideas of use in the text such as a FORTRAN 
program for Ciuussian random numbers, parameter estima¬ 
tion, statistics of estimators, and the numerical results of a 
computer experiment. 


Overall eifaluatlim: On the paxiUve side the h<»ok tv an 
attractive one both in its material and its production. The 
topics dealt with are well chosen and are described with a 
minimum of detail. Each chapter a adequately provided with 
exercLses. The publishers ha\>e done a f^ood job and the book 
o nicely produced, particularly the hardback version. Tor the 
courses it is intended to roirr the book may well be popular 
succeeding in stated aims. On the negative side the hook 
could be criticized for a tendency towards an abstract 


mathematical style of presentation with few diagrams or 
graphs and tn.tuj(^rifnJ i/Ziiffrarioru of some of the theoretical 
ideas. The nu}re straightforward topics of the core syllabus of 
the book are well explained but some of the additional topics 
are written in a manner which is difficult to follow. Another 
criticism which can be aimed at the book is that it skims otter 
basic standard material in favour of pursuing novelty of 
approach Thm the treatment of the bread-and-butler" 
two-dimensional Gaussian distribution is brief and sketchy 
whereas the multidimensional Gaussian distribution is treated 
in some detail including an unusual extended calculation of 
the iniferse of (he bivariate covariance matrix. Simitarty, 
ordinary statistical prtKedures are replaced by new methods 
using the diagonalization algorithm of Appendix 1. .S'lnre the 
student will need to know the simple unsophisticated 
procedures later in his or her career, the wisdom of following 
unusual or nonstandard methods in teaching degree courses is 
open to question. 

The .style and philosophy of the hook reftecis in some 
measure current trends in teaching. It o quite usually 
considered that the amount of material which a student might 
ideally be required to be familiar with nowadays is so 
extensive that limitations of time {and the students' patience) 
make it impossible to cover everything in a systematic 
step-by-step way. So there is a tendency towards a less 
detailed, informal presentation aimed at touching on recent 
developments. This runs the risk of not ghfirig the thorough 
grounding in fundamentals which o essential for good later 
work In the reviewer's opinion it us important to try to 
achieve a synthesis of the clear and systematic presentation of 
the best of the older hooks with the livelier presentation of the 
more recent ones. 
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A Practical Study of Adaptive Control of an 
Alumina Calciner* 

P. M. MILLS.t P. L. LEE* and P. MciNTOSHt 

An adaptive pole-placement controller has been applied to an industrial 
alumina calcination process, and it has been found that this control method 
has reduced temperature variations by three fold and reduced overall 
energy consurr^lion. 

Ktty Wordi —Adaptive control; alumina pn>ccssing; calcination; polc-placemcnt. 


AbstnicI —This paper outlines the successful application of 
Advanced Process Control mcthixls in an industrial 
environment. The control strategy incorporated conventional 
regulatory aintrol techniques, dead-lime comt>cn&ation and 
an explicit polc-placcmcni self-tumrig control algorithm 
Application of this .strategy to control an alumina calcining 
kiln i.s successfully dcmon.stratcd. Success is demonstrated 
not only by improved regulatory behaviour, but in terms of 
operator and engineering acceptance and on going use of the 
control strategy. 

I INfRODUCTION 

Thp nhed to improve efficiency of process 
industries is well recognized. Recent studies 
(Marlin et al., 1987) have shown that application 
of Advanced Process Control is one available 
tool to “make more with less'’ with good 
economic return. Typical returns have been in 
the order of 5-10% of annual production value. 
Availability of modern distributed control 
systems, often in conjunction with process 
computer systems, has made technical applica¬ 
tion of advanced control methods feasible. 
However, process industries in general have 
been slow to utilize this increased capability 

Adaptive control has probably been ihe topic 
most written about, academically, in control 
literature in the past 15 years. TTie field is rich 
with different approaches for parameter iden¬ 
tification, controller design, maintaining signal 
excitation and numerical techniques. However, 
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despite this richness, few industrial applications 
have been re|K)rlcd in the process industries that 
have passed the so-called “12 month lest" 
i e. the controller is still opcraling 12 months 
after being commissioned and is being main¬ 
tained by normal operating and instrument 
personnel—not the development team. A review 
of published applications was given by Scbi>rg el 
al, (19K6). The ability of an adaptive amlrollcr 
to adapt to changing prtKCss behaviour, 
particularly changes caused by the underlying 
nonlinearity of many prtKCsscs, makes the 
adaptive approach appealing However, so few 
successful industrial applications arc reported in 
the open literature that the processing industries 
are collectively “nervous” about applying such 
“modern’’ techniques to their plants. Only the 
economic incentives mentioned previously and 
reporting of successful applications will change 
this situation. 

This paper describes one such successful 
industrial application of adaptive control. It 
highlights some practical issues in application of 
such methods in an industrial environment and 
reports the economic improvement obtained in 
using such approaches. TTiis paper docs not 
provide a new theoretical insight but rather 
describes a successful application of academically 
e,stablished techniques 


2 THE APPLICATION 

Queensland Alumina Limited (OAL) opcratcf 
an alumina refinery at Gladstone. Queensland 
based on the Bayer process. Maximum plan 
capacity is 3,(XK),(KK) metric tonnes of alumina 
per year. The process extracts alumina froir 
bauxite by dissolution in caustic soda. The fina 
phase of production is the drying and calcinin^ 
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of the alumina to remove free and chemically 
bound moiature by the application of heat in a 
rotary kiln. Ilie alumina enters the kiln at the 
cold end and passes along the kiln counter- 
current to a stream of hot combustion gases. 
These combustion gases are produced at the hot, 
end by burning oil in several burners. A scries of 
exothermic and endothermic phase changes take 
place as the alumina passes along the kiln. OAL 
uses 9 kilns operating in parallel to perform this 
process step. 

Operation of the kilns requires the calcination 
of alumina to meet product specifications while 
minimising energy consumption and main¬ 
tenance costs. Product spccihcations are met by 
controlling kiln temperatures, while energy 
consumption depends on operating strategy. 
Increased maintenance costs result from poor 
operating stability. In particular kiln refractory 
damage is caused by large temperature 
fluctuations. 

Product quality can be directly related to Loss 
on Ignition fLOI) and Specific Surface Area. 
Both are laboratory measured parameters that 
are unfortunately only available every 8 hours, 
and hence not suitable for on-line process 
control. LOI is itself greatly influenced by the 
maximum temperature the alumina attains while 
in the kiln. Unfortunately this also cannot be 
measured directly as the maximum temperature 
occurs part way down the kiln and changes 
location depending on operating conditions. 
On-line control consists of maintaining the 
Hot-End Temperature (HET), i.e. the tempera¬ 
ture of the alumina at the discharge of the kiln, 
constant. 

vSecondary objectives of kiln operation are to 
minimize energy consumption by ensuring 
optimal combustion, and to minimize tempera¬ 
ture fluctuations to maximize refractory life. 

Auxiliary measurements include the Cold-End 
Temperature (CET), and flue gas CO and O 2 
measurements. Manipulated variables include 
the kiln feed-rate, oil mass flowrate and kiln 
draft (the air flowrate). 

Control equipment consists of a Bailey 
Network 90 Distributed Control System inter¬ 
faced directly to a Data General MV 8000 
minicomputer. Application software in the Data 
General computer allows monitoring and reset¬ 
ting of parameters in the Bailey Multi-Function 
Controllers. 


3 CONTROL STRATEGY 
Until 1984 the kilns at the OAL plant were 
manually controlled. The only automatic control 
consisted of primary regulatory flow control of 


both hydrate feed and oil rates. During the 
period 1984 to 1986 a combination of single-loop 
Proportional-Integral (PI) control loops and 
feed-forward compensators were installed using 
the Bailey Network 90 system. A diagram of the 
kiln with the original control scheme is shown in 
Fig. 1. 

Although this control system provided stable 
control of the kiln, the following deficiencies 
were observed: 

(a) Recovery after process upsets or load 
changes was very slow. The hot end 
temperature control took approximately six 
hours to settle following a process upset, 
compared with an open-loop time con.stant 
plus time-delay of 30 minutes. 

(b) The fixed tuning of both the hot-end and 
cold-end temperature control loops resulted 
in poor control at low throughput or low 
kiln rotational sp>eed. This is due to the large 
increase in transport delay through the kiln 
which results from these conditions. 

(c) The control loops tended to be poorly tuned 
because of the difficulty in tuning very slow 
loops when uncontrolled disturbances are 
frequent. 

(d) Poor hot-end temperature stability resulted 
from a cold-end temperature controller 
suffering from a non-representative tem¬ 
perature probe position and sensitivity to 
unmeasured disturbances from sources such 
as gas dust content. 



F/F - FEEDFOnMiSRD ELEMENT 
SET - SETPOINT 

Fig. 1. Initial control scheme. 
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(c) The interaction between oxygen and cold- 
end temperature loops which was relieved 
by special tuning techniques, forces any 
re-tuning to be done on a kiln basis rather 
than individual loops. This made initial 
tuning and tuning maintenance time- 
consuming. 

In 1987 work began on development of an 
advanced control strategy to overcome these 
deficiencies. The kiln chosen for this study is a 
GATX-Fuller rotary kiln of 3.66m diameter. 
99 m long, generally rotating at a fixed speed of 
Ir.p.m. The kiln capacity is approximately KXX) 
tonne per day. Heat recovery exists only from 
the product at the hot end, not on the flue gas at 
the cold end. 

The general structure of the advanced control 
strategy is shown in Fig. 2. The important 
features of this strategy are: 

(a) The cascade CO-O 2 control strategy to 
maintain combustion efficiency. The inner 
O 2 controller includes a Smith Predictor 
(1957) for compensating the inherent dead¬ 
time in this loop. 

'b) A self-tuning pole-placement hot-end tem¬ 
perature controller adjusting hydrate feed 
rate. This controller is discussed in more 
detail below. 

(c) Operator-set oil mass-flow adjustment which 
effectively allows the operator to set 
throughput for the kiln. It was found 
necessary to adopt this strategy rather than 



hydrate I 


OIL MASS FLOW 


SET 


-! H E T -- 

CONT., 

SELF-TUNING 
POLE PLACEMENT 
CONTROLLER 


KILN 



DRAFT i 

1 


flue oxy 


FLUE CO 



t 


BET 


LCONTj 


SMITH PREDICTOR 

F/F - FEEDFORWARD ELEMENT 
SET - SETPOINT 


SET 

CO --) 

CONT,, 


Fio. 2. Revised conlrol scheme. 


allowing the operator to set the kiln feedrate 
directly and controlling the HET by the oil 
flowrate. This was done because complex 
interactions within the kiln can cause the 
open-loop gain of a HET-oil loop to change 
sign as a function of operating conditions. 
This obviously creates serious problems for 
any control strategy employing this am- 
figuration. However, the open-loop gain 
hetween the oil flowrate and the peak 
temperature attained in the kiln (and hence 
LOI) is always positive, always allowing the 
operator to increase the hydrate setpoint 
following an increase in the oil flowrate. 

(d) Feed-forward compensation from both ad¬ 
justments made in the kiln feedrate and oil 
flowrate to the draft controller. 

3.1. 5>//-funing controller 

An explicit pole-placement self-tuning con¬ 
troller as developed by Wellstead el al. (1979) 
was used for the HET controller. This controller 
uses as its basis a process model of the form: 

(1 4A(Z M).v(f)-/?(Z *)«(() 4-e(r) (1) 

where A( ) and B{ ) arc [K>lynomials in the 
backward shift operator Z ^ of order a and h 
respectively, y(0 is error in the HET 
(setpoint-measurement), u(r) is the process input 
(kiln feed-rate), e(f) is the model error. 

Dead-time in the above process model is 
included by increasing the order of the B 
polynomial and setting the appropriate leading 
coefficients to zero. The regulator takes the 

form: 

(WF(Z ’))u(r)-C;(Z ■)y(/) (2) 

where polynomials F and G are of order / and g 
respectively. 

ilic pole-placement algorithm requires selec¬ 
tion of F and G such that the clo-scd-kMip pole 
locations are located to desired values as 

.specified by the polynomial 

] -^r(z ') (3) 

where T is of order t. By combining equations 
(1). (2) and (3), the following identity is 

obtained: 

{1+A(Z ■)}{1-HF(Z ')} 

- B{Z~')G(Z~')=l+ r(Z '). 
Important constraints are 

g = fl - 1 

f=b-\ 
t<a + b 

A solution of the above identity given A , B and 
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T polynomials is required at each sampling 
interval A matrix approach to this problem is 
outlined by Wcllsiead and Prager (1985). Gauss 
Jordan elimination was used in this application 
and proved sufficiently reliable. 

Controller design was achieved by specifying 
the closed-loop bandwidth (B) and relative 
damping (D). Given these two specifications, 
Wittenmark and Astrdm (19K4) have shown that 
the order of the T polynomial is 2, and that. 

r,--2c 

and 

A damping factor of approximately 0 7 and 
bandwidihs between 0.25 and 5 radians/sample 
proved satisfactory for this application, with a 
bandwidth of 1.5 radians/sampic finally chosen. 

Recursive least-squares parameter identifica¬ 
tion with a forgetting factor was employed to 
provide on-line estimates of the A and B 
|x)lynomial parameters. The UD factorization 
method (Bicrman, 1976) was u.sed in the 
co-variance update to improve numerical 
accuracy, 

3.2. Impiementation issues for the self-tuning 
controller 

Implementing a .self-tuning controller in an 
industrial environment raises a number of 
practical issues. Among lhe.se arc: 

(u) Hardware implementation strategy. For 
reasons dominated by reliability it was decided 
to implement live control law using a sampled 
data control algorithm available in the Bailey 
Network 9(1 .system, and the adaptive strategy on 
the Data General MVH(KK). This also allows the 
adaptive strategy to adapt several loops simul¬ 
taneously using the same software. 

(h) Sample time. Choice of an appropriate 
sampling lime is governed by the dynamics of 
the prtKcSsS and the desire to keep the number of 
coefficients in the identified model suitably 
small—approximately 5 for each polynomial Six 
minutes proved suitable for this application. 

(r) Sample filter. The procedure of sampling a 
continuous signal can introduce problems of 
aliasing as discussed by Aslrbm and Wittenmark 
(1984). Careful consideration of the process and 
measurement system must be taken into account 
in designing an anti-alias filter. For example, in 
this application it was determined that the HET 
thermocouple probe mounting contributed an 
equivalent first-order lag of two minutes. The 
required time constant for an anti-alias filter for 
a sample time of six minutes is approximately 


four minutes. Hence the required additional 
filter is approximately two minutes. 

(d) Scaling. Engineering unit ranges of the 
input and output variable are considerably 
different. To obtain more reliable parameter 
estimates, scaling of the differenced HET 
samples was used to make the ranges nearly the 
same. 

(e) Model order. The model order of the A 
and B polynomials has an important impact on 
computational load of the identification algo¬ 
rithm, rising as a square relationship with the 
total number of parameters. Model order is also 
dependent on the chosen sample time. High 
order models of course offer the advantage of 
greater modelling accuracy, and thus a com¬ 
promise is required. Model orders of 4 and 5 for 
the polynomials A and B respectively were 
chosen for this study. These model orders were 
obtained experimentally from simulation of the 
regulator with inverse response models (as is the 
fecd/HET transfer function), and during actual 
kiln trials The high order of the B polynomial is 
necessary for the inverse response while the 
order of the A polynomial combined the actual 
process order with the external integrator 
compensation plus the implicit noise model 
order (Wellstead et al., 1979). 

(/) Model validation. To provide some 
protection against an upset-corrupted model and 
to allow an automated start-up of the regulator, 
an algorithm which checks for model validity was 
added. This is an OK/NOT OK check. If NOT 
OK, the regulator design uses a back-up set of 
controller parameters. Criteria used for this 
check were: 

-1.5 < fl , ■ -f fl4 < ~ 0.5 

and 

0.1 <6, -f ■ • ’ 4 */)s<2.0. 

The first criteria ensures that the identified 
model is relatively stable (Ia, ===l) while the 
second criteria ensures that the steady-state 
model gain is “reasonable’' (Zb, =^+1). The 
back-up controller constants were 

/.=/ 2 = -=/4 = 0 

scaling factor 
^ 

(^) Forgetting factor. The exponential forget¬ 
ting factor used in the recursive least squares 
algorithm was set to 0.99 for this application. 
This represented a reasonable compromise 
between steady-state accuracy and speed of 
adaption. 

(7i) Signal excitation. During periods of good 
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control, little infonnation is available to the 
identification algorithm. To avoid parameter 
“explosion”, a dither signal was constantly 
added to the controller output signal. This dither 
signal was a square wave with constant 
amplitude but randomly selected period. 

(0 Setpoint rate-of-change. Large changes in 
HET setpoint would be observed by the 
identification algorithm as a sudden unmeasured 
disturbance with the potential for introducing 
model errors. As the primary purpose of this 
controller is to act as a regulator, servo resptrnse 
was limited by placing rate-of-change limits on 
the setpoint. While a multi-input, single-output 
identification procedure could have been used to 
overcome this problem, the performance re¬ 
quirement and the fact that setpoint changes 
occur infrequently justified this simple approach. 

(/) Pretune. To enable rapid initiali/.ation of 
the controller and a fast recovery after model 


corruption, a rapid pre-lunc mode was de¬ 
veloped. When the controller operated in this 
mode, the dither signal amplitude was increased 
to three times its nonnal value and the 
exponential forgetting factor was set to 0.95. The 
control algorithm used back-up parameters 
during this phase until the model validation 
criteria was again satisfied. 

The overall controller algorithm structure is 
shown in Fig. 3. 

4 (ONTROl PBKFORMANCr* 

4.1. Combustion control 

Improved performance of the CO control 
strategy incorporating the dead-time compen¬ 
sator is shown in Fig. 4. This clearly shows 
reduction in oxygen content in the stuck gas 
achieved because of the higher setpoint on the 
CO controller. This achievement was due to 
reduced variation in the oxygen mcasua*mcnl 
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also evident in Fig. 4. The remaining variation 
with a dominating apparent period of 1 minute is 
probably caused by the kiln rotation of the fresh 
and variable moisture hydrate feed. Improve¬ 
ment may be achieved by a slight detuning of 
this control loop. 

4.2. HET control 

Improved performance of the HET self-tuning 
control strategy is shown in Fig. 5 which shows 
that the histogram of HET has been narrowed 
and the mean shifted to a more central position. 
Thi.s is confirmed statistically as is shown in 
Table 1 which also shows that at a 99% 
confidence level the mean and standard devia¬ 
tion have changed. 

'Fhe histograms shown in Fig. 5 were 
established by collecting HET values at five 
minute intervals for 3 months prior to the 
installation of the control strategy (26,(KX) 
values) and one month after the strategy was 
implemented (HfXX) samples). Data was collected 
continuously during these periods with no 
distinction made between periods of automatic 
and manual control. It was estimated that the 
control strategy was in automatic mode for 95% 
of the time, with periods in manual control 
generally attributable to equipment maintenance. 


Tabij- I. ImphovedHET cx>ntrol 


Characteristic 

Before 

After 

Statistic 

99% 

Confidence 

index 

Mean (“C) 

5.9 

1.7 

1 «6.13 

2.33 

Standard 
deviation ("C) 

55.4 

47.4 

1.17 

1.025 

% Within 
+3(rc 

55.1 

71.5 




To confirm that improved control performance 
could be attributed to the advanced control 
strategy, a comparison of HET control before 
and after the new strategy was implemented on 
the trial kiln was conducted on other kilns of the 
same type (Fig. 6). This indicates that no 
external effects can be responsible for the 
observed improvement. 

Other kiln improvements include: 

(a) Improved overall kiln stability leading to the 
expectation of reduced energy consumption 
and more consistent product quality. 

(b) The HET regulator is capable of making 
large prompt hydrate feed changes when 
feed density alters which prevents sub¬ 
sequent damage to the kiln brickwork. 

(c) The kiln has demonstrated stable operation 
on automatic control over a much wider 
range of throughputs down to 2.9 tonne per 
hour oil flowrate compared to 3.5 tonne per 
hour previously considered the minimum. 

Average oil consumption figures p>er tonne of 
hydrate processed could not be obtained as the 
hydrate measurement shows considerable drift 
over long periods, making comparisons before 
and after implementation impossible. This 
comparison could be performed after all kilns 
were converted to running the new control 
strategy based upon the total alumina conveyor 
and inventory figures. 
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Flo. 5. Hot end temperature histogram—trial kiln. 
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Fio. 7. Normalized model parameter trends {A polynomial) 


604 ^ a4mf>i« 664 


A plot of the normalised identified model 
parameters are shown in Figs 7 and 8. These 
show the changes that occur in the A and B 
polynomial coefficients over time. It is clear from 
these figures that the prcKess does indeed 
change, requiring adaption of the model 
parameters, clearly justifying the need for an 
adaptive controller. This is further illustrated in 
Fig. 9, showing the impulse respemse derived 
from the model parameters at sample instants 
604 and 884 from Figs 7 and 8. Since the 
regulator is cascaded with an integrator, the 
impulse response of the identified model is 
equivalent to the step response of the actual 
process dynamics. The model of sample 604 
shows insignificant inverse response with be¬ 
tween 12 and 18 minutes of dead-time, while the 
model of sample 884 indicates a 30% peak at the 
inverse response, and a lower overall gain. 
Again, this highlights the need for an adaptive 
controller. 

4.3. Human factors 

(a) Control room operators. Ease of use of the 
control strategy was important in its overall 
success. The two new controller types (Smith 
Predictor and Self-Tuning Regulator) appear to 
the operator like any other control loop on the 
Bailey Operator Interface Unit. Acceptance of 
the strategy increased with familiarity and was 


Fin 9 lmpulF»c incxlcl rcNponsc 

indeed aided by this ‘sameness ’ appearance on 
the visual display unil. 

(/>) instrument personnel. Although inslru- 
ment personnel do not have to mainiain the 
strategy, education regarding the strategy's 
principles was important to prevent it becoming 
the “scapegoat". 

(r) Engineering personnel. One engineer was 
required for design and implementation of the 
strategy for an estimated period of 12 months. 
This period also included a learning phase on the 
principles of self-tuning control. Careful docum¬ 
entation was also important to allow future 
applications of this lechnology lo proceed. 

S (;ON( I IJSION 

This paper has outlined the successful 
application of advanced control principles in an 
industrial environment. The combination of 
a)nvenlional controls, a Smith Predictor and an 
explicit pole-placement self-tuning controller has 
been shown to be very effective on the control of 
an alumina calcination kiln. A measure of the 
success and acceptance of the new control 
system is that the original trial kiln has now been 
controlled by the strategy for over 20 months, 
and two other kilns for over 12 months and all 
arc still operating. There are plans to extend the 
system to the remaining kilns. 
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Fig. 8 . Normalized model parameter trcod.s (B polynomial) 
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Adaptive and Robust Cascade Schemes for 
Thyristor Driven DC-motor Speed Control* 

R M. STEPHANA V. HAHN4 J DASITCH* and H. UNBEHADENJ 

The widely used cascade speed control scheme for (hyriuor driven 
DC-motors can be significantly improved by applying adaptive and robust 
control methods to compensate for unmeasurable variatiofts of their 
mechanical and electrical characteristics. 

Key WcNtli—Adaptive control; robust conir<f|; IX-mcuor, u^ntrol, nmcrcK'onipuirr'hiiH'^d 

control; direct digital control, cascade control. 


AlMtract -'This paper is concerned with the development of 
improved cascaded speed control systems for thynsior driven 
DC motors The main features of the work can Ih* 
summarized m the lollowing four points (1) Development of 
a digital dual-mode adaptive controller for the inner current 
control liKip and of a model reference adaptive coniioller for 
the outer speed control loop, thus making the entire system 
adaptive (2) Development of robust controllers both for the 
inner current Uxip and also for the outer speed Uxip. thus 
making the entire system robust (3) Implementation o| the 
above control strategies, adaptive and robust, in a l6-bii 
single b<iard computer with floaiing-pomi coprocessor (4) 
(\in>(iari.son of the results of both robust and adaptive 
improved ca.scaded schemes with a commercially available 
controller. The obtained results .showed that the model 
reference adaptive control concept and the robust control 
strategy cun be applied with success for the speed control of 
a DC-motor 


1 INTRODUrriON 

Amonci various methods proposed nowadays for 
the speed control of thyristor driven DC-motors, 
cascaded speed control schemes, with an inner 
current control loop and an outer speed control 
loop have been widely used and represent the 
classical control structure. 

Certain difficulties arise in actual practice in 
this system. One is due to the conduction modes 
of the armature current. As long as the current is 
continuous, the armature may be modelled 

‘Received 2 November 1988. revused II (Xlohcr 1989; 
revi.scd lU July 1990; received in final form 4 August 1990. 
The original version of this paper was presented at the IFAC 
workshop on Robust Adaptive Control which was held in 
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Pergamon Press pic, Meadington Hill Hall, Oxford 0X3 
OBW, U K. This paper was recommended for publication in 
revised form by Associate Editor G. Verghese under the 
direction of Editor H. Austin Spang III. 

tCOPPE/UFRJ, P O Box 68504. 21945 Rio dc Janeiro, 
Brazil. Author to whom all correspondence should be 
addressed. 

t Ruhr Universiiai. P.O. Box 102148, 46.30 Bochum, 
Germany 


praclically as a hrsi order system, but as the 
curreni becomes discontinuous, it exhibits 
nonlinear gain behavior (Kiimmel, l%5; Bux- 
baum, 1%0, Felly, 1971). Furthermore, varia¬ 
tions in load torque, moment of inertia of the 
load and field excitation may also occur. Under 
these conditions desirable performance of the 
system may be maintained either by employing 
adaptive control techniques or by incorporating 
robust control designs. Usually a fast inner 
current loop compen.saies for the armature 
behavior and a relatively slow outer control loop 
compensates for the rest. 

As the continuous and discontinuous operat¬ 
ing modes can be easily detected with inexpen¬ 
sive circuits, it is common practice to apply the 
so called “parameter .scheduling conlrof’ prin¬ 
ciple (Unbehauen, 19K5b) for the inner adaptive 
curreni control loop. The scheduled adaptation, 
that will be termed here also a,s dual-mode 
adaptation, responds as soon as a plant variation 
is detected changing the controller parameters 
corresptJiidingly. This method was introduced by 
Buxbaum (1%9) to the control of the armature 
current of thyristor fed DC-motors. Buxbaum’s 
analog controller switches from a Pi-structure, in 
continuous current, to an I-struclurc, in 
discontinuous current. 'Die realization proposed 
here is with a microprocessor using fixed-point 
arithmetic. 

The alternative inner robust controller (Unbe¬ 
hauen et ai, 1987), which had not yet been so 
far applied for cascaded speed control of DC 
motors, will also be used in this investigation. 

When the variations in held excitation, 
moment of inertia, load torque, etc. can be 
measured or ob.scrvcd, it is also possible to 
implement parameter scheduling control for the 
outer speed control loop, as described by Str5lc 
(1%7). Another way of adaptation is possible 
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with an adaptive observer, m propciscd by 
Weihnch and Wohid (1980) The self-tuning 
approach was studied by Depping and Voits 
(I9H2) and Brickweddc (1983) I'he model 
reference adaptive appn>ach for the speed 
control of DC-drives wauS introduced by Raatz 
(1970), who applied a control scheme based on 
the Mi l rule (ourtiol and Landau (1975) 
proposed an analog adaptive system based on 
hypersiability theory. They used the adaptive 
model following control (AMFC) approach, 
where the conditions of perfect model following 
(Er/.bcrger, 1968) must be satisfied Recently 
digital tentative suggestions were made Ixizano 
and Noriega (1983) applied an adaptive algo¬ 
rithm with forgetting factor, introduced origi¬ 
nally by l>o/ano and Landau (1981), for the 
digital speed control of a DC servo-motor, 
without inner current l(K)p. Ihc proposed 
adaptive controller is not applicable to nonmtni- 
mum phase plants. Balestrino et al (1983) 
applied a variant of the adaptive nicKlcI following 
control (AMFC) of Couriiol and Landau (1^75). 
Plut/er and Kaufman (1984) made simulation 
studies applying the reference model adaptive 
control algorithm prcjposed by Sovcl et ai 
(1982). 

In the present work the adaptive speed control 
liHip is bused on a discrete model reference 
ciHUrol strategy introduced by Hahn (1983). 
('ompared with (he above mentioned references, 
it has the following characteristics: (a) stable 
operation is guaranieed even when the plant is 
nonminimum phase (Hahn and UnlKhuuen, 

1982) . or when the current limits are reached 
(Hahn, 1985). (b) an inner current control hnip 
is considered; (c) cxpcriincntal results arc 
presented The proposed method was already 
used for the control of a distillation column 
(linbehauen and Wiemer, 19S5) and of a 
turlxvgcncrator lalHirutory system (Hahn et aL, 

1983) Both implementations were done in 
mmi computer with standard real-time operating 
systems The prcKcs-scs were also sufficiently 
slow. that the algorithm calculation time was 
not such un extremely critical factor as in the 
present experimental application. 

A robust outer sjH'cd Uxip has been 
implemented in the present investigations for 
comparison purpt>scs. 

C'om^xirisiins with a conventional cascade 
analog amtrol system arc also made. 

2 BASIC nilORY OF THF IMPLFMEN*n’D 
AO An t VI ANl > ROBUST t CIN l ROl 

The adaptive and robust methods used in this 
work will be summamed in the following 
sections. 


2. L The Model Reference Adaptive Connoller 
{MRAC) 

2.1.1 Basic considerations. The mcxiel of the 
plant with one input Uiz), one output Y(z) and 
unit delay is described by the discrete transfer 
funaion 


OAz 


B(z^ 1 ) ^ 
( z “* )'' 


^ Thz) ' 


with the polynomials 

/l(z ')= I +/l*(z ')2 
«(2 *) = ‘)i ‘ 


( 2 , 1 ) 


( 2 . 2 ) 
(2 -I) 


For simplicity of treatment, only the unit delay 
case is considered. However, the results can be 
generalized for plants with arbitrary time delays 
and multiple inputs and multiple outputs (Hahn. 
1983, Unbehauen and Wiemer. 1985) The 
disturbed plant output is described by (see Fig 
1 ) 

Aiz ')T(z) - ')z 'fy(z) 4 V^(z), (2 4) 

U(:)-C(z ')r(z)T Z.,(z), (2.5) 

where r(z) is an independent white noise signal 
and Zj(z) denotes the unmea.surabic determinis¬ 
tic disturbances 

Direct adaptive control schemes like model 
reference adaptive systems lead to unstable 
closed kmp behaviour with non-minimum phase 
plants because of the compensation projx*rties of 
the controller. Ihercforc, in order to stabilize 
the nonminimum phase control, Ihe idea of the 
correction nern^ork intriKluced by Hahn and 
Unbehauen (1982) is applied The plani output 
T(z) is augmented by the signal 


y:(2) = (;,(.- ')(/(r), 

(2,6) 

/»,(.'■) 6’(2) 

(2.7) 

.4,(2 ')--l+/»,*(2 '): '. 

(2.«) 

»,(*• ') = ft... + fl,*(2 ')2 '. 

(2.9) 


plQ n I 


I--1 



FK> 1. Tlx haiik strticlure of itx pimnt 
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Fki 2 Iljc biiMc »trticlurc of ihc MRAC scheme 


herein the correction network (;r ') should 
€ stable Tlie augmented plant output is then 

y:(z)- y(z)^ Y,(z) (2 10) 

'he adaptive controller is now acting on the 
ugmented plant as shown in F ig. 2 Therefore, 
1 C adaptive system is closed-Uxip stable if a 
able adaptive algorithm is used and all /x'ros of 
le augmented plant lie in the unit circle of the 
-plane. ITicsc zeros arc the roots of the 
quation 

(#, (z) 

(j, (z ) 4^ (jAz ) = (1. or 1 4 ; - =0 (2.11) 

( - ) 

the parameters of the plant are known, the 
;>ots of equation (2,11) can easily be investig* 
led with rcKit Uxus techniques using knowledge 
f the zeros and fKilcs of the functions (iAz) and 
/,(z). Tins leads to ihc following design 
KKcdurc 

Draw the zeros and poles of ('/.(z) into the 
complex z-plane. The zeros of G.(z) arc 
starting points and the poles arc ending points 
of the branches of the rcxit kxus of equation 
( 2 . 11 ). 

Find polynomials /f,(z) and A,( 2 ). st) that all 
branches of the rcKit Ukus lie in the unit 
circle 

)f course, in the case of adaptive control, the 
ant parameters arc essentially not known 
evcrthclcss, in most cases a pnon information 
the plant will be available and can be used to 
^sign the correction network. 

In order to reject the influence of detcrminstic 
sturbances which have the property 

lim = const. 


it is generally convenient to force the amtrolkr 
to have integral action. This can easily he 
obtained by multiplying equations (2.4) and 
(2.7) with the factor (1 - z *) on both sides. 
Therefore, they arc modified to 

AA 2 ) * B(z ^)r 'UAz) + VAz) (2 12a) 

and 




) “ B, (.- 

')z 'V,{z), 

(2.12b) 

with 





’) = 

(1 - ; 


) ” 1 + a:u 

')r 





(2.15a) 

V,(z) = 

(1 - 



(2 13b) 

V,{z ) = 

(1-r 

'VV(z). 


(2 13c) 

A.,(z 

(1-z 

'VAAz 

')» 1 + AM 

'u 


{2 AM) 


for s e (0, 1). x denotes the case with 
integral action, whereas the integrator is 
switched olT for k ^ 0 Note that by this 
modification and under Ihc as.sumption of 
f(z) -0 and constant deterministic disturbances 

lim P/(*) lor AI. (2 14) 


This basic structure of the control scheme is 
shown in Fig. 2. 

2.1.2. Ihe control law. The augmented plant 
output y^(z) is compared with Ibe output Y^{z) 
of the stable reference model 


where 


and 


G..(z ')lV(z). 


(Uz ■) 


fUz ’)^ 


Y^iz) 
VV( z) ■ 


A„lz ■)» 1 4 AI (2 ')z \ 


(2.1.S) 


(2 10 ) 


(2.17) 


wherein W(z ) is the reference input (set point) 
Instead of the model error signal 

fAz}^yjz) y;(z). (2.i8) 

the Altered model error signal 

£„(;) = A.,(z ')/’:(i) 

')Y„{z)~ AJz ')y(z) 

-AM ')n(^) (2. >9) 

IS introduced 

Adding the “zero-term from cqualiom 
(2 12a,b) 


\A,{z ')Y{z)- H(z ')z 'V,(z)- V,{z)\ 

+ |A,/(z ')K(r) -- B.iz ')i 't/,(z)I = 0 

to llte rig)if hand vide of e<|uaiion (2.19) and 
taking into account from equation (2.16) that 

AM ')YM)^BM ')z '»V(r). 
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il (ollown from equation (2.IM) that 
EJz}^z '\HJz ')W{z) + (A:{z ') 

- A*Jz '))^'(z) + (/4,V2 ') ~ A:.(z '))Y.(z) 
mz ')+ B,{z '))V,(z)\ - v,{z). (2.20) 

Now, u!iing equations (2.3) and (2.9), the 
difference equation of the filtered model error is 
obtained as 

t:^(z ) » z '|«(2)' {b„ f h„.)V,(z) 

-H'iz ')z 'U,(z) 
f '(Kfz)! - (2.21) 

with 

A>4*(J ')^A:{z ') • /1:(z ') (2 22) 

and 

H(z)^RJz ')W'(z).»:(; ')z 

+ |/l,Vz ')-/4:,(z ')1>:(Z). (2.23) 

where the signal R{z) is generated only with 
known parameters and measurable plant input 
and output signals 

If the control signal is computed by 

x\R{z) H*{z ')z ^U,(z)^ AA^iz ‘)V(z)| 

(2.24) 

for V/(z)=“'0 the augmented plant output 
follows the output of the reference model 
and ® If 

Note that the polynomial H,(z ') is forced to 
have a zero at z 1 if integral action is required. 
Then, under the assumption 


always be achieved by chmisjng an appropriate 
for the airreclion network. 

With equation (2.13h) the output U{z) of the 
adaptive amtroller is 

(/(,) = (2.28) 
with re (0, 1). 

2.1.3, Adaptation of parameters. By substitute 
mg R(z) from equation (2 27) in equation (2.21) 
il follows that 

EJz) = A„{z ')E(zj = z ‘[(ft., - K)U,(z) 
^{^•{z ')-fl*(z ‘))z '(/,(z) 

- (A>i-(z ’) - A/l*(z ’))y'(z)) - V,{z). 

(22q) 

Considering now lime-varying controller para¬ 
meters, equation (2.29) can f>c rewritten in the 
time domain as 

*’m(<£) = Ip - p(* -- 1 )|'k(A “ 1)~ t'i(k). (2..30) 

where all signals Uf{k) and y{k) and their 
backward time-shifted values arc contained in 
the signal i»f(7or %{k} and all the corresp^mding 
parameters are included into the parameter 
vectors p and p(k\ 

Equation (2 .30) describes an estimation 
problem, which is very well studied at least in 
the disturbance free and white noise case (e g 
L^)zano and L.andau. 19HI). This estimation 
problem can be formulated as follows f ind a 
law for the adaptation of the controller 
parameter p such that 


lim m(/c) const, (2.2.S) 

(he output yAk) of the correction network 
vanishes for / —» x. Equation (2.25) can only he 
satisfied for constant reference signals W^(z) and 
step disturbances Zj(z). In this case we have 

lim y(k) lim v^(4), (2.26) 

i e. asymptotic model matching of the plant 
output 

In equation (2.24) the ci>cBk'ients of the 
(xdynomials W*(r ') and ‘) depend on 

the unknown plant parameters. For the com¬ 
putation of the adaptive control law they have to 
be replaced by their esiimiilcs 

xlR(z)- d*(z ')z 'U,(z) +A/i*(r ')>'(z)|. 

(2.27) 

In equation (2.27) ihivS is iiidiciiled by the symbol 
'' This equation can easily be solved, 
provided the term ft,* 4 fe,„ is not zero. This can 


lim e,„(A ) =0. (2.31) 

k -x 

There are different solutions available for this 
estimation problem As the least squares 
estimation takes more time for computing, in the 
present approach a f^enerahzed stochastn ap¬ 
proximation method (flahn, 1983). similar to 
that proposed by Goodwin et al. (I9KI), has 
been applied for (he e.stimation of the controller 
parameters: 

p{k)^p{k - \)^r{k)GMk l)f^()t). (2 32) 

where 


r(A)- 


fr*{k) if r*{k) 
or 

1 

I pC{k - 1 )GjL{k - I) + y 

I k,(k) 


p*'(/( - \)G%{k - 1) + y 
(2.33) 

otherwise 


r*(*) r(*-l) 

+ Xi(k)C{k - l)Gi(* - 1) + A,(A) (2.34) 
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and the values of 

G >0. r(-l )> 0 , (2,35a) 

i< A,(t), (2,35b) 

1)55 A 4 *). p>l (2.35c) 

are freely selectable. It is advtsable lo chixvsc 
p»k and large values of y. This algorilhm, 
equations (2.32-2.35), contains the ''classical'' 
adapHation algorithm with nondccreasing (lixed) 
gain estimation (c.g. lonescu and Monopoly 
1977) as a special case setting 

A, ==(). A. >0.5, A»-l. (2.36) 

llie stability of the total algorithm in the 
disturbance free case, i.e. v(A)^ 0 , is guar¬ 
anteed if 6\(2 ') and G^(r ') arc stable and 
G,(r fj. (‘ ') has no zeros for |r] 1 . Ihcn 

all signals are bounded The algorithm can t>c 
extended to the disturbed case by introducing a 
"dead zone’' into the adaptation law (Peterson 
and Narcndra. 1982) Phe stability proof follows 
easily using the l.iapunov function 

V'(p(A))-p(*)V; 'p(A). (2.37) 

where p(A ) =- p - p(A) is (he parameter error 
As the reference model is stable, the 
convergence of the original error h(z) directly 
follow's. I'he influence of step disturbances on 
the estimation prixedure is at least asymploti- 
ciillv rejeciei) if an explicit integrator (x ~ 1 ) is 
used because then equation (2 14) holds 

2 2 I he rohiLst eontroller 

Among several approaches found in the robust 
control theory, the dominant pole placement 
concept of Dastych (1983) was chosen for the 
present investigation Ihc design goal is to 
guarantee nearly the same dominant jxile 
configuration of the closed control l(H>p, 
independently of variations and uncertainties of 
the plant parameters 7’hc principal characteris¬ 
tics of the method will be summarized in the 
following sections 


2,2J. Damimmi pedes. If the charitcfenstk: 
equatk>n of a control system is whiten as 

H ^ 

P(s)KP jU) X p,s\ X ponstjuil (2.;38) 
with 

PdU ) ® P- Pm ,, * • ■ (2 

and if iis ctKflficienu arc related by 
and p, »/>,,, 

lor I » M + 1.. p + V ~ 1 (2 40) 

then the poles of Ihe polynomial P^fs) art very 
close to the dominant poles ol P(.r). The 
conditions given by equation (2.40) are satisfied, 
for example, with Ihc following characteristic 
polynomial 

PU) ^ P^(s)P„(s) ^ V (2.41) 

where 

(2.42) 

6^ « 1 and a 

In this case, the companson of equation (2 41) 
with equation (2 38) gives 

lim /»^(v). (2.43) 


I.e. Pa(.i) is Ihc dominant parcel of P(.i) when 
a 

2 2.2 Conirollrr xtruclurr and pole ptacrmeni. 
Tlic system structure is shown in Fig. 3 where 




/>(!) 

r(7) 


c„ 4 r| .r 4 • • • 4 " 


n ' m, (2.44) 


is the plant transfer function and 




fl(.0 

.4(A) 


h„ + bfX + j ^4 
a, I 4 ti,i 4 ■ 4 r’ 


H', 


(2,45) 


coniroiicr picnt 



Fki 3 The* n>t>uM ccinlrriller Diruclurc 
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IS a (lit x2n) matnx that contains the plant 
parameters, 

r*^ = [^0^, h„af\a[ ■ • a;..) (2.54) 

is a vector of controller parameters, 

p' ’^[popiPi ■ Pi« i] (2-■55) 

contains the coefheients of the desired charac¬ 
teristic polynomial, and 

«' =(() Ocor, r„ ,I (2.56) 


that of a feedforward path. 

Initially GV and GV will not he considered For 
this condition, the characteristic pitlynomial of 
the closed kK>p is given by 

PCf)-/l(.T)C’Cv)-t-^( a)D(.0 

3 a p^^ + />,.V f s'* (2.4K) 

For n controller transfer function G’/uCa) with 
integral term, the denominator y4(.v) m equation 
(2.45) is given by 

/t(A) A(ao 4 cjJa f s** ‘), (2.49) 

and there are </ + unknown controller 
parameters, which can be established comparing 
the r/ n ct>cflftcients of equation (2.4K). A 
necessary condition for the existence of a unique 
solution h»r this pole placement problem is that 

q 4 iv » </ “f n w - n. (2.50) 

To maintain the controller order minimal it will 
he required that 

q ^ w. (2.51) 

'^fhe resulting equations relating the coefficients 

of A (a), /f(A), (’(.a) and I)(s) can be written as 

(Unbehauen, 1982, Dastych, 1983) 

Mr « p “ m (2.52) 

where 



(2.53) 


is a vector (1 x2n) a>ntaining the denominator 
cocfhcients of the plant. 

2.2.3. Variation of the controller parameters 
and robust pole-placement. The properties 
mentioned in section 2.2 I can be applied to the 
pole-placement method presented in section 
2.2.2. Suppose that the parameters of the plant 
to be controlled vary within a known region and 
that a set of nominal parameters, characterized 
by the index /V, is chosen for the controller 
synthesis. Equation (2.52) gives 

Mvf ~ p^ - mv (2 57) 

'Ilic controller parameter vector then is deter- 
mined by 

r « M.v'fpv " mv) (2.5K) 

if Afv* exists, i.e if /)(.v) and C‘(v) have no 
common zeros The general case is describi*d by 
equation (2.52). The substitution of equation 
(2.58) in equation (2.52) leads to 

p ^ !VIMv'(pv mv) 4 m. (2.59) 

llic aim is that p and pv have the same 
dominant poles. This can lx* achieved if /V(v) is 
cht>sen as suggested by equation (2.41) and if the 
elements p, of the vector p, given by 

pi - ^,p,s ^ .2/*' (2.60) 

satisfy the conditions (2.40) The factor K, and 
the remainder terms R, depend on the plant 
parameters and on the characteristic equation of 
the closed Uxip. 1 hc.se considerations are used to 
chtKxsc the nominal plant parameters and the 
vector Pv necessary for the controller synthesis 
presented in equation (2.58) 

"fhe application of this method can be 
summari/cd in the following way: 

1. Choice of a desired dynamic behaviour 
through the p<ilynomial p,s(.y). 

2. Choice of a nominal operating condition, 
characterized by the index N. 

3. Esiablishmeni of the controller order using 
equatians (2.5(1) and (2.51) 

4. Choice of nr so that equation (2.4()) is 
satisfied. 
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5. EslaWishmcnt of the oontrolter by solving 
equation (2.58). 

Finally, the prc-fiiter Gv(j) and the feed¬ 
forward filter G|;r(5) can be chosen to improve 
the system performance at determined operating 
points. For example, tf the desired transfer 
function of the closed loop is given by 



/ \ PlW 

Air(3‘) » - — . 

w(.o 

(2.61) 

then the pre-filter transfer function 



(j) = 

B(s)Ds(s) 

(2.62) 

can be 

chosen to compensate the 

z£rm of the 

closed 

loop, when G^(3) and 

Gj(i) arc 

minimum-phase transfer functions. One can also 

choose 

Gv (.V) = (J) 

(2.63) 

and 

G, (.f) =-, 

G„(,v) 

(2 64) 


where fi/w(A) is an approximate model of the 
plant at a determined operating point and must 
be chosen so that G, (a) is realizable In this case 
the closed lix)p transfer function is given by 


GV(.v) 


where 


O.U) 


V'(.v) 

W(s) 


Au (.v)[l ^C?.(v)], (2 6S) 


Gj|^( 5)(1 (j„{s)Cjs{s)\ 


(2.b6) 


It can be seen that when the plant 

transfer function Gv(s ) is approximately equal to 
G^^fv) In this case the system transfer function 
Gh.(.y). at the specific operating point, becomes 
equal to A'u ^v) 



Fkj s l>cpriKSiiiU'c cif ihe tiiiM unt|uc una of 

ihc fnciH>n ct^ethcicni t/t) Knih the cxciiMtH^n curirnt «it 
the eddy <-ufirm brake ufN>n ihe M.:aled itpeed </»•) 


V Tilt Ft ANT ri) Ht (ONTUOl t i n 
The plant consists of a thyristor fed l.lkW 
separateIv excited IK'-machine. an eddy-current 
brake, a magnetic clutch, an excitation field 
supply unit and a tachogcneraioi The armature 
power control rectifier contains two thyristor 
bridges, each one with four thyristors in fully 
controlled single-phase configuration Variations 
in moment of inertia, field excitation and load 
are then pos,sible Hie single phase supply makes 
the discontinuous euiTeni domain wide All 
these variations make the application of an 
adaptive or of a robust solution mleresling 
'Tile plani was identified by means of classical 
mcthiKis The mean value model used is 
explained in detail in Stephan (1^7). Figures 4 
and 5 present the final model. 

4 (ONmOl.I.I RS SlklKTimi S ANt) 

IMPI r Mt Nl AlltlN 

Ibc three cascade s|K*ed cunlrollcrs compared 
in this work are reproduced in Fig fi The 


m. 



Fk» 4 Scaled plani model (the ugnab within thin nonUncar 
blocJt diagram are cofrudertd to he in Che time domain T,, 
G and B arc vanafc^ paramcien) 


rectiher input signal 


anafc^ paramcien) 
11 , - I ir 

ipiai^ u, 

u « - 1 ^ IHff 


f*' scaled motor bade vohage 

ij: scaled armature current (mean value during hah period) 
n* scaled speed 

lb*: scaled load torque (alterable with the eddv-citrrefii 
brake) 

(0<di;<0.9) 


} rcciilier characleristK::^ 

0 < T; < If) rm J 

"21) I motof/rcrtiher m 
G ■* .K) m* i amiinuous current miidc 
0 3 < < 2 0] motor/rectifier m 

«. 0 J discontinuous current mode 

0 S < f * < 1.0 scaled held escitaiKm 
330 ms < 7„ < 7tl) m» dectownechanical lime consiani 
0 < B < 2. friciion coefficient (altcrible with the cddy-currrni 
brake) 

Reference values curTcnt IhA, speed IWXIrpm. nuiior 
voltage 130V. lorqur Ul,4 Nm 
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rn. 6 Ihr t'RScadctl sfKCvi coniml schemes (al LArmmcrciallv asailahlc analog conlrollci. (h) coinpkicK 
adaplivr thgtial scheme, (c) dtgiial lohusi siheme 


eniircly analog coniroller (Fig 6n) is a standard 
commercially available unit (Siemens, Simoreg- 
6RA21). with dual mcKk adaptive inner current 
kxip. The other two schemes were implemented 
during this investigation on a lb-hit single board 
c'ompuier. It consists of a 5 MHz 8086-CPU, 
with floating points copr^>ccssor 8087 Moreover, 
the SBC includes an interrupt controller (8259). 
a serial (K251) and a parallel (K255) communica¬ 
tion interface, a timer (8253), RAM and 
BPROM's 12 bits A/D and D/A converters. 


The dual-mode current adaptive inner con¬ 
troller was programmed in machine language for 
fix-point arithmetic. It iKcupics approximately 
1 K byte and executes m (I 8 ms. It is impi^rtani 
to mention that the inner current lm>p performs 
more than a simple control task Actually, it is 
also responsible for the commands nccessiiry 
during a change m the direction of the load 
current. These functions belong to the 'bridge 
selector ' blcKk shown in Fig. 6. The sampling 
time used for this control Ux>p was 10 ms, 
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because the single phase thyristor hndge* 
operating at 50 Hz, allows changes in the firing 
angle only at intervals of approximately 10 ms, 
llie model reference adaptive speed controller 
and the robust controllers were programmed in 
PASCAL. Assembler subprograms for Ooating 
piiinr multiplication, division, subtraction, addi¬ 
tion and comparison devclo|)ed by the authors 
make the use of the H087 facilities easy and the 
computation time nearly minimal Lor the robust 
controller it was possible io use a sampling time 
of 10 ms and for the adaptive speed controller ot 
20 ms. ITiesc sampling limes arc rcspeciivclv 
I/IO and 1/5 of the desired time constant of the 
controlled motor. Practical applications reveal 
that these are reasonable values foi sampling 
limes (IJnbehauen, l%5a) Moretiver. these 
timers can lx* directly obtained frtun the line 
voltage at 50 Hi. 


S l .XPI KlMrN I Ai Rt Sl I IS AND ( (IMI*ARISONS 

5 1 The inner current Ump 
Three different current controllers arc lesied; 
the analog dual-mode adaptive, the digital 
dual-mode adaptive and the digital robust 
current controllers (Unbehauen et a/.. I^^M7i 
The digital controllers work with a sampiirig lime 
of H) ms. 

In I ig. 7 ihc dynamic behaviour of the current 


loop for step variations of the reference current 
arc shown for cxintinutHis and discontinuous 
currcni, as well as for the cniical change from 
discontinuiius to continuous cut rent. The analog 
duaTmixle adaptive coniroUei gives in all 
amdilions a rse lime of approximately Mims 
and no overshm^t The digital cxmtrollcrs. on the 
other hand, show a greater variation ot the rise 
lime and in two cases a small current overshtmi 
Nevertheless, the perforiTUince of the digital 
dual-mode adaptive and that of the digital robust 
controllers are satisfactory for the cascade 
amtred it is interesting to cxvmpart these results 
with the step resfvonse without adaptation shown 
in I ig 8 The sl*>w transirnt. with a nse-iimc 
greater than i 2 s. was obtained by switching ott 
the adaptation of the analog or of the digital 
dual-mode Jidapiivc controllers. This implies that 
the opiimi/ed PI ixmt roller for continuinis 
curreni actuates during the discimtinuous currcni 
di»main loo Lhis slow dynamic Ixiuiviour id the 
inner current liMip can make a cascade speed 
control scheme unstable (Bunbaum and 
Schicrau. \m)) 

It IS shown, theieforc. that the robust 
cnnirollcr can substitute with success the 
duabmode adaptive currcni controller and that, 
m continuous or in disionlmuous current 
conduction mode, the controller inner Knip 
behaves nearly as a lirsl order system with time 
constant between 15 and .^bms. 



Fig 7 Sicp rcAftcmteA tin reietemx current varuitian« under diffcrcni iximlitHmt^ i ewrenf in A 









disccr»t inu-cHiS current 


R. M. Sthpman et aL 



f-\i» rt C'urrcnl tuirp rciprm(i« in di«£<>nliniH>us current rm>dc (from IA lu 4A); Pl-eurrcnt controller with 
paremetcri ^►ptimjiccJ for continuous current i ^ current in A 
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5.2. Th€ cascade speed control schemes 

5.2.1. Design comideratiems. The parameters 
of the commercially available PI-speed controller 
were optimized using the well known ailenon of 
Kessler (1958). The reference model for the 
adaptive speed controller was chosen as a lirsi 
order system with time constant of approxim¬ 
ately 0.1s and gain one. The robust controller 
was designed to guarantee nearly the same 
dominant pole configuration of the closed 
control loop, independently of variations and 
uncertainties of the plant parameters The 
dominant piolcs were chosen at -7±j7s 
which provides a step response with 5^f 
overshoot and settling time of 0.5 s 

5.2.2. Results. The plant model has already 
been presented in Figs 4 and 5 llie parameters 
and variables that appear in these hgures will be 
often mentioned during this section If no 
comments are made in (he text, the results 
obtained with the adaptive controller are for well 
adapted parameters to set point variations 

In Fig 9 the controllers arc compared at four 
different operating points. One can see that the 
completely adaptive .scheme maintains a settling 
lime of 0 5 .s and an oversh(M>t smaller than ]i)% 
This is almost the performance given by the 
parallel model (a first order system with time 
constant 0.1 s). The differences arc due to the 
correction network, which is ncccs.sary m this 
application because the plant with inner current 
liK)p (i.e the plant to be controlled with the 
model reference adaptive controller) has non¬ 
minimum phase characteristic after discretization 
with a sampling time of 20 ms (Stephan et al , 
19HK) On the other hand, the commercially 
available c^introller and the robust controller 
present at some operating conditions an 
ovcrshmil greater than and a seitling time 
greater than 0.5 s The advantage of the robust 
controller, when compared with the aimmcr 
cially available one, is the .simpler realization of 
the inner kK>p. T“hc laicr uses a dual-mode 
adaptive inner current loop, that changes its 
structure and parameters al each operating 
condition, the former has fixed parameters and 
structure. 

The effect of an abrupt change of the moment 
of inertia can he seen in Fig 10. Ibis 
penurbation serves also to show the effect of a 
pulse of a load torc|ue m,, that cKcurs when the 
magnetic clutch is switched on and a mass, 
initially in repose, is set in motion After this 
abrupt variation, the commercially available and 
the robust controllers show their characteri.stic 
responses in the new operating condition. The 
completely adaptive controller performs well, 
although without wclUadjusied parameter!. 
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A variation of the load torque rh/ can be 
obtained altcnng the excitation current of the 
cddy-ciirrcni brake Figure 11 shows the sj>ccd 
performance in this case. TTic completely 
adaptive controller rejects the load perturbation 
only due to the adaptation. It responds more 
slowly than the commercially available and 
robust controllers, that have integral action. Ai 
was described in Section 2 2 1, an integral term 
a>uld also be added to the model reference 
adaptive Lxmtrolier, but experimental results 
have shown that such a nalulton makes the 
reference current signal (the output of the mcKlel 
reference adaptive controller) wobbly This fact 
IS cxpecicd due to (he approximately integral 
behaviour of the plant at the operating speed of 
15<)Drpm As can be seen from Fig. 5, for 
n*»f0.79. the coefficient B is nearly zero and 
therefore, according to Fig. 4, the electro¬ 
mechanical pan of the plant behaves as an 
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miegrutor The speed cunind liHip ihcn, with 
(wo integrators, presents a structural instahiliiy 
for the adaptive controller, which explains the 
wohbly characteristic mentioned above. 
Moreover, a reference model for set [xuni 
variations, and mil for load pertiirbalion. is 


given for the model reference adaptive scheme. 
This fundamental design consideration handicaps 
the step resfX)nse for periurbations and is also 
responsible for slower parameters adaptation m 
the case of load perturbation than in the case of 
setpoint variations. 
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The parameter adaptation for seipoini varia< 
tions can be judged by the results shown in 
Fig. 12. All parameters of the mcHkl reference 
adaptive controlkr are initially set to zero and 
the adaptive algorithm is then started with a 
reference speed of lOOOrpm. Then the reference 
speed is varied between 140Cirpm. b(K)rpm and 
KXMlrpm. furnishing an identification signal 
Satisfactory responses arc already obtained 
during the second step. Thus, the controller 
parameters are adapted. 


6 CONC't i;SK)N 

A cascade control strategy was chosen lor the 
DC-motor speed control design and three 
schemes were compared: a commercially avail¬ 
able analog scheme, a completely adaptive 
digital scheme, and a completely robust digital 
scheme, 

Ihc implementation of the digital controllers 
was made on a standardized 16-bit single tx^urd 
micrcK'omputcr. 

The obtained results showed that the miMJcl 
reference adaptive control can improve sig¬ 
nificantly the speed performance for setpoint 
variations and that the robust current conirol can 
substitute with success (he usual dual-mode 
current controller (Stephan. 19K5). 
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Quality Control of Binary Distillation Columns 
via Nonlinear Aggregated Models* 

J LtVINEt and P ROUCHON} 

A robust rumlinear control law u designed to reject unknown feed 
composition disturbances with overall stability. Implementation to real 
columns as well as comparisons with classical control strategies, show the 
robustness and flexibility improvements of the method. 

key WerOi—C ontrol upplic4tiunii, diMillfiiiion adumn^. diMuittancr icjrtuon* riHHkl irduciion, 
rnmlirKir ainlrol syMcnu; overall Mahiiit>\ i)uali(v control. uriKulm f>crlurti(itiom 


t - Using singular ptrturhatmn techniques on a 
physical model of distillntion column, an aggregated model is 
proposed for control purposes Nonlinear perturbation 
refection techniques via statu Iccdhack arc then applied to 
this model to reject the teed composition disturbances 
around every slowly varying reference trajectorv. the 
existence of such a control law aiuJ the stability of the overall 
closed l<x>p system arc proven Moreover, the ohiained 
control law can be synthcM/ed with measurements commonly 
available on distillation columns the ponJud comjMWiiions 
and two inner temperatures An industrial implcmeniaiion 
on a refinery dcpropani/er of 42 trays is presented 
Simulation aimpari.ums with linear and nonlinear geometric 
control laws, both using the physical model ot high 
dimension, show the robustness and fleKibdily improvements 
provided by our methixl 

\ofa/ion 
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(unciH>n defined m T*hcorcm 5 
fpj. funcniofi defined m I'hetjrcm S 

y rcljifrvc Ki (he ked 
^ rclati^^e in tJow dyriamte^ 

' rclaiivc 10 faul dyiiamii.'i 
rclahvr to iKt compairliiieni of m irayik 
relative to the uleady »talc 


I INTRDDUC'TION 

OiMPOsniON (DN^mm of distillation columns has 
been studied extensively. Fhe purpose is to 
maintain the product qualities at their scIfKHnis, 
even if the feed flowrate and comfwisition vary 
(generally, the feed composition is not 
measured) However, very few industrial columns 
maintain dual compr>siiion control lire mam 
reasfin lies certainly in the difficulties attached to 
this problem |sce for example Pucnlcs and 
Luyben (1983)); strongly nonlinear and inlcrac- 
tivc system, very sluggish resptmses, dcadtime m 
the composition measurements and large 
dimension. 

In the literature relative to distillation 
dynamics and control, two generally separate 
streams can Ik* idcntilied several pafK*rs 
cmphasi/e modeling without strong influence on 
the control design, whereas several other papers 
concentrate on control wuhoul discussing the 
model 

In the “modeling stream", many physical 
models arc proposed for simulation purposes 
[see (iailun and Holland (1982) for example) 
Since the early study of RosenbrcKk (1902), who 
established most of the qualitative results 
concerning such models, little theoretical pro 
gress has been observed Other modeling ideas 
have iKcn developed, for example by Hspana 
and Landau (1978) and more recently by 
Henallou rf ai (I9K()) Ihcy propose com- 
partmcntal approximation techniques to obtain a 
simpler model of reduced order. 

In the "control stream", many papers have 
been published and the held can Ik* divided into 
many parts, in particular; linear predictive 
amirol (see for example Moran (1988) and 
Gcorgiou ef al (1988)); adaptive amtrol [sec for 
example Agarwal and SeN^rg (1987)]; linear 
geometric control [see the pioneering work, 
using Wonham's (1974) approach, of Takamatsu 
rf at (1979) and more recently Kummcl and 
Andersen (1987)); and the nonlinear geometric 
approach jsee Gauthier et aL (1983) and Li^vme 
and Rouchon (1986)) applying the methods of 
Hirschorn (1981) and Isidori fi at (1981); sec 
also the nonlinear control approach of Alsop and 
Edgar (1987) based on the approaches of 
Jakuberyk and Respondek (1980), ffuni et at. 


(1983) and Krener (19H4). Another related 
approach on extensive variable control can be 
found in Georgakis (198(>), 

To summarize, one can observe that hrstly, 
distillation processes are carefully modeled and 
their dynamical properties arc well established; 
secondly, recent developments of mmlinear 
control theory are able to provide efficient tCKils 
to incorporate the nonlinear aspect of this 
problem into the control design In this 
perspective, our contribution is the following: 
hrstly, we construct a simplihed model where the 
nonlinear and qualitative properties of physical 
models are preserved (steady-state gains, 
molar fraction in [b. I|. global asymptotic 

stability.); scc<^ndly. we compute a nonlinear 

control law, rejecting the feed composition 
perturbations, simple and robust enough to be 
implemented on a refinery depropanizer 

More precisely, we show that the classical 
distillation nuKkI studied by RosenbrcKk (1962) 
can be approximated, via singular pcriurhalion 
techniques |sce Kokolovic (19H4) for example), 
by a reduced-order model including only the 
slow transients but having the global asymptotic 
properties oi the original model This aggregated 
model proves very useful for control we apply 
nonlinear perturbation rejection techniques (see 
Isidori (1989)] and obtain, around every slowly 
varying reference trajeciory, a feedback law 
without singularity, producing asymptolicallv 
stable closed-loop dynamics, that can he 
synthesized via output feedback when tempera¬ 
ture measurements arc available though com¬ 
puted from a simplified model, this control law 
appears to be extremely robust when facing, m 
an industrial environment, delayed measure 
merits and modeling errors It is currently being 
used on a refinery depropanizer, providing, 
moreover, energy savings and increases in 
prixluctivity and flexibility. 

In the first section, a classical nonlinear 
physical nuniel of binary distillation columns is 
recalled The iime-.scalc aggregation technique is 
presented and the qualitative properties of the 
resulting model are analyzed In the second 
section, the existence of the control law, 
rejecting the feed composition perturbations on 
the aggregated model, and the closed-loop 
stability arc proven. A robust control synthesis 
via output feedback is proposed and its 
implementation on a refinery depropanizer is 
presented 'Hie last section is devoted to 
simulation comparisons between the obtained 
control law, the linear geometric one [Taka¬ 
matsu ft ai (1979)) and the nonlinear geometric 
one (inspired by Gauthier et al (1983) and 
derived from the physical model of this paper). 
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2 THE COMTtOL MODEL 
After Slating classical modeling assumpiions, 
we recall the associated physical mi^del which 
is reduced in Section 2.3 by time scale con* 
siderations. For daniy's sake, the reduanm is 
presented firstly on an arbitrary scctain of irav^s 
(compartment) and then extended to the overall 
column. In the whole section, the major ttKil for 
analysing stability and convergence of our 
reduction method, is the global stability result of 
Rosenbrock (1%2) that is recalled in Appendix 
A 

2.1. Modelinif assumptions 

A general description of distillation pnxesses 
can be found in the biK>k of Van Winkle (1%7) 
The process studied is a classical binary 
distillation column [see for example Espana and 
landau (1978)) as displayed in Fig 1 The 
following assumptions are introduced 

1 On each tray, liquid and vafKir phases are 
perfectly mixed and arc at thermodynamic 
equilibrium 

2 The liquid molar holdup on each tray is 
constant The pressure is constant and 
uniform The vapcH molar holdup on each 
tray is negligible 

V The liquid molar inflow is equal to the liquid 
molar outflow on each tray The vajxn molar 
inflow is equal to the vapor molar outflow on 
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each tray (with the cxceptH^n of extreme trays 
I and It) The feed is a saturated liquHt 

Assumption ] means that the lime ct>nstanis o( 
the mass transfer between liquid and vapor arc 
much shorter than the resident time of each 
tray Assumpiitm 2 slates that hydrodynanucs. 
pressure and level dynamics arc stable and fast 
enough to l>c neglected lliis implies prefect 
level and ptessure coniroE Generally, the tray’s 
geometry, the pressure and level cx>ntrol hxips 
are designed such that 1 and 2 are satisfied for 
smtHXh enough inputs f . /. and V. respectively 
the feed flow, the reflux flow and the relxiilet 
vafNir outflow I'hc Iasi assumption, iT is more 
reslnciive and corresfxuuls to the Lewis 
hyptUhesis [see V'^an Winkle (l%7. p 22M|. ITie 
control techniques which are used in this pu|:>cr 
can be extended to more general nuxlels where 
energy balances are considered Such an 
extension can be done i^rvly on a forinal ground: 
the analysis i>f asymptotic stiibiliiy of more 
complex models remains an open problem, even 
if simulations never display instabilities for 
reasonable opt*raling ctmdilions Nevertheless, 
for several industrial columns such as dt- 
propam/cr, deethanizer. assumption 3 pro 
vidcs a goiHl approximation of the inner flow 
profiles 

Remark I l or clarity's sake, unilorm pressure 
and saturated liquitl feeil are considered 
However, all the results of this pa|H:r remain 
valid if pressure drops corresp4>nding to a given 
pressure profile and lecd va|X)r fraction are 
introduced in the model: Hosenbrock's stability 
result applies and the closcd-hwip stability 
pro|x*riy (ITicorcm M can Ik extended to ihis 
case It suHiccs to consider in place of the 
function k. introduced m Section 2 2 . a 
colleciion of functions kj where j denotes the tray 
index kj enjoys the same properl its as A s hut 
takes into account the pressure on tray /. 
j - 2, , n Also, denoting the vapor 

fraction of the feed which is assumed to be 
measured or estimated, the liquid and vapor 
flows m the rectifying and stripping sections must 
be modified as follows: /, and V must be 
replaced by /. and V 4 for the rectifying 

section, L 4 F and V must be replaced by 
/- + (1 ” t^,,jA and V for the stripping section 
We now pnKxed as follows. Firstly, a physical 
mrHlel is obtained from assumptions 1, 2 and 3 
as in Espafia and landau (197H) For most 
industrial aflumns, this model is far Im) large for 
control purposes, but it can be used directly for 
simulation and comparisons. Scamdly, ihis 
model IS reduced by time-scale considerations to 
prrxlucc a satisfactory model for control. 
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2.2. A dasMica! phyxical model 

Under aKSumplions 1, 2 and 3. the dynamic 
mtHlcI of a binary aiiumn as displayed in Fig. 1 
is derived from the balance equation on each 
tray for one aimponcnt 

H,Xi = VklX}) ~ 

HfXf == Ijt, , + Vk(x,,,) ~ Lx, - Vk(Xi). 

/ = 2.- 1 

H„x ,^« /I + Vk{X,, *,)-(/, + FU;, ^ 

- \/k(x,^)^ Fz, ^ 

H,x, “ (L + F>, , + yk(x ,, i) - (F + 

- yk(x,), y=/,+ 1. rt-1 

\^H„x„ (/. 4 F)x„ I - {L + F~ V)x„~ VkixJ, 

where; 

/ denotes the tray index, I * y - 5 ; n, 
j - 1 corresponds to the reflux drum, j - jf to the 
feed tray and j ^ n to the boiiom (3^ ), 
n \)- 

n\ the liquid holdups (constant); 

X - (ty)(i ; ri) wre the liquid molar fractions; 
k(x,) is the vajxir molar fraction; k corresfHinds 
to the thermodynamic equilibrium [Kunt of the 
binary mixture [see Prausnit/ et ai (IMH())| We 
will call k the equilibrium function, 

/’ and Zf arc the feed flow and com|X)sition, the 
perlurbiilion variables; h is measured whereas z, 
\s not; 

i. and V' are the reflux flow and the rcboilcr 
va|>or outflow, the control variables 


System ( I) IS rewritten r ^ f(x\ L, V\ F, with 
fix. I..V.F.Z,) - U]U.L.V.F, „ 

where 


/,(.» . 1. V', F, z,) 

W1C(X;) “ V'X, 

.". 


== 2 . Jf - l ; 

l,(x. L. V. F. z,) 



», 1 4 Vk{x ,.- Lx, - V'A(jr^) 


w, 

fAx.L.V. F,:,) 


^ /.j:,, , 4 

- (L4 FU,. - V'k(x„)-Fz, 



for j ^ 1, + \ .. . 

..n 1; (2) 


/;u, L. V', F. 2,) 

{L 4- F\x, , 4 V'Afjf ,- (L 4 FVr, - FA(jt,) 

n 

fjx, L, V, F, If) 

{L ^ FU. ^ ^ F - V}x^- 

nr .. '■ 


Notice that / is linear with respect to L, V, f and 
Fzf, and that / is smooth if the equilibrium 
function k is. We assume once and for all that: 

Assumption 1. The inputs L, V, F and Zf arc 
continuous time functions from [0, +*{( 010 , 4-®( 
such that for ail ( e [0, L{t)<V{\) < L{t) ^ 

F{t) and Zf{t) e |(), I[; 

Assumption 2. The equilibrium function k and 
its derivative arc continuous functions from (0, 1) 
dk 

to[0. 1), - (>r) >0for all x e [0. I). ;t(0)-() and 
A(l) ^ I (sec Fig. 2). 

Remark 2. Assumption 1 means that the flow of 
the lop and the bottom products is positive. 
Assumption 2 is satisfied for all binary systems; 
Malcsinski (196.5) derives from the second 
thermodynamic principle that the function k is 
always an increasing function of .r. For more 
general situations, see the analysis of Kwaalen et 
al (1985), In practice, the equilibrium function k 
is obtained by solving the algebraic nonlinear 
equations of the thermodynamic equilibrium 
These equations depend on the particular choice 
of the thermodynamic model and arc generally 
solved numerically In the depropanizer applica¬ 
tion below the model of Soavc (1972) is used 

llic physical miHlel considered is simpler than 
the model of RoscnbrtKk (1%2) where vapor 
holdups and vapor Murphrec cfticiencies are 
considered whereas tray hydraulic eftccis are not 
taken into account. (3ur model can be seen as a 
particular case of Rosenbrock’s, which contains 
twice the number of equations, by neglecting 
vapor holdups and assuming l(K)9r tray effi¬ 
ciencies. For simplicity reasons, wc demonstrate 
directly, for (1), the Roscnbrock open-loop 
results (and complete them with a spectrum 
property) by using the theorem of Appendix A. 

Theorem 1. Assuming that Assumptions I and 2 
hold, wc have: 

(i) For each initial condition x" in the closed 
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subset [0, Ip. the maximal solution of 
i = /(jt. L, V, F, 2f ) 

is defined for every fe[0, *fx| and satisfies 
jr(/)e(0. ipfor all / e (0. +»(; 

(ii) For each L, V, F and 2 ^, there exists a 
unique steady-state x in )0. l|''. namely a unique 
solution of fix, L, V, F, 2 ;) = 0; moreover, if k 
satisfies /c(jr) > x for all jt e )0, 1(, then x satisfies 

1 > i 1 > > • ' > x„ I > i„ > 0; 

(iii) If L, V, F and Zf are constant and if 
Ip. then the system is [.yapunov-stabie 

(see Arnold (1974, p. 155)| and its sc^lution 
converges to the unique steady state asMxrtaied 
to L, V, F and moreover, for every 
X 6 [0, Ip, the Jacobian matrix 3f/3x has real, 
distinct and negative eigenvalues 

Proof of (/). It is sufficient to prove that the 
vector held f is oriented inwards on the 
boundary 3D of D ~ (0, 1 3D is made of the 
points (x,, . . . , x„) € (b, 1|'‘ for which there 

exists y e {1.n} such that x, ” (J or 1 , - 1. 

At such ptiints, it suffices to prove that t; if 
x^ - 0 and x,0 if x^ “ I lliis directly results 
from formula (2). □ 


Proof of (li) and (iii). We will prove simul¬ 
taneously (he existence and uniqueness of the 
steady-state, and the global asyrnpiotic stability 
by applying RoscnbrcKk's theorem 

In our case, p - n, “ /Yj,x* tor k - 

n. Q “ II (i), / 4 I and system (1) is 
* 1 

rewritten ^ = where ip is continuously 

differentiable. The dependence of <p with respect 
to L, V, F and Zf is omitted since they are 
assumed to be constant, llic preceding prmif of 
(i) implies that assertion (i) of Roscnbr<x’k\ 
theorem is satisfied From (1) we sec that for 

- L 

1=2 . n ~ \. v'i = V'l and ^ 

/ ^ f. y 

-with v, defined by (X)) Assumption I 

implies that assertion (ii) of RosenbrcKk’s 
theorem is satisfied. 

The Jaaibian matrix d(p/3t is the matrix J of 
Lemma 2 in Appendix A with p ^ n, 


( ^ II 

\H, 

/. + f t - V 



V -L 
H, 


y ^ 

’ Htdx 


{X 2 I. 


V dk i 
V7 7 

W. d* 


Assumpiiom I and 2 impiy that ihc veclors a 
and h have positive cxtmpttnenls. ConMM^uentiy, 
assertion (iii) of RoscnbrtKk's theorem is 
satisfied. More<»ver. Ixmma 2 implies that the 
eigenvalues of arc distinct, real ami 

negative. Since i^(5) “ Hf{H L, V, F, z,) 

with //'«diag|l/,.H,|, the eigenvalues of 

$//$x have the same properly. Asaeriion (iv) of 
RosenbnKk's theorem results from the lndia> 
gonui structure of the system 

Ii remains necessary to prove i e |(t. 1|" and 
the inequalities of (ii). Wc know that i f. (U, 1)" 
salisiics f{i. V', F, :,)=«(). ITtis is equivalent 
lo 

=(V - /.M.-f ^ F- V)i, (3) 


p-i; + (l -(“I. .1/1 


(4) 




/^ I. I (5) 

where (I) i.s obtained by simmiing all the 
equations of (1), (4) C4)rresponds io the sum of 
the y first equations and (V) to the sum of the 
n y f 1 last equations If ir, “ tl. then by 
induction on y in (4) wc have ^^11. Using (5) 
with / If 4 1. we have i,, - 0 Iliis is m 
contradiction with assumption 1 and (.^) 
Similarly, we obtain that i,# l, ^ b wnd 

i„ # 1 (Consequently 4 ,. j(„ r |0. l| By induction 
on i in (4) and (S), wc have i c |(), Ip It we 
suppose addilionally that k{.%) *.x (or all 
xc)0. l(, then relations (4) and (S) give the 
desired inequalities IJ 


2 3 Thr rrdm ed control model 

For industrial columns, Ihc dimension oi the 
above dynamic model is generally Urge (for a 
refinery depropanizer n -*‘40) It can be reduced 
b> limc-scalc con.siderations ITie standard form 
of a iwo-scalc system is (iscc Kokotovic (19H4) or 
Marino and Kokotovic (19H8) for cxamplej 

i' «/'(x\ x', u, w, r) 

. . . \ s (fi) 

f'i' , 1 . u. H', r ) 

where (jt', x ’) is the stale vector, the superscript 
•S’ (resp F) standing for slow (resp. fasi). u is Ihc 
control vector, w Ihc perturbation vector and f a 
small positive sc 4 ilar. Under .suitable assump¬ 
tions. such a system can be reduced lo its slr>w 
dynamics [by applicatKin of Tikhonov's theorem 
(Tikhonov et at., IIWI) recalled in Appendix B)) 

i'* =c|''(jr', x', u, H. 0) 

() = /'‘fx\x^, u, w. 11) ’ ^ 

airresponding to e » 0. 
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The model (I) is not in standard form (6). 
Nevenheless for physical reasons (the behavior 
of each tray is similar to that of any other, the 
resident time in one tray is much shorter than 
the resident in a "large” section of trays), we 
propose a choice of e and a diffeomorphic 
change of variables to express system (I) in 
standard form. More precisely, this can be done 
by splitting the column into a given number of 
sections of consecutive trays (called oimpart- 
ments), and by aggregation of each section 
separately. We now present the aggregation 
method on a given section of trays which gives 
an alternative model to the compartmcntal 
models of Benallou er al. (19H6) or of Espuha 
and Landau (1978). 

2.3.1. The reduced model of a section of m 
trays. 

Preliminary results t’on.sider ihe section of m 
irays displayed in Eig. 3. Its dynamic model is 

Hji « fj„ + E/t(ij) - fj, • Vk(x,) 

fljXj - Lx, + • IJ: • Vk{x,) 

fl„ ,.i„ . , U,„ 1 + Vk{x„) - U„ , 

- Vk{i„ ,) 

H„.t„ * /jr„. I + Vk{x„ ,- fj„ Vkix„.). 
where: 

ure the liquid holdups, 

I arc the liquid compositions; 

L and V arc the liquid and vapor flows entering 
the sccrum; 

jfo and k{x^,i) arc the compositions of the 
liquid and of the vapor entering the section 
{k IS the previously defined equilibrium 
function). 

The above system is denoted 


hand side of (8), Similarly lo the overall column, 
wc have the following open-loop behavior. 

Theorem 2. Afisume assumption 2 and that the 
inputs L, V, x^t and are continuous-time 
functions such that fur all refO, L{t), 

x\,(Oe[(). 1) and i„^,(/)€ (0, 1). 
Then the following assertions hold true; 

(i) For each initial condition i*' in (0, Ip, the 
maximal solution of (K) is defined on [0, -f and 
for all (6 (0, i(r) remains in [0, Ip; 

(ii) For each T, V, if, and , there exists a 

unique f (i/)y..i ^ it> 1 T 

/(i, L. V. x,>. = 

(iii) If the function.s L. V, x„ and are 

constant and if the initial condition x" lic.s in 
[0, Ip, then the system is Lyapunov-siablc and 

lim i(r) = X 

t ♦ ♦ * 

where /(i. T. V, i„, i^,,, ) = 0 defines the 
steady-state i. 

llie proof is a straightforward adaptation of the 
prcK)f of Theorem 1 and left lo the reader □ 

In the sequel we will use the following lemma 
relative to the steady slate i of (8) 

Lemma 1. Assume assumption 2 and that 
f >0, V >(1 and irv, 1 C onsider the 

unique steady-stale (Theorem 2) i € [0. I|"’ of 
(8). Ilicn k{Xi) and i^, arc continuously 
differentiable functions of IJV, i,,. 
denoted respectively Y'^(IJV, i„. i) and 
i). They arc related by the 

equation 

LX-(IJV, i„. i...,) f VY-(LfV, i,, .,) 

^ 4 i) (9) 


where i ^ and / denotes the right and satisfy 
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Proof, Notice thai (9) results from the sum of all 
the equations of (8) at the steady slate. It 
remains to prove (lO) and (11). The prot>f is 
similar for A""* and Details arc only given for 
y"”. We will proceed by induction on m. the 
number of trays, to prove (10) and (11) for 
Ixt us prove that the result is true for m » 1 
and V. jfi IS given by (8): 

L . , L 

since is a continously differentiable bijeciion 
from fO, 1) lo (0.1). i, exists, is unique and 
twlongs to (0, I|; /f(ii) is a regular function of 
LJW and is. The inequalities relative to > ’ 
result from the derivation of the previous 
equation 

Assume that the result holds for m - 1 1 and 

‘ Consider i “ (i,), , ^ the steady-state 

of (H) llien (i;., i„,) is the steady-state of 

the section made of trays 2 to m corresponding 
lo the m - 1 last equation of (H) By the 
induction assumption, we have 

where T"' ’ is continuously differentiable and 
satishcs 

0 Y^ ' - I 

3Y^' ' / 

0 ' —.• >. 

ai, V 

3Y^ ' i\k 

0-- . - (r;,,.,) 

Moreover, if i, ij > > i, »i. have 


i, is then given by 

4 /f(i,) - K'” i,. i^.i) 

( 12 ) 

the equation of (K) corrcsfH^nding to ihe tray 1. 
The left hand side of ihe abi>vc equation is an 
increasing continuously differentiable function of 
i, (use inequality amcerning the derivatives of 
Y^ ’ with respect to i/), nonpositivc for i| = 0 
and non-negativc for i| = I. Consequently, this 
function has a unique zero i, c |0, 1). /c(i|) is a 
continuously differentiable function, de¬ 
pending on L/V, it, and with values in 

(0, Ij. llic derivatives with respect to ii>, 
and L/V of (12) immediately give the desired 
inequalities concerning the derivatives of K"", □ 

Tme-scoie reduaion. Wc suppose that the trays 


arc comparable and that 1 c< m I>enoie 

W « II ftf the section holdup. Consider the tray 

1 

numbered l, {I, ,m). called the ag¬ 

gregation tray For each ; wc set ff ** ra) fi 
with 0 < I « 1 and a, ** 1 We have H 

(1 !! I Consider the following change of 

stale c«H>rdinale asscKiated it> ^ 



where the compitsilion of each tray / # j„ remains 
unchanged and where ihe ct)mf>oMlion on the 
tray is replaced by the weighted sum of the 
comfvosilions on ihc rn irays of the section. Ihe 
slate equations become 

'rnjH' - /:»„ ■» Vkii’,) V'*(if) 

I i'‘ f y_ \ 

, i'kixi ,) 

■ //i' - Li„ 4 vk{i .„,,) iJl Vk(i\) (14) 

( i' - r y o,a' \ 

I 

4 /j'., - 

^ mx^.,) Lxl - Vk(xl) 


and arc in Ihe standard form (6) The slow and 
fast subsystems arc thus described respectively 
by 


' Hi^ = U„ + Vk(i„,.,) - fJl - n(if) 

(I = tJi„ 4 V/tCi j) - /.it - ^k(S[) 

* 0 = fjc^_. 2 + (i ') - fjcl -, Vk ( xl I ) (15) 

(»«/>' + Vk{il,2) - 
. n» /Lr: , + i^*(i„.,) - Lxi, - mC) 
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and 


arj/y~ => lJ(t f Vkix^) - lJc\ - Vk(x[) 
dr 


a,. ,-^Vk(x^) 


dr 


“/- • I '' '*■ (* f,. j) 


Ul ,~Vk(xl ,) 
r'4 Vk(i^^,,) 
Ul^,- Vk(xl.,) 


(16) 


a„.H^'” - U:,. , t Vkix„^,) 
dr 

- Vk(x!„), 

with T = l/t: in (16). Wc denote i' ==• {x^)^. 


Theorem 3. Wc assume lhal ihc equilibrium 
function satisHes Assumption 2 and that /., V. r,, 
and ,, arc continuous time functions such that 
for all / f [0, Lit), V^(0< |0, 4„(r)e 

(0, 11 and ♦ i(0 H t *i\ If the 

initial conditions of (14), fc' and of (15). 

i' ", have their com^xments in |0, l|, then (14) 
and (15) admit continuous solutions on |0, f^(, 
denoted respectively (f'(r. f). t^(f. / )) and 
(jc'.(r). satisfyinn 



uniformly on every interval of the form (a. T] 
with 0 ' a < 7. 


Proo/, Let us verify that all the assertions of the 
likhonov’s theorem (Tikhonov ei al . I9S0) (see 
Appendix H) are satisfied; 

• Lxistence of the solution of the perturbed 
system (U) rheorem 2 proves that (14) ad¬ 
mits a solution (i'(r. r). a^(r. i )) on (0. ^ x[; 

• Lxistcnce and stability of the fast subsystem 
(lb): in (lb) I,, V\ i„. i„,,, and i' arc 
constant purameters. consequently, (lb) is 
made of two decoupled section of trays, the 
first one corresponding to the trays 1 to - L 
the second i>ne to the trays /„ 4 1 to m: 
Theorem 2 implies lliat if x' e |(1. IJ, system 
(lb) admits a unique steady state, and if the 
initial condition lies in [0. 1|"* then (lb) is 
globally asymptotically stable, moreover, its 
Jacobian matrix has distinct, real and negative 
eigcnvaluCsS; 

• hxistence of the solution of the slow 
subsystem (15); if fuc[(). I|, the algebraic 
equations of (15) has a unique srdution, io. 


corresponding to the steady state of (16); 
using Lemma 1, (15) becomes 

77jt^ = ZJr,, 4- Vk(x^,\L/V. Xu. iii) 

- LX- HUV, 

the prcK)f of the existence of the solution for 
t € [0, 4 -xj| and remaining in [0, 1| is similar to 
the proof of (i) in Hicorem I (use (10) of 
Lemma 1) and is left to the reader. □ 

Remark 3. Expressed in a less mathematical 
form, the result of Theorem 3 becomes very 
simple. The dynamics of the whole section can 
be approximated by the dynamics of a section 
where the holdup profile is modified as follows; 
the trays j have no holdup (()--*>//^), the tray 

has the section holdup ( E Z7^ 77;,) Notice 

that the global holdup remains unchanged 
2.3.2. The reduced model o/ the column. 
Consider now the overall column. Tlic choice of 
the compartments (sections of consecutive trays) 
has to lake inti^ account several considerations 
concerning the holdups For most columns, the 
holdup profile is as follows 

• rhe holdups on external trays 1 and n (reflux 
drum and bottom) arc much more important 
than the holdups on any other tray (trays 

2.fi - 1). 

• The holdups on external trays are comparable 
to the global holdup of all other trays; 

• The holdups on trays 2 lo n 1 are 
comparable, 

fhe aggregated model should simultaneously 
have a small dimension and represent correctly 
the column dynamics 

Wc can consider that the two external trays 
have their own slow dynamics. For the trays 2 to 
f! “ I. the number of compartments constitutes 
a degree of freedom, In the case of the 
dcpropani/er described in the discussion below, 
open-loop trajectory comparisons belwcen the 
physical model and different aggregated models 
(aggregated models of orders 3, 4 and 5. 
corresponding to aggregations of trays 2 to n “ 1 
in respectively I, 2 and 3 compartments), are 
displayed in Fig, 4. They correspond to 
variations of the feed composition vSlightly more 
severe than what is usually observed in practice. 
They show that a gcxxl tradeoff between 
accuracy and dimension can be obtained with an 
aggregated model of order 5 
In the sequel, we consider a 5-compartfncnt 
aggregated mcxlcl as displayed in Fig. 5: 

• The two external trays remain unchanged, 

• The other trays arc decomposed into 3 similar 
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Fig 5. THe aggrcgatioti in 5 ocmipiirtincnu 
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its aggregation tray j (2 < r < /, < jf <j, < s < 
n). 

According to Theorem 3 (sec also Remark 3). 
the reduced model is desenhed by the 
differential-algebraic system 

' « V'A:(ji,) - V'r, 

0 1 + i'k(x,,,) - U, - V'A:(.i,:i. 

/ = 2. . , r - 1 

HrX, » /j, , -i V'A(i,,,) - Lx, - V'A:(a,) 

11= Lx, , + V'k(Xi,i) - Li, ■ i'A(A,). 

y “ r 4^ 1, , if ’ I 

* ri/,., -f - (/. + F)x,, 

. -Vk(x,,)~F2, (17) 

0 = (/, + /•)., , + v*(ji,.,) - (/.4 n«, 

t'A ( l,), j » I, 4 1..1 1 

H,x, = (/. 4 (•')», I 4 V'C(x..,) - (I- ■* F)X, 

- C^A(.«,) 

((-(/, 4 h')x, I 4 V'k[x ,, i) (/ + F)x, 

~ ). / •» .1 4 1.n “ 1 

^ fu. - (/- + n*. , - (/- + f r )4„ V'A(i„), 

where 

//, = //,, /(,= <;//„ /F,-Vw,, 

J, i) 

n 1 

The substitution of the algebraic equations into 
the 5 differential equations preserves the Iri* 
diagonal structure of the original system (1) and 
gives the aggregated model 

Jr, ='/i(r,, r,. /.. V) 
i, ^/.(r,. r,, !., V) 

r,,. 1.. L, V. h. Zf) 

< T. V'. /■) (18) 

x^, L, V. F) 

y\^ 

ft results that jr^ « (r,* x,, i,, jr„), and x^ 

correspemds to the liquid a>nipositions of the 
remaining frays. (18) is called the control model 
and: 

y, and Vj arc the outputs; 

L and V arc the a>ntrol variables; 

Zf is the perturbation; 

F n a measured input; 

The vector field / can be defined only with the 
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functionti Y”' of Lxrinma 1, 
jr,, U V) 

«^ (V - L)x, 4 vr Hliv, Jip ji,) u, 

L. V) 

- /.jr, - V'r '(/./I/, 

^V/y/r - '(LIV^x,.x,^) - Lx, 

HfJi^ix,, x,^. X,, L, V, F, Zf) 

^Lx, - VY^> ' '{LI V. 
iVr '{{L^F)/V.x,,x,) 

(L 4 F)x, 

lU{x,^.x,.x„,L, V. F)^{L 4 ^ K 

- vr V V(/. 4 F)IV.x,^,x,) 

4 * '((/. 4 F)/V,x,,x„) 

- (/- 4 F)x, 

llfJx.^ X,,. L, V, F) - (7. 4 F)x. 

- V'r ’ '((/. 4 F)IV. r,,jrJ 

- (/. 4 f- V'U,. 

F'r(un nciw on. wc shall only work with this 
control model. For obvious notalional reasons, .r 
and /. previously used for Ihe physical mtKicI, 
remain unchanged since no ambiguity is 
p<»ssiblc; X ® (x ^, t,, v,,. x,, ) and f ” 

"I'he proposed reduction preserves the o(H*n" 
loop behavior id the physical model 

Ihrorrm 4 Assume that Assumptions 1 and 2 
hold, rhen we have the following assertions: 

(i) For each initial condition r'* in the open 
subset (tl. Ip, the maximal solution of (IK) is 
defined on |(), 4oi| and remains in |(), Ip 

(ii) For each L, F, F and Zf, there exists a 
unique steady state x in |0. Ip of system (IH) 
Moreover, if A (a) -r for all .re |(). l| then x 
satisfies 

I - i I > i, .t, ‘0. 

(iii) If the functions L, V'. F and Zf arc 
constant and if r" lies in |(l, Ip. then (IH) is 
Lyapunov-stabic and its solution converges to 
the unique steady-state assiKiatcd to L, F, F and 
Zf \ moreover, for every x t |l), l)\ the Jacobian 
matrix 3f/3x has real, distinct and negative 
eigenvalues 

The proof I.S a .straightforward adaptation of that 
of Theorem 1 using Lemma I. □ 

Remark 4. Our method is of the same spirit as 
Benallou r/ ai (1^86) or as Espaha and Landau 
(1978) since it prixluccs a reduced mi>del of the 


column where dynamics of trays are replaced by 
dynamics of sections of trays. 

However, if we assume piecewise constant 
equilibrium, our model is not a special case of 
Benallou et al. (19H6) compartmental mixicl l^i 
us recall the Benallou et al, compartmentation 
assumption; “The dynamic behavior of a section 
of stages, or a compartment, can be represented 
by that of a single stage having the same holdup 
as the total compartment holdup and the 
composition of the compartment sensitive 
stage". ITic dynamic behavior of our aggregation 
tray does not satisfy this a.ssumption since, even 
if steady stale coincide with the ones of the 
compartment sensitive stage, transients may 
differ. More precisely, if we apply the reduction 
technique of Benallou et al. (19H6) to the 5 
compartments case as displayed on Fig 5, we 
obtain a reduced model whose structure docs not 
remain indiagonal whereas our aggregated 
model does fhis results from the application of 
ihc equations (24) to (32) in Benallou et al. 
(19K6) One can verify that the differential 
equation corresponding to the feed compartment 
depends, in Benallou et al (19Kb), on i, and i„, 
the product comi^isilions. whereas, in our 
aggregated model (IK) it does not On the other 
hand, as in Benallou et al (19Kb), the steady 
states of the outputs v, ■ i , and \:-x„ arc 
prc.served whatever the inputs L. V'. F and Zf 
are 

Contrary to Fispaha and Landau (197K). wc do 
not use bilinear approximations of (I) for which 
the calculated molar fractions do not necessarily 
remain in (1), 1] Moreover, no idcntihcalion of 
compartmental parameters is needed here 

Note also that the qualitative dynamic 
behavior of our aggregated model is deduced 
from the stability analysis of Rosenbrock (I9b2) 
whereas, for the reduced models of Benallou et 
al. (19Kb) and Fspaha and l.andau (197K), this 
analysis remains to be done 

Remark S, We can enrich our model by 
including hydraulic effects due to the liquid 
flowing down from tray to tray These dynamics 
that have been neglected in the physical model 
(I), are, for most industrial columns, much 
faster that the slowest part of the dynamics of 
the compositions and include time constants 
similar to those of the fast part of the 
composition dynamics Moreover, the applica¬ 
tion of the Tikhonov theorem to a physical 
model including such hydraulic eftects will 
produce the same aggregated mixlel (18) since 
for the .slow hydraulic model the liquid holdups 
remain constant. This is why wc presented the 
analysis without such hydraulic effects. To fix 
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ideas, the time constants on the depropanizer 
which IS considered below, are around mn for 
hydraulics and more than M) mn for the 
compositions. 

} the: nonlinear conthol i aw 
This section is devoted to the application of 
nonlinear pcnurbalton rejection techniques on 
the control model (IH) In most of the 
theoretical results that have been developed for 
nonlinear systems, the controls and the pertur¬ 
bations appear linearly (see Hirschorn. 1%1; 
Isidori et ai, 1981; Isidori, 1989). However, the 
extension of these results to our problem, where 
this dependence is nonlinear, does not present 
major difficulties 

Firstly, we establish, on the control model 
(18), a l(K'al constructive existence result of a 
feedback law rejecting feed composition distur¬ 
bances with stability llien. we show how such a 
control law can be synthesized as output 
feedback when temperature measurements arc 
considered. Finally, the implcmentaiion on a 
rchnery depropanizer is presented 

3 1. S'ontinear disturhance rcfiriutn M ith stahihry 

fh(‘(}rem 5. Assume that assumption 2 holds 
and additionally that for all i c |i). 1(. A(.i) - i. 
Consider the dynamic system (IK) and a 
steady-slate, x, corresponding to / . \ . / and z, 
satisfying assumption 1 Ihe associated steads- 
slate values of the outputs are denoted \\ and i;. 
I'hen IcKally around i, the hdlowing assertiims 
hold true 

(i) There exists a unique control law (/., F). 
solution of the nonlinear algebraic system 

fAx,,x,, L. V) 0,(xi. I',) 

1,, L, V, /') = v.) 

depending on i ,. x,, i,, /* and on (r,. is) 

which are the new control variables, the 
closcd-l(H)p dynamics of the outputs are 

V, = 0, (>i. t' I) 

y. 0.1 y-. *’ 2 ), 

where and (p^ arc arbitrary smmnh functions 
such that ^»i(Vj. (I) ” and ^ and 

r “ (I'l, t’ 2 ) being the new control vector 
( 11 ) If the closed-loop dynamics, <pi and 
are chosen asymptotically stable, then the 
overall closcd-kx>p system is asymptotically 
stable. 

Remark 6 llte additional assumption, 4(x) >x 
for all xe )(). 1[, physically means that the first 
component is the light one For a large majority 


of bmary mtxtua^s whether Vi c )(), 1|, lc (jr ) > x 
or Vi € p, 1|, 1 - k(x) > 1 -- X and one can 
chiHise (he light component m firm one, 
Cofisequenily, the same rcsuli holds true if 
kix) < 1 for all x € }0, Ij 


Pr(H\f of (r) ITtc control law 1 $ necessarily the 
solution of the nonlinear algebraic system 
(Lsidori. 198^) 


.Vt ^ X, w /,(x,. x,, L, F) I. tf,) 

V: ^ L, F. f) »»:) 


( 21 ) 


Let us prove that this svsicm is hH ally invertible 
at the stcady-siaie by using the implicit furKtions 
theorem 

With (19). (21) bcasincs 


{ >-) *1 


t'l) 

'V’’. 


II 


I , / 




V 


V" 


/. + h 

.' V' 

('*' 


l).>, (21) 

4>. \ V;, I'r) 


X*. 


I- 


(I 


Ocntiic 11' and IT the Ictl-hund side (uncinms ol 
(22) At the slcady-Mate, i *. <p, ipj " “•'‘I 

(/., 1) vcidies (22) l.ci us compute the 
Jacobian matrix <*1 (22) J:(.») •» for all x t )<). 1( 
implies that (II) holds true for V" ’ and K" ‘ 

( onsequcnlly. at the steady state, 

jir _ V'jii’ 1 

j/, " / W " V' s/jy ' 

u»ir' V air 
di T J v 


Uv. 


x, > 


av" ’ ’ 

3(1. 4 n/v 


). () 


This implies that, at the steady state. 

i an'air I jaii'air 

i a/’, 3V I ■’ ! 3V 31. ' 


since by assumption I wc have 1 and 

F ^ 

b- V ;• I ITic Jacobian matrix of system 


(22) IS thus regular The implicit function 
theorem ensures the existence and uniciucness. 
in a neighbourhcKHJ of (i ,, x,, i,, L, \\ / ) 
and of I ,-0, of the solution (L,V) of 
system (20) Tliis solution depends regularly on 
(x,.x,.x,, x„, F, IN), ^>2(^2. *'i)) n 


PnH>f of Ui). Since and ip^ arc chosen 
asymptotically stable, it suffices to prove that the 
zero dynamics (see Byrnes and Isidon (I9H8)) is 
stable This is shown directly by application of 
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the Routh-Murwitz crilcmm |see Gantmacher 
(1966) (or cxampkl on the linear tangent 
approximation at ihc xtcady xialc. 

According to (i), Ihc unique xtalic feedback is 
locally given by 

L - X,, X., X„, F. 0,(X,. K,), <t>2{x„. Oj)) 

V-^ S;(x,, X,. X., X„. F. (P^(x^. I'l), <p 2 (x„, V;)). 

where H, and arc continuously differentiable 
functions. The closed-loop dynamics arc thus 



= 0|(X| 

. t'l) 






X, 

= 4(^1. 

X,. X, 







*il-r 1 

. X, , X, 

■ X„. F 


. ''l 

). <P?(x„. 




1 x,, X, 

. x„, F 

. 0i(<i 

- 

i). 0;(x„. 




X,,. X, 


. X,, X, 


, F. 



0.(»i 

, 1',). 

<PAx„. 






H.(X| 

. X , , K, 

. /• 

. 



(23) 


0i(j;i 

. I’ll, 



- 

I 


a, 

-A (.*,,. 


, — l(-* 1 

. X,, X. 

. Xm 

, A. 0,(-v 

1. t'l). 



. »';)). 

E,(X|, 

x,. X,. 

Xr. . 

F. 0,(x, 

. I'l). 


<PAx„ 

, vA), 

/•) 






0,.(X, 

t. V.). 







Ihe dynamics of x, and („ are decoupled and 
stable by assumption ( onscquently, (he sta¬ 
bility, around the steady-state i, is ensured if 
the zero dynamics, obtained by setting ip, to 0. 
()>,. to (I. X| to i'l aiul »„ to iv in (23), is 
asymplotically stable Ihal is. if 

>3 “/,(>’|. »,,, H|(V|,t,, V;, F. 0, tt), 

H;(> , , X,, X,, V. , /, 0, ())) 

»/, * /„(->- ii(.Vi. ,V:. F. 0. 0), 

E,(ii. 1 ,, , 1 ,. v,. /•, (I, 0), F. ) 

». ' V.'. F. 0. 0), 

Z..(v,, t,, t., V,. /•, I). 0), F) (24) 


is asymptotically stable 

In the remaining part of this priMif. all 
functions are evaluated at the steady-state For 


31. 


simplicity's sake, we also denote in place of 

as, 


3x, 


3x. 

, and the same for V The equations (22) 


defining the control law bectsme 


> ’ ■'( . v'l. ) - Vi * 0 

I + F 11. + F \ 

.V 0.V: 

/. 4 f 


. 1- + f \ 

^. x,. v,) = II 


when 01-4*2*’If- The inequalities (11) imply 
that 


V dL 
I + F~dx, 


dV , dUV „ 
<0, -^<0, 
ax, ax, 


d{L ->rF)I V 

3x, 


(25) 


5x, ' <3x, 


L aF 
Vdx, 


d{L^F)IV 

axT~~ 


<0 

(26) 


Using (19), the closcd-hMip system (24) can be 
rewritten as follows; 

H,x, = ~gi +g, 

'V/, =/"'v - ff'(27) 

— gn 4 gj, 

where g,, g, and g„ are the following 
functions of (x,, x,,. x,) 


gi(-r,. X.) (V'(x,, x.) - l.(x,. i,)))'| 

g,(x,,x„,x,) = V(x,.x,)Y" ' '( ^.(x,), X,, x„ j 
-/,(x,,x,)x, 


g,(X,.X„, X,) = [l.ix,, X.) /•■).v„ 

-F(x.,x.)V'' " ‘(~y-^(x.),x„,x.) 
rj ^ (/.(x,. X,) 4 F ^ r(x,. X, ))>., 


Lcl us now compute the tangent linean/.ation to 
(27). (26) and ^^,“0 at the .steady-state 

3 

imply that ^ = (J. Symmetrically, wc 

^ 3x, 

o 

have : -^„) = 0 Consequenilv the matrix 

3x, 

A corresponding to the tangent model of the 
zero dynamics (27) has the form 



inhere; 




^>1 


%I _ 3g. 

dx/ -^dx,’ 3x/ 

i7X, 3x, dx,^ 


04 = 


5x, ■ 
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The eigenvalues A of A are solution of 


01 + 02 


-A 


02+^2 ® J ^ J 




0 




-’-A 


I) 

b 

H 


0 


h, + A, 


= 0 , 


or equivalently of 

01 + 02 —/?,A 01 0 

j0i-/);-//,A -W„A f)| - 04 -/y,A 1 = U 
0 h, h, + h,-H,k 

Wc have 


0, +03 


5(L -V). -/.r,) 

3x7” ' ' 3x. . 

L + F-V _ 3L VV" ' ' - (/. + F)x, 31. 
/- + A 3x, /. f /• 






> 3x, '^^' . ""dx, . 

’"'ZT7'"' ' ~3l/v" I '"3x7' 


/. 


- 1 

.1.7- 


(use ai the steady-stale. (25)4 (HM with 

m - jf - r - ] and x, playing the role of 17 ,, 
y, >i,) Consequently n,Similar com- 
putations give 

Q y >0, d, ' hj 0, h, a 4 < O4 

hi > (I, h I "♦ />4" 0 

I>cnolc 


n, = 

and 

^.= 


41 1 + 41; 


H. 

hi ^ hg 


Oi * 






fl, “ />; 

77” 

h, - fl, 

w 


n 


fty- 


h, 


(k^, (^ 2 , a%. Pi, p 2 and P^ are positive The 
characteristic polynomial of A is then 

^ (Oi ^ Pi O, 4 P^)k^ 

4 {(i\P\ 4 

4 aypi 4 4 pxai)X 

4 02^1^1 4 PjP^Q). 

Wc have 


OTi 4 4 O, 4 Py > 0 

4 OfiO; 4 a^/}, 4 p ^2 ^ P^^\ ^ 


Q2^%P\ PlP^^l 

(*i ^ P)^ Py)(^\Pi 4 a^aj 4 a%pi 4 

4 Ps^i) > ^ PiP^<^i 

The desired stability result follows from the 
Routh-Hurwiti criterion □ 

Remark 7 The preceding result is only a kKal 
stability result. Simulations show that stronger 
stability pri>perties should be es|KCled, but we 
have no prwf of them On the other hand, it 
should be noticTd that, in (i) of ITieorcm 5. 4*i 
and ^2 can be chosen in order to folUm an 
arbiirarv slow reference rntnlel It results that 
set-|xunt changes arc easily handled by such a 
amtroi technique. An integral action can be 
added through i*, and U; in order to remove 
static oflscls fwtween the control model and the 
real column 

Remark H Tquation (20) shows that is nol 
required to compute the control law. This results 
from the special triduigonal structure of the 
reduced model (IK) and from Ihr. disturbance 
rcjcciKui mclIuHl More precisely* one can show, 
using the rcsulis of Isidon (I'tIHM), ihwi the 
characteristic numbers ol the outputs >1 and vi 
with respect lo the turnirol arc /ero which means 
lhai the control variables affect the first lime 
derivatives of y, and y> ‘rhe [icrturbalion 
rejection methml consists in making unobser¬ 
vable all ihc stale variables which are affected by 
the pt*rlurbations and which need a larger 
number ot derivations lo affect y, and Vj 
Indeed, otherwise they would reintroduce the 
effects ol the pcriuibations in the outputs. 1 ’his 
explains why the feedback makes . 17 . and x, 
unobservable through y, and yv and why x,,. 
which affects ihc outputs after 2 time deriva 
(ions, docs not apjx^ar m the control law Note 
that Ihc same results would hold true with more 
compartiTicnis and that the feedback scheme 
would remain Ihc same Namely, this would 
produce only an increase of the number o( 
unobservable stale variables by a lecdhack law 
still defending on 4 slate variables 

Remark 9 I'hc closed-hxip analysis has been 
done under the condition that A(x) vi for all 
x€ )fl. 11 A/eotropic mulures (see Prausnitz ei 
al (IVK^)) for example! do not satisfy such 
conditions Nevertheless, the same result tan in 
fact be proven by assuming (hat A(x) * 1 , 
Vx ^ )(), a\ and k{x ) < x. Vx c Ju. I( where 
fl 6 (n, 1 ( IS the azeotropic composition (A(<i)«^ 
a). l*he reason is that the steady-state composi- 
iKins are ail on Ihc same side of a if if 

3. 2. Synihem by output feedback 
The cxinlrol law of llicorem 5 depends on 
(x,, X,, X,, x„, f) and on the reference mtxlel 
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(21), In practice, the product compositions 
(Xi.x„) and the feed flow f are measured. But 
the average compositions (x,, xj in the rectifying 
and stripping compartments arc not measured 
Nevertheless, (x,. xj can be estimated by means 
of well placed temperatures which leads to a 
reasonable approximaticm of the control law 
With the cc|uilibrium function /c, the equations 
of the thermodynamic equilibrium also give the 
temperature T on each tray as a function of its 
liquid composition x (sec Prausnil/ et al , 19K()): 
T ^ B(x). We now prove that 7’ and I\, the 
temperatures on the aggregation trays r and a, 
can be considered, at the order zero in t , as 
functions of Xr and x, respectively, and thus can 
be seen as additional outputs for system (18). 

Ixrt ufi return to (he compartment of m Irays of 
2.3 I. Consider (he tem[>cralure of the aggreg- 
alcd tray 1]^, and its liquid composition, 

We have; ^ B(X| ). x,^ dc|;H:nds on the slow 
variable i' hut also on the fast variables as 
follow.s: 

- S \' - f 

X - / L 

I - ^ f L c\ ) 

l^tM 

At the order 0 in r. x, - t\ Consequently, 
/j^» 0(i')-t 0(f ), for the overall column, we 
have similarly 

7’ B(x,) 4 0(f) and I\ - 0(.t,) 4 (7(r). 

ITiis implies that x, and v, can he estimated via 
temperatures on aggregation trays r and a. 
Moreover, these estimates do luu contain fast 
componcni.s at the order 0 in r ITius the 
feedback law where i, and \\ are replaced by 
0 '(T,) and 0 '(7[) neither destabilizes the 
neglected fast dynamics nor the aggregated 
closed-loop system Otherwise staled, the 
proposed synthesis by output feedback does not 
remix the time scales of the original system [for 
an extended disscussion sec Kokotovic (1984) or 
Marino and Kokotovic (1988)1 
lo summan/c, the contrt)! law can be 
computed with the following online measure¬ 
ments 

• The product compositions, x, and x„, 

• 'rhe rectifying temperature on tray r. 7‘; 

• The stripping temperature on iray v. 7,; 

• The feed flow, l\ 

We have observed that the pr^sition of the 
aggregation trays r and s d(K!S not require great 
prccisKm. For the depropani/cr described below , 
several choices of r and s have been explored 
The corresponding simulations show only slight 
differences. An important bypriHluct of this 


approach is chat, when the setpoints remain 
unchanged for a long period, the measurements 
of the prcKluct composition (l”yi,y 2 ) arc not 
necessary. Consequently, failures on these 
measurements can appear without significantly 
affecting the behavior of the control law 
Notice that it results from Remark 8 that the 
number of on-line measurements (temperatures) 
doe.s not depend on the number of compart¬ 
ments of the reduced model. 

3.3. Implementation on a refinery depropanizer 
The control law of Theorem 5 has been 
implemented on a refinery depropanizer (a 
binary column splitting a mixture of propane and 
butane into two products the lop product, 
essentially propane, and the bottom prtxiuct, 
essentially butane). This depropanizer has the 
following characteristics: 

• 42 theoretical trays (n " 42), feed on tray 21 
(^ = 21). 

• The holdup prnhle is as follows: on tray I 
(reflux drum): Nlkmol; on trays 2 lo 41: 
2kmol; on tray 42 (bottom): 3(Jkmol. 

• I'hc top pressure: 1^ bar 

• A typical steady-state is; saturated liquid feed 
flow of 5 kmol/min with a propane molar 
fraction around (I.3.S. a reflux flow nf 

kmol/min, a rcfniiler vapor outflow of 
7 kmol/min, prt>iluct purities of O butane 
in the lop product, and ol 0 Vr propane in 
the fxiitom product 

For this column, the modeling assumptions are 
valid, and the hypi>lhesis of rheurems I, 3. 4 
and 5 are satished The real-lime control law 
depends on: 

• The molar fraction of butane in the lop 
product; 

• The molar fraction of propane m the bottom 
product; 

• The rectifying temperature on tray 11; 

• 1 he stripping temperature on tray 33; 

• The feed flowrate, 

• The lop pressure as a parameter in the 
thermody n a m ic ca leu I alions 

It should be mentioned that the two composition 
mcasuremcnis are obtained with a delay greater 
than 5 min. The hrsi control L, the reflux flow , is 
directly measured and regulated llie second 
control V'. the reboiler vapor outflow, is 
proportional to the reboiler duty which is 
measured and regulated. TTic thermodynamic 
model (the functions it and 0). used lo represent 
the binary mixture propane-butane, is borrowed 
fn)m Soave (1972). 

We now present records of real data relative 
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to this depropanizer. On Fig. 6. the variationi^ 
over 10 hours of the priKluct compositions 
(1 - Vi and >s). of the control variables (f. and 
V) and of the measured input (f), are 
displayed. At lime 0, the control law is switched 
on: the objectives are set to U.5% butane in the 
distillate (setpoint of 1 - Vi) and to 0.3^; 
propane in the bottom product (setpoint of y.) 
These data suggest two comments. Firstly, 
though important initial offsets exist IxMwcen 
outputs and setpxiints, the objectives are 
reached in 5 hours (the lime-constants o( the 
linear first-order reference models are around 2 
hours). Secondly, the outputs arc only slightly 
modified in spile of severe variations of the feed 
fiow' F (more than 4()^r in 15 min) Fhis 
demonstrates that the nonliner control law wtirks 
in a large range of operating conditions and 
rejects the perturbations asympioiically. 

lo conclude this section, we have compared 
our control technique with the following classical 
SISO method: 

• Ihc reflux flow /. IS pro|XJrtioniil lo the feed 
flow F with a gain slowly adapted by PI 
controller depending on the lop composition 

,Vi' 

• The reboilcr duty propntional to V is 
controlled through PI action depending on the 
stripping lemfK'raiure /, 

Figure 7 displays on-line data relative to the 
same depropanizer where the nonlinear uintrol 
IS removed after t- .V>() mm and is replaced, in 
the absence of feetl fK'rturbations, by the SISO 
control dcscrilxd above The bottom quality 
remains acceptable whereas the lop quality 


:"V< 


V'l 





Fk« 6 Plant daiii impIciTKiilation of the afupcgjitrd 
fionlincAr ctmirol fwi a rcfWMrry ckpf «i|>aniicr 






4') ' {■> 


:> I .v‘ 




'IV' 

7 Plum ilaiii. aimpuriKoii iKiwcen iKc uggic gated 
nnnlinrjir coniinl uiul u lUvMiu) SISO conlrol Irtttnitjur on u 
fchncrv dcpriff^anifn 

slowly lucorncs out of spiTifications. litis SISO 
controls the quality of one of the iw'tt prtKlucts in 
a quite satisfadoiy way. but it is unable lo 
control simultaneously the lop ami l>otlom 
product qualities. 


4 l)|S( DSMON 

All the dynamic simulations presented m this 
section corresfTond to the refinery depropanizer 
of the preceding section and arc obtained via the 
dynamic simulator SPFIFDUP (User Manual 
(19KH)1 Numerical integrations start from the 
same steady-stale characterized by: 

• Feed flowrate 5kmoI/mm, reflux flowrate 
5.dHK kmol/min, vajKn leaving the iclwiilcr 
6.957 kmol/min; 

• C’olumn pressure IS bar; 

• Feed composition: 2.5% ethane, 35^^ pro¬ 
pane, f4l% n buiane, 2.5% n-pentane. 

During the first HI min. the feed compositions 
change lo the new values: 2.5% ethane 
(unchanged). 2tl% propane, 75% n-bulanc, 
2.5% fj-pcniane (unchanged) After that, all the 
entries remain unchanged, lire thermiHlynamic 
mixJcl used to represent the liquid- vapor 
equilibria is (he ,Soave mcKlel (1972). ITic 
open-l<H)p responses can be seen on Fig. 4 where 
a similar perturbation of the feed composition is 
introduced. 

71ie .sci-poinis arc: 0,5%. n-bu(ane in the top 
product, 0,5% propane in the boliom product. 
Notice that apart from the two key components 
(propane, n-butane), we add two other scccm- 
dary ones, present in practice in small quantities. 
In llic conlrol law of llicorcm 5, the output 
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dynamic!) (the tunciiom d*i »nd ^2) ^re arbitrary 
.nable dynamic!*. For the .simulation tests, we 
chiHMe 

V -) - Vy 

ipi(yi.vi) ^ '— , 

cr a 

where a = 10mm is constant, i/, = 0.995 is the 
lop set-point and ^0.005 the bottom one (the 
component chosen to write the balance equa> 
tions is the n-butanc). 

Our control technique is now compared with 
other linear and nonlinear nonaggregated 
methods. We do not consider errors on the state 
measurements .since an observer ought to be 
designed in each case and the comparisons 
would be hazardous Only robustness versus 
delays is studied. 


4 I Why nonlinear contror^ 

We compare, by simulation, the performance 
of the nonlinear control law of Theorem 5 with 
the linear geometric control law of I akamatsu ei 
al. (1979) This linear control law is the solution 
of the linear system 

n, i/). ; hV ^ (Si, (lif I I rt, ,u> ,) 

X Ac, a , .(u, , I U; ;) 

X dx 2 ■ u I .fj. ^ dx K 

I iV. f .. AV' - Av„ „ , A.t„ , 

h,, , Af. 


where 


/ I ; arc obtained by 
lincuri/ation at the steady state, 

(Al,),. are the deviations oi the state r (sec 
system (I)). (A/., AT) the devialii>ns of the 
control ( / . T) and AA- the deviation of the 
measured input / ; 

, and Ai„ arc the closeddoop output 
dynamics, chosen linear and stable 

( 28 ) 


with fil "^ 5mm. a constant and Ai , - 
U, , A.l| f 2 Al;, 

In simulations, we suppose that the part of the 
stale required for control is measured directly 
(the composition of propane on tray 1 and 2. 
used for the control, are calculated by I minus 
the true compiisitions of n-butane on these 
trays). 

Figure 8 corresp^mds to the closed-lcK>p output 
responses to feed composition perturbations, 
firstly when the slate is perfectly known and 
secondly when a measurement delay of 5 min is 
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F ir. H SimuUuon daU, aimpanson between the aggregated 
nonlinear control law and the linear gcomeinc control law 
(depropuni/er, slep change of (he feed composition) 


mlKKluccd This delay corresp<mds to the 
resident lime m the chromatograph, ihe 
composition sens4)r generally used for a de¬ 
propanizer The linear control law works better 
than the nonlinear aggregated one if the 
measurements are perfeci and without delays. 
But, the nonlinear aggregated control law is less 
sensitive to measurement delays, whereas the 
linear one blows up in their presence. 

In other simulations, we have observed that 
the parameter 0 of (28) must be carefully 
chosen: if ^ is tiH) large, for instance greater 
than 10 mm. the linear control law destabilizes 
the column The gains of the control law must be 
large enough to maintain the linear model in its 
validity region that seems to be small 

4 2. ViTiy aggregunon 

We have also compared the nonlinear 
aggregated control law with the nonlinear 
control law rejecting feed composition distur¬ 
bances in the system (1). 

W'c have proven in Levine and Rouchon 
(1986) that, at the steady-state, the nonlinear 
control law of Gauthier et al. (1983) is singular. 
In order to bypass this difficulty, one can look 
for nonmaximal invariant distributions (sec 
Isidori, 1989). Since on the singularity jr, = 
/c(ji.), the reader can verify that this leads to 
rejecting the perturbation on the new output 
functions ( Vi “ >': = x^) Thai is. we 

change the top output (xj to the propane 
composition of the vapor leaving tray 2 (Af(jr 2 )). 
Clearly, since W|i| = V(A(jt;) - jf,). if X; is 
constant then x, is also constant. With these new 
outputs the control law is regular near the 
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itcady-siale and given by 


7 (x:) Tj-- L + ~- (X;).., 7 - - 

djr f/> dr //? 


_ <'i <c(x:) 

F'“ 

X„ 1 - x„ ^ J[„ - /c(xj ^ 

" 7/7 ' Hn 


(29) 



“ X 

K 


h\ 


where we chose linear stable output dynamics 
with p = 10 min {v, -= 0.995 and - 0 rM)5) 

As lor the linear geometric control, two 
simulations have been made: the fiinii one with 
perfect slate measurements and no delay, the 
second one with a measurement delay of 5 mn 
(see Fig. 9) The complete nonlinear amtrol law 
works perfectly without delays. But the linear 
geometric control destabilizes the column in 
the prescncx' of delays. Instead of the linear 
geometric control, the choice of the parameter fi 
in (29) is not important; with perfect state 
knowledge, stability is ensured if fi > 0 . 


5 C ONCLUSIONS 

We have applied the nonlinear perturbation 
rejection techniques to an aggregated model of 
distillation columns. The obtained control law is 
shown to be robust and simple to implement. It 
is actually working on two depropanizers and 
two debutanizers of ELF-FRANCE. 

Another by-product of our control technique 
concerns the design of the instrumentation of 
the columns. The proposed control law uses 


intermediate temperatures, their postitons can 
be adjusted in order to give the best closed-kH>p 
responses (composition and noise sensitivities). 

The same technique can be extended to other 
counicr-currcnt separation processes, as in 
Duch£nc (19l<8), where (x:iunler-currimt mixer- 
settler extractors are studied and similar results 
arc obtained. Moreover, the extensions of these 
results to more complex distillation columns 
(more than two comixinents. several feeds, side 
products, networks of columns) seems to be 
reasonable. 

The implementation on the refinery de¬ 
propanizer has shown that controlling product 
qualities has several industrial interests, in 
particular; 

• Energy savings: the purity margins that the 
o|XTa(oi maintains with the final prcnluct 
specification can be reduced, as well as the 
ass<Ktated energy consumption (for the dc- 
propani/ei , savings arc greater than 15'^4); 

• Productivity gains; the internal fluid circula- 
turn is also reduced, the trays arc less flcKHled 
and the feed flowrate can Ik increased (for the 
depropanizer, productivity gams arc greater 
than 15%); 

• Process flexibility 
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APPENDIX A TWO RESUl-'I2i 
RoscnbrtKk (1962) has proven the rc^uif given bclcm 
(Tficorcm 6 of the appendix) 

Ho.ifnhruck \ throrrm Consider tEie diffcrenual system of 
dmienxinn p >0. |®^^(^) As&umc that ^ 

belongs to U, a bounded, closed and convex subset of R''. 
and that ^^ (^,),..i p with lU partial derivatives arc 
cimlinuous functions of .Suppose that: 

(i) For each initial corKlition m Q. the solutHin remains m 

U. 

(ii) For all 1 # f 1, . p). Oie fuiKiion of 

v,(€i “ - ^ 

... J?. 

IS IKm-negative, 

(ml For all i ami k in {1, .p) such ihai i # A. 

' 0 . 

(iv) Given any if (l. ..p) for which 9^,-0. there 

exists y # i m {1, ,pl such that #0. il ip, ^ 0. 

there exists lEt fl. p) different of i and / such that 
^ d. if Vk " d, then . moreover, this prm.:ess 
always leads in the end to stime fi (1 ,p) for which 

9';#d 

ITicn there exists a unique sieady-slate in U. every 
solution siiirting in U converges to this steady state and the 
function 

r 

it l.vapunov function o| Ihe system 

*... 1 

We will al.so use the following lemma 

i^emma 2 ( onsidcr a - |w,) and h - (bj. two real vector^ ol 
dimension p • 0. and the teal p ^ p matrix / - (7, j 
conslructcnl by means ol a and h as follows 

• E’or J 2. . p, J, , , M. ,, 

• For I I, , p. y., ij, h ,: 

• For / I. ■ /’ ' 1 - A . ■ i . I ■ 

• For /, ; ’ 1. . p such that |/ ;[ 1,7,, b 

If for all M (d, ,p), Ii, () and K, (I. then ihc‘ 

eigenvalues of 7 are distinct, real and negative 

Ihc pr<H>f of this lemma is a straighllorward applicalion of a 
clavsical result relative lo Jacobi s miiinx |(iammachcr (]W»b, 

P '^)l 

APPE NDIX B THE TIKHONOV HIIOKI M 
C onsider the singularly perturbed system 

i' \ M(r). K'(r). r I j'((t| ^ i'" 

i.i' - /'(» \ iV idn. K(r), ♦) U(ni - 

which admits continuous solution (i'(r, O,-U (r. * )) m 
|d./ |, / d (/' and / ^ are continousls diflcrcniiablc 

fuiK'tioiis) The asHK'ialcd slow subsystem is 

i' = 7'(i\ x\ u(r). H(/). (1) , '((») - i' " 

b - 7^ I \ l ^ u((), H (/), b) 

We suppose that it admits a continuous .solution (t^(f), x,',(/)) 
in |d, 7 I For tf |b. / |. the asMxialed fast subsysicm is 

t'(r), u(n. H(n. ('). 
dr 

where I - f/f 

/oATionoif'.r thforrm If, for each /1 [0. 71. Ihe tangent 
lincanialion ol the fast subsy^sicm around Xo(f) prixluccs a 
stable linear s\Mcm. and if belongs to the region of 
attractHin of x,((b) then 

Iim I'(I. *) - »,'(/) 

r - *<» 

lim i^(r, f) ® I'fr) 

» Ui* 

uniformly on all cKned subseis of |i). 7’| More details can be 
found for example in Tikhonov ft al (198B) 
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Drag-law Effects in the Goddard Problem* 

P T^IOTRASt and H. J KELLfcYJ 

For a drag-law witnessing a sharp increase in the transonic 
region, a more complex switching structure than the classical full- 
singular-coasting sequence may occur during the optimal burning 
program for the vertical climb of a rocket. 

Kri H'ocd*-• Acrmjijicc ira|ccl<»iii‘^, biing-Njiiftis ttuiitul, opiimi/iitioii. Mnnular hicjn, 

singular atnirul 


Ab»tr»cl Prcscnllv studied in the pn>blt*rn o( mamnii/ing 
ihc aliiiudc of .1 rocket in vertical flight in a resisting 
medium, when Ihc amtiuni (d prof^Krlliiin is s|K‘Citicd, known 
as the (nnldard problem I he case is studied in which the 
drag cof flit lent is a lunction ol the Mach nunflK-r, witnessing 
a sharp increase in the transonic region Analyvis shows the 
[vissihilifv of a more complcn switching siriitiure than the 
classical lull singular-coast sequence with ihe aptx'aranee of 
a sciotul lull thrust suhaic in the transition from the subMinic 
to the sufXTsonu region Necessarv conditions such as the 
l.egcndre ( Irbsch condilKui (oi singular subarcs and the 
MiDancll Powers condihon for loining singular and 
non sngular siituircs were cheeked and were found to be 
satisfied M IS shown that ifie results obtained defKnd heavily 
on the assumed form of the drag law. and on Ihe magnitude 
of the uppt'f Kiund on the thiiisi 

I INIK()IM'(M|()N 

I Ml i M of optimum thrust propriimmm^ 

lor miiximi/inj! the altitude of a rtKkcl in vertical 
Might, lor a given amount of propellant, has l>cen 
extensively analy/cd over the past sixty years. 
Briefly, we can refer to the pioneering work of 
(ioddard (IMl^), Hamel (1927), Tsicn and Evans 
|19,S1) and Eeitmann (l‘fS6, 19.^7). However, as 
Leilmann (l%3) first pointed out, the problem s 
solution continued to f>c far from complete, 
mainly due to difficulty arising from the 

' Received 7 March IVIW. revised S F ebruary I‘/SHI, 
received in final lorm 22 August 1990 The original venaon of 
this pafxr was presented at the 7ih IF A( Workshop fin 
Control Applicaiion.s of Nonlinear Programming and 
Optimi/ation which was held in Ihilisi. I' S S R during June 
\9HH The published prrxcedings of this IF A(." Meeting may 
be ordcTfd from Pergamon Press pk. Ftcadington Hill Hall. 
Oxford (>XT OBW. V K This paper was recommended for 
pubUcation m revtsed lorm by AsMxiaic Editor I:. Krcindlcr 
under the direction of Editor ft Kwakernaak 
t Formerly with the Department of Aerospace and 
Ocean Engineering, Virginia Polyicchnic Insiiiuie and 
Stale l. nivcrMly. Black&burg. VA Z40fil, I -S A , currently 
with the ScFwiol of Aeronautics and Astronautics, Purdue 
UmvcrMiy. West l.afayeUe. IN 479Bb. U S A 
t TTepartmcni of Aerospace ami Ocean Imgincering. 
Virginia Potytechnic Institute and State lim%crMly, Bfackv 
burg, VA 244tbl. 1; S A Dr H J Kelley paitK^d away V 
Fehruarv 19H8 


requirement that the mass be momuonically 
non-increasing In this work, Ihc possibility of a 
more complex sequence of subarcs for the ease 
of sharp transivnic drag-rise was suggested. 

Solutions that meet this requirement have 
Ix'cn obtained only in a few sfxx'ial cases, 
typified by the work of Mieic and Gavoli (I9.SK). 
and MieIc (I9.S5), who treated the cases of flight 
in vacuum and flight with a |X)wer law for drag, 
and later by Bryson amt Ross (I9SH) Mieic 
(1%2). using a totally dificrent approach, also 
proved the \u/finenry of the optimal solution 
established by his predecessors, i.c. that the 
optimal burning program involves a rapid txM>sl 
at the lx‘ginning of the flight, usually followed by 
a pcTitxl of continuous burning (sustain phase) 
and ending with a /ero-ihrust poruxl Micle and 
CTcala (19S6) were also the hrst to suggest Ihe 
possibility of a more complex sequence of 
subarcs for ihc ease of a general drag model 

One of the most complete works on 
Gixldard's problem is perhaps Ihc cxtcimivc 
treatment by Garfinkcl (1%3), who proved that 
with impulsive boosts in the vchx'iiy admitted, 
and for the cave of a general drag model, the 
solution contains a finite numtxT of such IxKists 
in the transonic vchx'iiy region, and contains no 
coasting arcs except the terminal one. 

As already has been established by previous 
researchers, the drag plays a significant role in 
the switching structure of the problem In 
particular, it has been shown by 7'sicn and Evans 
(1951) and later by Mieic (1955), that for the 
special case when drag is ideally zero, the 
variablc-ihrusl subarc disapjxrars from the 
extremal solution, which amsequently reduces 
icj subarcs flown with maximum engine output 
and coasting subarcs Moreover, the approxima¬ 
tion C/, ^ const, may be of use ai low altitudes, 
when the speed of optimum climb still belongs lo 
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the region of quasi-incomprcssible flow As the 
altitude increases, both the vel(Kity and the 
Mach number increase with such a rapidity that 
the hypothesis 3Cf,l$M ^ 0 is soon no longer 
satisfied, and a more accurate drag mrxiel should 
be used. Constant drag coefficient C/> is then 
replaced by a Mach-dependent drag coefficient 
featuring a sharp increase in the transonic 
region. When such a model is used, two optimal 
solutions for the singular surface arise; one in 
the .sub.sonic-trans4.)nic region, and the other in 
the supersonic region of the velocity. For the 
case of level flight of a rocket-powered aircraft 
Micic and Cicala (19.56) showed that another 
full-thru.st .subarc may occur during transition 
from the subsonic to supersonic region. 

In the current work, Ooddard’s problem is 
examined with relaxed restrictions on the 
assumed drug characteristics of the rocket. The 
relaxed assumptions allow (or .switching struc- 
ture.s that were previou.sly not considered for the 
case ol vertical climb Invaluable insight to the 
problem was obtained via a transformation to 
a state-space of reduced dimension, where the 
problem becomes more tractable. Ilie methodo¬ 
logy cun be applied to other singular optimal 
control problems too, in order to determine the 
possible optimal solution structure, i.c. the 
number and the relative irosilion of singular and 
bung-bang subarcs. 


2 PROHl I M t tlRMlM-AItON 
'Ihe vertical flight of a rixkcl obeys the 
following system of diflerential equations. 

h ^ I' 

/ - 1) 

m ^ ( 1 ) 

7 

m .= - - 

c 

where h. i>, m are the altitude, veliKity and mass 
respectively, f denotes the engine thrust, D 
denotes the aerodynamic drag, c represents the 
exhaust veltK'ily of the gases from the rcxket 
engine, and is the gravitational acceleration. 
Tile second of the ab<.wc equations simply states 
the force equilibrium along the flight path, the 
first equation is the kinematic relation between 
the altitude and the velocity, and the last states 
that the fuel cxinsumption is proportional to the 
thrust. If we assume spherical earth with an 
inverse-square gravitational held, the above 
system of equations can be suitably nondimen- 


sionalized using the following quantities: 

/i = /?, 

i=G 

( 2 ) 

m ~ mo- 

Here denotes the radius of the earth, G Ihc 
gravitational constant, g the acceleration due to 
gravity at the surface of the earth, and m the 
launching mass of the vehicle. Using the above 
nondimensionalization factors, the equations of 
motion in nondimensionalized form become: 

/i = i; 


T 

m = - 

If S \s the characteristic cross-section area of 
the vehicle, and p denotes the atmospheric 
density, then the aerodynamic drag is given by 
the quadratic formula: 

. (4a) 

If in addition, we assume that the density of the 
atmosphere reduces exponentially with the 
altitude, the nondimensionalized form of the 
drag force becomes 

D - Cp{M)hv^ exp {ft( \ h)) (4b) 

where the factor hir exp {^(1 - h)) is numeri¬ 
cally equal to the product of the veliKiiy head 
and the characteristic cross-section area of the 
aircraft, fr, p are constants, and M is the Mach 
number defined as the ratio of the vehicle speed 
over the speed of sound. For simplicity it will be 
assumed that the speed of sound remains 
constant with altitude, an assumption which is 
actually valid only for stratospheric Milutions. In 
(4) C/,(A#) is the zero-lift drag coefficient 
assumed to depend on the Mach number 
according to the following relationship: 

C|,(M) - tan ' (442(Af ~ A,)) 4 A, (5) 

This formula generates a quick transition from 
one value of Cp in the subsonic region to 
another higher value of Cp in the supersonic 
region. The A\» Ai, A^, A^ are constants con¬ 
trolling when, and how fast, this transition takes 
place (Fig. I). 

Tlie initial conditions are specihed for the 
three state variables as /in, Vo and mo. The final 
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value of the mass is also given as I’he 
problem is lo delermine the optimum Irajectoiy 
ol a rocket m vertical flight, (rom an ussigneeJ 
initial position on the surface of the earth to the 
final jxisilion where the altitude reaches its 
maximum value, i.c. we want lo maximize the 
altitude at the terminal time Hence, the 
performance index is given by 

y - /i(r,) (6) 

subject lo the prescribed boundary condition 

(7) 

and the dynamic equality constraints given by 
( 3 ). The thrust is the control variable which is 
b 4 )unded according to the inequality; 

(K) 

The aerodynamic data and the vehicle's 
parameters, with the exception of (he value for 
were taken from the work of Zlatskiy and 
Kiforenko (I9K3), and their nondimcnsionalizcd 
values arc listed below: 

h = f>2lH) 

/l=5(k) (SI) 

7_ = 3 5 

Furthermore, the constants in (5) arc chosen as 
follows. 

/I, =0 0095 
Xj = 25 

( 10 ) 

-4, = 0.953467778 
/), = () 036. 

For the numerical solution it is assumed that the 
rocket is initially at rest at the surface of the 


earth, and that its fuel mass is 40% of the iwket 
total mass. 

4 PHOB1.EM ANAI.mS 

Define the state vector .f *• ail (A, n. m), and 
the 1 ' 0 -stale vector a « col (A^, A,., A*), Then the 
variational Hamiltonian takes the form: 

X, T) = A,A + A„i' + A,„m (II) 

where the propagation of the co-state vector 
olieys the equation 

< 12 ) 

3.r 

Using (3) and (12). and noting that the control T 
appears linearly in the equations of motion, one 
obtains (or the Hamiltonian the following form 

.AT = .AT,, + 7',/r, = 0 (13) 

where AT,, and AT, are given by: 

.4',, = A,i- ■ A.,(^^+A ') (14) 

\m ‘ 

( 15 ) 

m 

''M\ is the “switching function’’ and governs the 
history of the conlrifl Using Pontry^gin's 
Maximum Principle (Ponlryagm rr al , 1%2). 
three pi>ssibilitics exist (or an extremal controL 
depending on the sign ol the switching function: 


7 * 7 

when 

> 0 


0 < T* 7 

' ' • * mi*» 

when 

^ fl 

(16) 

T* 1) 

when 

W, - 0 



llie second case indicates the [Kissibility of an 
interval of singular contrrd, i.e an inlerval ol 
finite duration over which the vanishes 
identically. The following relationships must 
then be fulfilled simultaneously on a singular arc: 

*...»(). (17) 

ITic above equations along with (13) define a 
manifold Eft;, m, h)^ 0 in the three-dimensional 
slate space of v, m, h Tliis mamfold^ often 
called the sinf^ular surface, represents the kKus 
of all possible state trajectories, corresponding 
10 singular a>ntrol effort. Note also, that 
E‘(r, m,/?)»(I is also the sinf(ular control 
switching boundary, since any point of the slate 
space which dcKs not lie on it, must feature a 
bang-bang control 

The three possible types of subarcs that may 
appear in the solution of an optimal trajectory 
have already been examined; however, the 
composite optimal trajectory consisting of these 
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three types of subarcs need to tx: determined. 
Tlie analysts of the problem is complicated by 
the fact that the optimal solution, in general, 
consists of some combination of singular and 
non-singular subarcs, the number and sequence 
of which are not known a prion, fn fact, the 
manner in which singular subarcs enter into 
composite candidates will be determined in part, 
by the specified two-point boundary conditions 
for the tulcr equations, lienee, the determina¬ 
tion of the optimal composite trajectory involves 
the solution of a two-point boundary value 
problem, frequently by means of a trial and 
error procedure The next section describes a 
methodology that simplifies problems involving 
both singular and nonsingular subarcs and that 
can be used to determine the possible composite 
optimal structure. 

4 TKANSFCIkMAIION K) Kii)U( I 1) SIAIT 
SPAl I 

A transformation approach suggested by 
Kelley (lW>4u,b) is somclimcs helpful and 
permits analysis of singular arcs in a state space 
of reduced dimension. The singular arcs become 
nonsingular, thus the available necessary condi¬ 
tions can be applied. However, this approach 
has the practical shortcoming that the solution of 
the transformation requires a closed form 
.solution to a system of nonlinear differential 
equations, f ortunately, this transformation can 
be obtained rather easily Un the present 
problem, allowing the structure of the problem 
to be studied in a reduced, two-dimensional, 
stale-space. This is quite attractive; the complete 
family of singular extremals for given initial 
conditions can be pictured in two-dimensional 
space 

Omitting lor brevity the iheory of the 
IransSformation. Kelley et «/. (1%7) have shown, 
that the transformation of the original state 
vector i to the canonical form leads to ihe new 
state vector : with comp^ments 

^ h Zj I' me' ( 18 ) 

I'he diflereiitiiil equations in the new .state 
.space are derived directly from (3) and (18). 




exp { Z:Ji ) 


I) 

exp (rwr) 



( 1 ^) 


I'he Hamiltonian for the new system is given 
by 




( 20 ) 


where i =»col (r^,, ic^,, is the co-state vector 
of the new state-space, satisfying the differential 
equations 


52, 


cxp(72/r*) ~ 


dp 

dz 


- exp (z./c ) 4 2z, 


I, ^ — exp (22/c ) 


31) !)] 

(211 

dZ-y c ^ 


exp (z 2 /r) dl) T - 1) 

5z2 c 



7 - I) 

Y ~ t^p(Z2/c) 


Notice from (19) that the control T appears only 
in one of the state equations, namely in the 
equation for ^^ric can therefore discard this 
equation, for analysis of the singular portion of 
the trajeclor, and consider the variable as a 
new “control-like" variable, in the reduced 
state-space of variables z, and This change 
occurs through the identical vanishing of the 
Lagrange multiplier asstxiated with the second 
equation of the stale. Indeed, the switching 
function of the transformed problem is given as 

TT, == -- ^ ' expiz./i ) (22) 

Jl z, 


and along a singular arc we require 

X 0 

because, throughout the trajectory, 




always. 


( 2 .^) 


(24) 


I'he vanishing of along the singular 

p<irtion of the trajectory, can be verified through 
an analogous transformation for the co-slate 
vector A of the original slate space as follows; 
Optima! control theory indicates that the 
co-state variables have a special meaning: as 
Brcakwcll (1961), and Cicala (I9.S7) have 
pointed out, the value at some lime ( of the 
Lagrange multiplier A,, associated with the 
variable x, is just 5f/5x,(r), where } is the 
“payoff" function with ( regarded as a starting 
lime, lliis interpretation of (he co-states is very 
instructive and it will be used extensively later 
on. Requiring that the a>sl function and the 
Hamiltonian remain unchanged under the 
transformation, and using the chain rule of 
differentiation, the following relationship must 
hold along the trajectory: 

3x dx dz 


( 25 ) 
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According lo the interpretation mentioned 
earlier, 


is the co-state vector for the new state space and 

*5z 

Jx 


1^1 


(27) 


is the Jacobian of the transformation, with 
elements 


I ,,->.2.X 


(2H) 


Assuming that the (ransformaiion is nonsingu¬ 
lar, the inverse of the Jacobian matrix exists, and 
the system of (25) has the unique solution 

K^\J] (29) 

which can be written analytically as 


1 0 
0 1 
0 0 

or in expanded form 

r; K, 

•I.. = k^x 


0 

’ m/c 



K 


A.. 


1 

_1 


m 


Notice that since 


del [J|=^c' " ifc(l 


(M)) 

(31a) 

(31b) 

(3lc) 

(32) 


the transformation is nonsingular everywhere. 
Equation (31b) offers another justification for 
the vanishing of along a singular art 
Comparing (15) and (31b) wc sec that the 
co-slate X,, is just the switching function of the 
original problem limes the mass; consequently, 
along the singular arc X'^ should be identically 
zero. The co-stale equations reduce to 


IT, = - 


A-, 


(fZ, 


cxp(Z:/r)-- - 2 z,z, 
9z, J 


d:^ 


*■,. = - 




dZ\ c 

and the Hamiltonian simplifies to 


(33a) 

(33b) 


r. 


A^Zj exp (Zj/c) + ZxZ, ^). (34) 


Notice that the new control Z 2 does not appear 
linearly in the system of state and co-stale 
equations, and the classical L^cgendre-C^lebsch 
necessary conditions can be applied successfully 
in the rcduced-state-space problem. 


The exucmals, then, o( the iransfoiined 
problem arc the singular extremals of the 
original, and those extremals satisfying the 
strengthened version of the classical Ixgendre- 
Clchsch condition are maxinu/ 4 ng, at least over 
short intervals Ihc staiionarv solution of the 
transformed problem corresponding to the 
singular subarc of (he original problem ihxui^ 
then, when 



X, I n 


-;-CXp(Z;/c)|- 



u 


(35) 


and ihc Legendre dclmh ncccssai y aMulirion 
requires, for a maximi/ing extremal 

/) 2 3fy 3'n 

cxp(r.wi) ,4 „ + . , () 

t ' i Jz> dZ'} 

(36) 


fhe latter relationship assures ihe convexity of 
the Hamillonian in Ihc neighlKuhood of a 
solution of (35), i c an optimal conirol obtained 
by (35) provides a( laixf n Uxa! maximum of 'Jk\ 


S NK I SSAKV C ONDIilON.S 
Ihc fact that a Irajectors salisfies the Lulei 
differential equaiums and the lusl-ordet neccs 
sary conditions, only guarantees its stationary 
character li) determine whether a maximum is 
attained, further investigation is in order 31nis, 
the Ixgcndre ( lebsch, Weierstrass and Jacobi 
conditions must be checked Lach of ihcse three 
conditions is a necessary condition for a 
maximum All o( them, suitably strengthened, m 
combination wilh the hrst-ordei necessary 
conditions, provide a sufficient condition In this 
section, wc will briefly review (he available 
necessary conditions (or the optimality of (he 
trajectory, in the case when singular suharcs arc 
considered as possible candidates 
Kelley condition. Hic mere presence oi singular 
members of the slalc-Luler system solutions 
dcKTs not assure the appearance of such subarcs 
in an optimal trajectory In fact, as Johnson and 
Gibson (1%3) pointed <uit. a singular solution 
may not be optimal even IcHially lo determine 
local optimality a further mvesrigaiion is in 
order Thus. the st>-callcd (ienerali/ed 
L^cgcndrc Clchsch, or Kelley fdntermm condi¬ 
tion must be checked, see Kelley (njf>4a) and 
Robbins (1%7) This condition can f>c stated as 
follows: 


/3r\ 

a / dr’" ^ 5 7 ) 


(37) 


where q i» the order of the singularity of the are, 
Junciion cf>ndiiion.s An admissible conirol must 
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satisfy other requirements, in addition to 
satisfying the given physical constraints. If the 
solution IS totally nonsmgular, or totally 
singular, necessary conditions for optimality 
resting arc available in a large number of cases. 
The continuity of and the continuity of A(/) 
across junctions between subarcs, the so-called 
Weierstrms -trdmann comer condition, is per¬ 
haps the most important However, the charac¬ 
ter of optimal trajectories which include both 
singular and nonsingular subarcs is less easily 
decided T1ic first results concerning the 
behavior of the optimal control at a |unction 
between singular and nonsingular suharcs were 
derived by Kelley et al. (l%7), and may be 
summarized as follows; If is the order of the 
singular subarc, then 

If q is odd a jump discontinuity in control may 
occur al a junction between a locally 
minimi/ing singular suharc, i.e a subarc on 
which the generalized l>cgcndre Clebsch con¬ 
dition is satisfied in slrenglhencd form, with a 
nonsingular subarc 

If if is even, jump discontinuities in control 
from singular subarcs satisfying the strength¬ 
ened form of the generalized l.egendrc 
dchsch condition arc ruled out. 

Johnson (l%7) recognized the conflict be 
tween the generalized Legendredebsch condi¬ 
tion and the pinction condition for q even, and 
showed that analytic junctions with jumps can 
occur only if q is odd, hut he did not identify the 
character of junctions l>clwcen nonsingular and 
q even singular subarcs. 

McDancll and Powers (P^7I), molivaicd by 
the preliminary results obtained by Kelley ci a!. 
(I%7) and Johnson (l%7). considered the 
problem concerning the continuity and smooth¬ 
ness properties of the optimal control at a 
junction between singular and nonsingular 
subarcs in more detail, and generalized the 
previous conclusions, with one important excep¬ 
tion; they proved the fxissibility of a continuous 
junction for control saturation with zero slope 
for q txld problems, a ptissibiliiy which had not 
been included by Kelley rt al. and which was 
later ruled out for q > I by Bcrschchanskiy 
(1979). Their main result was that—for analytic 
junctions the sum of the order of the singular 
suharc and the order of the lowest time 
derivative of the control which is discontinuous 
at the junction must be an ixld integer when the 
strengthened generalized Legendre-Clebsch 
condition is satisfied. 

In the McDancll and Powers results, the 
assumption that the control is piecewise analytic 
is not to he taken lightly because the junction is 


typically nonanalytic not only for q even, but 
also for q odd with ^ > L In fact, according to 
Bershchanskiy, the McDanncll'*-Powers neces¬ 
sary condition.^ arc actually of interest only for 
q-\. As was shown in his work, for q even 
problems or for q odd problems with q > 1 the 
transition from a nonsingular to a singular subarc 
IS ass<K*iaied with chatlennf^ junctions, i.c 
controls that switch rapidly between the upper 
and the lower bound faster and faster, with a 
point of accumulation, and which although 
measurable, are nonanalytic. 

Jacobi and Jacohi-like condinons. Testing of the 
second variation, on the other hand, such as 
Jacobi and Jacobi-like testing is rarely earned 
out for nonsingular extremal candidates, and 
even more rarely for candidates with isolated 
singular points, possibly corners, as pointed out 
by Kelley and Moyer (198.5). hxtremals cor¬ 
responding to the second case, so-called broken 
extremals, have been studied with generality, 
detail and rigor by Larew (1919), Reid (1935) 
and CarathciKlory (1%7). Moyer (1965, 197(1) 
using this idea, developed a computational 
technique in the case of a nonsingular extremal 
exhibiting corners, and used this approach 
successfully in an orbital tran.sfer However. 
Jacobi-like testing for composite fculer solutions 
including singular .siibarcs is still a research area, 
and the lew attempts made in this direction, 
mainly due to McDancll and Powers (1970), are 
limited to the case of a totally singular arc Very 
few methods have been also developed for the 
more complex cave of a composite extremal, 
mainly by Speyer and Jacobson (1971a, h) and 
Moyer (1973) 

All the above conditions, though only 
necessary, help to eliminate some of the possible 
subarc-scquencc candidates 

6 fONTROI I (Kil( ANAI YSIS 

Only the frce-limc ea.se was studied, but the 
method of solution is applicable also for any 
value of fixed final time. Due to the sharp 
increase of the partial 3Cp/3M near Mach 1, the 
singular surface witnesses also a peak in the 
same region fFig. 2). Moreover, projections of 
the singular surface into mass-velocity and 
allitudc-vckHriiy planes reveal the existence of a 
nonadmissiblc portion of the variable thrust arc, 
since it corresponds to increasing mass (shown 
by a dashed line in Figs 3 and 4). Therefore, an 
optimal switching structure cannot include a 
singular arc in the transonic region, on aca>unt 
of the violation of the requirement the mass be 
monotonically nonincreasing. 

The problem becomes more transparent if 
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0.00 


Tk. 2 Singular fiurfacc E{v. m, /i) 0 lor Math dependent 

drag ci^fhaent 

one uses ihe iransformation lo z, and z, stale- 
space described before. It should be noted 
however, that such an approach is equivalent to 
admitting jump discontinuities in the new control 
variable Zj - v Such discontinuities. (Kcurring at 
corner points of the solution, imply impulsive 
behavior of the thrust T Such impulsive 
bi'havior would be admissible in the absence of 
inequality constraints on T, but in practice, there 
IS always a limit on the available thrust output 
However, thrust impulses, while not physically 
possible, arc convenient idealizations to very 
rapid burning of fuel llius, an optimal st>lulion 
obtained m the z-space would still be of 
importance as an approximation lo the case of a 
very high magnitude of the throttle setting, and 
in addition to this, it could provide physical 
insight lo the problem 

The analysis can be stated briefly as follows: 
examine the singular arc by transforming to 
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Tig 4 Pro)t\:iioD <i( ihe iia|rcunv i>ri ihc alhiudc ATUH:ily 
plant U>f “ 

z space with a new contioldikc variable. Z;, 
which maximizes the new llamibonian I'he 
vanalion of Ihe Hamiltonian vs the velocity 
along the extremal, corrcspi)nding to the 
singular arc of the original problem, reveals that 
along this singular arc the Hamiltonian has three 
stationary values, corrcsjxinding to three solu- 
lions of Ihc equation of the singular surface 
mj\) ^ Two of those corrcs|xmd to a 
maximum, and the other corresponds to a 
minimum value of the Hamiltonian l^hc first 
maximum corresponds to the subsonic branch, 
the minimum corresponds to the transonic 
branch, screened out, and the second maximum 
corresponds lo the supersonic branch of Ihc 
singular surface. Ffcnccforth wc shall use the 
terms “subsonic maximum" or “subsonic solu¬ 
tion". and “supersonic maximum" or “super* 
sonic dilution" lo distinguish between the two 
ca.scs of inlerc.st Thus, points corresponding lo 
Ihe Iran.s4mic solution cannot be* included in an 
optimal trajectory for a second reason, since 
such points provide a local minimum rather than 
a maximum for the Hamiltonian 
From Fig. 5 we notice that there is a point m 
time when bi)lh solutions provide the same 
maximum to the Hamiltonian, and the velocity 
then jumps from the subsonic to the supersonic 
solution llial is, 

(38) 

where the subscripl “sub" denotes the subsonic 
solution, and the subscripl "sup" denotes the 
supersonic solution. Hence, 

= for fSf,. (39a) 


Fkj 1 Projection of ihc trajcciory on fhc mavs-vdocity 
plane for 7^, » 


and 




for r a r... 


(39b) 
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a i'/ no I ■'/ ^ j*. ,A 


Fir» S, Vun»tion of jit with f . u 

Thul is l>ecau.sc. although both the subsonic and 
the sup>crsonic solution give a relative maximum, 
an optimal control should correspond to the 
ul>solutc maximum of the Mamiltonian How¬ 
ever, the result is limited to the ease in which no 
upper b<mnd on thrust is imposed, 

7 (OMPOSni, orilMAl I KAJi:("l()K> 

'fhe previous analysis indicates that an optimal 
trajectory should start with a fulldhrust subarc 
until the subsonic solution of the singular surface 
is reached. Ihen a variable-thrust subarc using 
this solution is used up to the [>oint when both 
the subsonic and the supi?rsonic brunches 
provide the same maximum to the Hamiltonian. 
A switching then to the supersonic branch 
occurs, and the trajectory remains on the 

singular surface until the lime when the fuel is 
exhausted, llien a final coasting arc is used, until 
the terminal Innindary conditions arc satisfied 
Although this thrust history would provide the 
optimal switching structure for die case of 

will not be necessarily true for the 
case of bounded thrust. In such a ease 

discontinuities in the vchKity are of course 
unacceptable, and the validity of the solution 
depends on the value of the appear bound of the 
thrust. ‘Hius. the structure of the optimal 

trajectory is still in question lliis is the topic of 
the following section. 

8 BOUNDED-THRUST CASE 
The analysis so far shows that the vanational 
problem has a special mathematical structure, in 
so far as the tvccurrencc of two optimal solutions 
of £(u, implies the existence of an 

infinite number of composite S4ilutions, in the 
passing through the transonic region, all 


satisfying the same boundary conditions. The 
question is: which of this family extremals is to 
be preferred from the point of view of 
maximizing the altitude? For (he case of 
unbounded thrust (he answer has already been 
given; At a time when the Hamiltonian 

in the reduced ;-space switches from its subsonic 
to its supersonic maximum. Although valid only 
for unbounded thrust, nevertheless, this remark 
gives us a hint; an optimal trajectory must 
accelerate from the subsonic to the supersonic 
region. Since the variable-thrust case must be 
ruled out. our only choice is the use of full thrust 
between the two .stilulions of E(v, m. h) - 
Furthermore, because for a realistic ease 
Tmai ihc switching from the vanable-thrusi 
to the second full-thrust subarc must take place 
somewhere before the time , and such that the 
switching function vanishes ai the points dI 
departure and arrrival to the singular surface 
(points B and D in Figs 3 and 4). In addition to 
(his. the switching function should remain 
positive all along the full-ihrusi suharc in order 
to satisfy the optimality condition of (16) 

Thus, a trial-and-crror procedure is needed to 
determine the points B and 1). The result 
obtained, using the boundary-problem solver 
BOLINDSOL (Biilirsch. I ^ni), was rather 
di,sappointing; an optimal switching from the first 
varible-thrusl suharc to the second full-lhrusl 
subarc (point B). should lake place before the 
switching of the hrst full-lhrusl subarc the hrsl 
variable-thrust subarc (point A) Therefore, for 
the case of “ ^ optimal trajectory 

cannot have this switching structure, hut rather 
must have the simpler full-singiilar-coasi se¬ 
quence, with the singular subarc corresponding 
to the sufversonic solution of L{i\ m, h) ~ (I 

However, when an analogous calculation for 
the ease 7,^^, - 6 was [H'rformed, the new. more 
complex, sequence of suharcs full-singular full- 
singular-coast. gave indeed a hif*her final altitude 
than the full-singular-coas! sequence (Table I) 
In Figs 6-H IS shown the history of the three 
components of the nondimensionalized slate 
vector respectively, for the op¬ 

timum burning program corresponding to 7,„^, = 
6, The switching sequence for this optimum 
thrust program is depicted in Fig 9. Notice the 

l ABii I roMPvRrvoN Bi rwi iN Tin (I Assu AI n i l 

SfNCiCl.AR (tIAST SI OIi| N< l AND Tlfr NJ IA H 1 i SJNf.l I AR 
n’li MNtil'l AR (t>AST SI OOFW I INVOIVINO A H M TTIRl ST 
Sl'BARr AI llir TRAN.S 4 >NK RI (,HJN, TOR Till t AM OT ^ 6 

f inal time Final altitude 

F-s r 0 1^7:174 I 

F-S-F-?v-C 0 IWI7H 1 DITTOS 
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Fici f) V'analion of altituik h wilh omo for fi Fig h Vtintttion o( m with limi- for ^ 6 


comer points during the vcliKiiy and mass 
evolution, that correspond to the points ol 
discontinuity of the thrust. This is the result of 
the control variable T entering directly to the 
right’hand side of the equations of motion for 
the vcIcKity and mass (3). On the other hand, 
the evolution of the state variable representing 
the altitude is smcHith. since the thrust dix^s not 
appear to the corresponding state equation 

1(1 (DNC I I’SIONS 

llte problem of maximizing the final altitude 
of a vertically ascending riKkci has been 
analyzed for the case of bounded thrust, and 
quadratic drag law. with the drag cwfficicnl as a 
function of the Mach number, witnessing a sharp 
increase in the Iransonic region A more 
complex switching structure, wiih an intermedi¬ 
ate full-thrust subarc in transition through the 
transonic region, was required owing to the 


requirement that the mass should be inonotoni" 
cally nomncreasing Ilie results are iiicniical 
with those of Ciarfinkcl. for (he case, 

although a totally different approach was used. 
TTic solution, using a irunsformaiion to a 
reduced two-dimensional state space, showed 
that the optimality of the solution depends on 
the assumed upper l>ound on the thrust, 
Numerical results obtained verified the superior 
ixrformancc of the new Ihiusl program, over the 
classical full-singiilar-coast sequence, at least for 
a sufficicnily high upjsci bound on the thrust 
rhe Kelley necessary condition for singular 
arcs, and the McDancll and Powers condition for 
joining singular and nonsingular subarcs were 
checked, and were found to be satisfied, 

A companion pa|x*r by the authors examines 
time-nf flight constraint effects in the problem 
(Tsiolras and Kelley, 19H8). 


i / 


r. an? ^-- 


Fro 7 Vanalion of vclociiy v with umc for « h 



x-;kvi tiwvnfl'i'ii'.v'-.i;;'!,)', 


F ki VariJitKin of lhfu*l T with tunc for 7^. 6 








P. Tsiotras itnd H. J. Kelley 


4W 


AcknowteJffemfnif Ihc auihon would like la rhiink Dr L 
M (lift for hi«i vjiluabk #mgnc?itKin» during tKc preparation 
of thiN work Supptul foi ihi^ rr^arch waJ* provided by the 
USAE Armament LafMiraiory, figlin APB, Honda under 
contract E(IW>15 K 


RIH KEN( ES 

Hcr^ihchan.^kiy. Y M (IV79) ( cnijugalion of Mnguiar and 
nonsingulnr puri.s of optimal control Aut Hrmote Controi, 
I2S i\ti 

Hreakwdl, J V (l%I) Approximation?* in flight opiimi/a 
non icchnK|ucH Afr(nf>a<e h.nf^nf^, 2tt, lt>- 21 
Bryson, A Jr. and S E Koss Optimum rocket 

tr«)e<:torics with aenHlynamic drag Jri f*ntpubum, 2M<, 
4f>V46<J 

HulirMh, R (1971) Einfuhrung in die Klughahnopiirntcrung 
die MehrzicImethiHie /ur Numenwhen l^osung vnn 
Nichtlinrarcn Randvcriproblemcn und Aiifgahen iler 
Optirnalenn Stcucrung Hufihuhnfjpitnufrun/f, 

( arl ( tan/ (lesellschaft c v 

( aralhciHlory.f (1%7) < ciA u/av of V'unatum\ umi Vanial 
DiffrrrnUai EV/uuliom of iht' hint Ordrr. V^il 2 
Holden Day, San I ranciHco 

( icala. V ( IVS7) An h.njii;ini*fnn^ Approaih to the ( aUutus 
tif yahuttons l-cvrolto c Bella, l urin 
(iartinkel, H (1%!) A Milutum of the (ioddard problem. 
SIAM J Control, 1, 349 Vift 

(fOildard, R II (1919) A Mrth(Hi o/ Rrathotf^ E.ilrrrrir 
Altitudt^s Smithsonian Institute Mih collections, 71 
(reprint by American Rocket Society. 194b) 
llamcl. Cl (1927) lifter eitu: mil dem Problem der Rukete 
/iisiimmenhiingcndc AufgalH* ilcr Vanuiionsrechnung 
/riLsrhtfl fitr tinjKfwandtr Malhrmtitik und Mechantk, 7, 
4S1 

Johnson, (' D and J E (iib?ion (l%3) Singular solutions 
m problems of optimal control Ih'h.h Tranx Aut f Vin/rrW, 
a, 4 IV 

Johnson, C , D (PX>7) Singular solutions in problems of 
optimal control In I coiidcs, ( 1 (cd ) Adr ( on/rol 

SyM . 2« Academic Press, New York 
Kelley, II J (l'>Ma) A Ininsformation approach to singular 
subares m optimal iraieciory and control problems SIAM 
J Control, 2, 214 240 

Kelley, II J (l'iX»4h) A second variation test for singular 
extremals AIAA J , 2, I 3S0 I 3H2 
Kelley, II J , R E Kopp and M Ci Movci (P^b7) Singular 
extremals In Ecitrnaiin, (• (cd ). Topics in Optimizatuot 
Academic Press, New York 

Kelley, M I and II (i Mover (IdgS) Computational 
Jacobi lest procedure C urrent Trends ('ontnd 
Proceetlings of workshop Dubrovnik. Yugoslavia, 
JUKEMA. /agreh, 19HS 

l.arcw, (i A (1919) Necessary conditions m the problem of 
Mayer in the culculu.s of variations /rum Arn Math 
Soi , 26, I 21 

Lcitinann. (i (1956) A calculus of variations solution i»f 


Goddard's problem Astranaut. Acta, 2, 55-62. 

Lcitmajin, G (1957) Opumujn thniait proipamining lor high 
altitude rockets Aeronaut Engng Rev.. 16 , 63-66 
ijcitmann, G. fl%3) An ctemeniary dcrrviition of the 
optimal control cofKliiion&. JM Ins. Astremaut Con^r., 
Academic Prew, New York 

McDanctl, J P and W F Powcni (1970) New Jacobi iype 
ncceftary and suflfknenl conditiom for singular opfimera- 
tiofl problems AIAA J . 9, 1416-1420 
McDancll. J P and W F Powers (1971) Necessary 
conditions for (otning optimal singular and ncmsmgular 
suharcs SIAM J. Control, 9 , 161-173 
Micic, A (1955) Optimum chmhtng technique for a 
rockcl'fxrwercd aircraft Jet Propuiston, 25, .3M5-391 
Micle, A and P Cicala (1956) Generalized theory of the 
opiium thrust pri>gramming for the level flight of a 
r(K:kci-|x»wcrcd aircraft Jet Propulston, 26 , 443-455 
Miele, A and C R Ciavoii (1958) Gcnerali/cd variational 
approach to the optimum ihrusi programming for the 
vertical flight of a rocket /W, 6 , 102-109 
Miele, A (1962) E.xtrcmizalion of linear inicgrah Green's 
ihcorcm Optimnatton Technufues with App/iconom to 
Aerospace Switems Academic Prcs.v, New York. 9H 
Moyer. H (i (1965) Minimum impulse coplanar circle 
ellipse transfer J AIAA, 3, 209-267 
Moyer. H (i (1970) Optimal control problems ihai lest for 
envelope contacts J Optimiz Theory Applic . 6, 

287 2W 

Moyer, H Ci (1971) .Sufticieni conditions for a strong 
minimum in singular control problems SIAM J C ontrof 
II, 620 636 

Pontryugm, I S , V (i Poltyanskii. K V (iamkrelid/e and 
E F Misi'hcnko (1962) The Mathematical ’Theory of 
Optimal Processes Intcrscacncc, New York. 

Reid, W f (1915) Discontinuous solutions in ihc 
nonparamelnc problem of Mayei in the Calculus of 
variations Amer J Math , 57 , 69-91 
Robbins. If M (l%7) A genrraii/ed Ix*gcndre C Ichst h 
condition for the singular cases of opiimal control IHM J 
Res . 11 , 161 172 

Speyer, J L and D II Jacobson (1971a) Necessary and 
sufficient conditions for optimality for singular control 
problems A iransformahon approach / Math Anal 
Apphi , 33, 161 1K7 

Speyer. J 1, and Jacobson. D II (1971b) Nccessiiry and 
sufticieni cimditions for optimality for singular control 
problems A limit approach J Math Anal Applic . 34 , 
119 266 

r.sicn, H S and R (' I vans (1951). Optimum thrust 
programming for a sounding rtK:kei J. Amer RtKkei Soc . 
21 , 107 

rsinlrus. P and M Kelley (1988) 13ic Goddard problem 
with constrained timc-of flight PrtH Am ( bnirol C imf , 
AllunU. 1412 1421, also AIAA J (iuidance. Control 
Ovnam (lo appeal) 

Zlatskiy, V 1 and B N Kifnrcnko (1981) Computation of 
optimal tra|ccloric.s with singular-ctmirol seettons 
Vychislttrl'nuia i Pnkladnaut Matematika. 49 , 101-108 



j Via* 'V. No .V pp 441 5110. 
(jt««t ttrtun 


mm ti m 4 ii «n 


C 


Vibrational Control of Nonlinear Time Lag 
Systems: Vibrational Stabilization 
and Transient Behavior* 

JOSEPH BEN I^MAN.tt KhDM S MONCit and JAMEl I AKUFAKH1 

Periodic excitations introduced mto time la^ .vv.vYfrm can stabilize unstable 
equilibria or induce stable periodic solutions with the desired properties. 
The resulting open-loop technique termed t^ihrahonal control can he useful 
when on-line measurements are not available. 


Key W4»nb—Nonlinear ^y^icms. itmc Ian ^ysicnn. 


AlMiracI - Tliis pafKT aildrc\srs iwn (uohlcms ol CiHiiiol of 
m>nlmcar iimr lag ?iy%lcm5 h) .in cxisu nce and a svnihesis ol 
parametric Mhraiions for their stnbiloaiion and (iif the 
irarisitni behavior analyiii'i of ihc vihrationally contrtdird 
nonlinear syMcms with time lags In this 5Hork, suihili/ahilitv 
conditions tor two vibration types are lormulatcd anil 
priK'cdurcs tot the synthcMS of the corresponding slahihring 
vibratums arc propi»sed 'Hic nieihixl (or the iinnMcni 
behavior analysis id vihralionallv ctintrolled systems on a 
imde lime interval is developed as well Several ruampleii arc- 
given to Mipjvori the Iheorv presented 

I INIRdDl't^nON 

Vihkahonai i (istkoi is lih open-loop technique 
that utilizes parametric excitation of a dynamical 
system ff>r achieving control objectives A 
well-known example of the vibraiional control 
effect IS a Mabiliziiiion of an inverted ptmdulum 
by vertical oscillations of its support Obviously, 
in this case there is no interference into the plant 
structure, and the control ohjeciivc to kec|) the 
pendulum in the upright position is achieved by 
much simpler means than using feedback. An 
extensive theoretical and experimental com 
parison of vibrational control with feedback and 
feedforward control strategies is given by 
Mcerkov (1980), Cinar et al (1987), Benfsman 

* Received 2 ^ .lanuary revised June 

received in final form 2b July IW) The original verwon ol 
this paper win, prcsenlcd at the If-A( SyrriprHium on 
Sonlinrar C 0 nir(A SyUrm Orngn which wav held m <’apri, 
haly during June. The published prixeedinur?. of ihic 

/FAC Meeting may be ordered from Pergamon fVevs pk. 
HcadingUm Hill Hall. Oxford 0X3 ffBW, t ! K Hiui paper 
W'if recommended for pubticaiion in revised form by 
Am»aa(e Fdiior V Idkin under the direction of Editor H 
Kwakernaak 

^ [>epartmcni of MechaiiR'al and Industrial Lnginccring. 
Lnivcrsily of IJlinoiv at Crhana-CTiampaign. I2fMi West 
Circen .Street. Urbana. IL blHUl, IJ S A 

I Author to w/khh all corrc< 4 w>ndencc sihould be 
addressed 


and Hvitsiov (I9HH) and Fakhfakh uiid Bentsman 
(19<X)j These studies show that feeing an 
opcn-l(K>p technique, vibrational CA>ntrol can (1) 
stabilize the plants when on-line measurements 
and hence feedback, arc im|X>ssiblc, such as in 
ptiwcrful continuous CO. laiscTs and particle 
accelerators; or (2) under the practical icslric- 
lions on si'^nsmg and actuation create desired 
stable operating regimes unatlainabic by feed* 
back for such plants as chemical reactors and 
laser illuminated reactions. Ilie mathematical 
machinery of vibrational control has also found 
imprrtant applications in the synthesis of linear 
periodic feedback controllers (Ixe et n/., I9K7) 
that ensure an infinite gain margin m the robust 
siabiii/ation of the nonminimum phase plants 
with ihe right half plane piiles, which is not 
possible with a linear lime invariant feedback 
(cf Khargonekar er d/, 19K.S) 

TJie theory of vibrational control for systems 
governed by linear and nonlinear ordinary 
differential equations has f>ccn developed by 
Meerkov (1980), and Bellman et at (1986a, b) 
and Bentsman (1987), respectively. However, 
many physical systems with nonlinear behavior 
such as chemical reactions and combustion 
prcKcsscs have time delayed states (cf. Ray 1981; 
Kolmanovskii and Nosov, 19Hf)), ‘This motivates 
studies of oscillatory stabilizing effects in 
nonlinear systems with time lags. 

Tins paper introduces the first results in 
vibrational control of nonlinear systems with 
time delays: amdilions for the existence of 
stabilizing vibrations and a procedure for Iheir 
synthesis arc given for a class of nonlinear lime 
lag systems, a method for the transient behavior 
analysis of vibrationally controlled systems is 
proposed, and examples of vibrational slabi- 
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lization of nonlinear time lag siyMcm!! arc 
presicnted 

In this paper a class of nonlinear systems with 
a finite number of constant delays is considered 
which is described by the equation 

x(l} = X - ‘f.). 

f- I 

l\ R’' X R" X R<R", xU)^^. 

/ « I.m, 

/^(jt(r), xd - d,), A) 

= (PmU(0. x{t ~ d,). A), . . . . 

pJxU). x(l~d.). A)l^ 
/'((), 0, A) = 0. i -1. m, {!) 

where X € R" IS a state, A = (A,.A,]' arc 

parameters subjected to vibrations, / is dimen¬ 
sionless time, and d,, i ^ \ .rn, arc time lags 

of the order 0(f), ()< k« 1 The paper follows 
the terminology of Bellman el al. (1986a, b). 

Introduce into (I) parametric vibrations 
according to the law 

A(f)-A„-1^/(7) (2) 

where A,, is a constant vector and f(() is a 
periodic zero average (PAZ) vector, ITien, (1) 
takes the form 

rn 

JC(M ® x(l d,). A„ + /(O). (3) 

I - I 

Throughoiil the paper it will be assumed that (3) 
can be represented as 

rn 

xd) - X ^ y(7 (f). 

(4) 

where (>(•, ) is a vccliir function linear with 
respect to its first argument 
Following Hellmun et al. (WSba,b), if 
Q(f(t),x(t))^l((), where l({) is a PAZ vector, 
the introduced vibrations arc referred to as 
uer/or additwt, if C?(/(0- t(r)) - /)(rU(/), 
where f>(r) is an ri x m PAZ matrix, the 
vibrations arc called linear mulhplican\f(\ and if 
D(t)X(x(t)). where X R 
is a nonlinear map. the vibrations are termed 
nonlinear muhiplkatioe. In the present paper, 
we consider vibrational stabilization and tran¬ 
sient behavior of a class of nonlinear systems (4) 

with lime delays t/,. i - 1.m, of the same 

order of magnitude as the period of vibrations 
and with linear multiplicative and vector additive 
vibrations, The pnxifs of all formal statements 
are given in the Appendix. 


fl VIBKATIONAL STABILIZATION 
Assume that (1) has an equilibrium point 
= Jr, = const, for a fixed (note that 
x.d) = x,d-d,)==x,). 


Definition T An equilibrium point x, of (1) is 
said to be vihrationally stabilizable (in 
stahUizahle) if for any d >0 there exists a PAZ 
vector fit) such that (3) has an asymptotically 
stable almost penodic solution r'ff), “X< t < x, 
characterized by 


r -x,|| < 6, x' ^x'(t) 



d/ 


(5) 


Definition 2. An equilibrium point x, of (1) is 
said to be totally vihrationally stabilizable 
(t-.Uahiltzahle) if it is I'-slabili/able and in 
addition x’(/) - const. = a,, - x < t < x. 

The problem of vibrational stabilization 
consists of: (1) Finding the cxindilions for the 
existence of stabilizing vibrations (v- and 
r-stahili/ahility) and (2) finding (he actual 
parameters of vibrations that ensure the desired 
stabilization. 

In order to address this problem for zero 
equilibrium of syslem (I) introduce system 

JC(0 = X f*)xil). V(r - fT,), A) (6) 

which is obtained from (1) by replacing d, by tr,, 
r, - (){\), t - m. In the discussion below, 

vibrational stabilization of (6) will be first 
considered and then related to that of (1). 


A. Linear multiplicatiife vibrations 
Define 


and 


/(»S I 

I ^I I 


(7) 


Denote by tP(f) a fundamental matrix solution of 
the equation 

i(r) = F(fU(f) (8) 

and introduce an ordinary differential equation 
z{t)^Rz(t) (9) 

where R is defined as follows: 


+ 2 B. 


( 10 ) 
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and A and B, arc computed as 

1 

^ lim “ 9» '(fM4>(f)d/. (U) 

r-*« r Jo 

and 

i»l. m (12) 

Theorem 1. Assume that there exists a 

sufficiently large set ficK'*. OeU, such that 

introduced in (1) is commuously 

diflfercntiablc for all e £2; Vi - 1.m, 

then 

(i) The zero equilibrium x, - 0 of (h) is 

/-siabilizabic if there exists a PAZ matrix 
F(t) such that a fundamental matrix <I>(r). 
t 6 ^), of i = f(r)x is iilmost fK'riodic, and 

R defined in (10) is a Hurwiiz matrix; 

(ii) There exists positive ft, - const such that 
Xj, =0 of (6) is t-stabilizabic by linear multiplica¬ 
tive vibrations /)(r)x(r) ~ (1//)F(r/f u(r). 0< 
f 5. t,,, where F{t) satisfies all the conditions tif 
assertion (i) above 

Corollary 1. Let an assumption of Theorem I 
hold for system (1) with fixed delays r/,, 

I = 1, . . . , m. Supp4ise that there exists a set of 
constants r,, i - L . . . m, such that djr, - d/fr,. 
i.; - L . . m, and x, - 0 of system (6) 
with these constants r,, i = I, . , m, is /> 
stabilizable by linear multiplicative vibrations 
(l/f )f(//f (Xf'srvi 111011 the zero 

cquilibnum of (1) is r-slahilizablc by linear 
multiplicative vibrations (1 /f,)/• (r/r, )x(/), 
f, ^ dJr,, if f, s f„. 

Remark 1. The significance of Corollary I is in 
that it relates the vibrational stabilization of 
system (1) with fixed delays d, to the vibrational 
stabilization of system obtained from (1) by 
replacing delays d, by quantities rr,, dJr, - dJr,, 
/. / = 1. . . . , m, with fixed r,s and varying r lliis 
leads to a constructive method for the synthesis 
of the stabilizing vibrations, since for fixed r,, 
I = 1, . . . m. Tlicorcm I decomposes this 
synthesis into a two-siagc procedure. First, PAZ 
matrix Fit) is sought which makes R Hurwitz. 

Once the desired matrix f(r) is found, 
the second stage consists of a onc-paramclcr 
(f) computer search where equation (4) with 
linear multiplicative vibrations /)(f)x(r)~ 
(I/f )f (r/f )x(/) and d,i-l, ,m. 
djr,^ djr^, V/,/ = L . . ,fn, is simulated until 
Fq is found for which stability is achieved Such 
Co will necessarily exist for fixed r,, X I, . , , m, 
due to assertion (ii) of Theorem 1 If d,/r, 
c, s £o, then the stabilizing vibrations for (4) 


with the original delays d,. i®“ l.m. are 

given by D(/yi|CX (l/f()f(r/c,)x(i). 

Remark 2. Analytical esiinmtcs of an upper 
tKvund on to arc usually extremely amservative 
(cf Bellman ei oJ,, IVK5K therefore the value of 
r„ for a given nonlinear lime lag system of the 
form (6) is best determined by a numerical 
simulation as descTilxrd in the pievious remark 

Remark 3 'llie choice of a fundamental matrix 
<t>(f) in (K) IS immaterial and is dictated only by 
convenience, Indeed, since any tundamenlal 
matrix 4>(r) of (8) is relaicd to any other 
fundamental matrix of (8). say via a 

constant nonsingiilar matrix (denote it as (') as 
0(f) 0,(f)(\ from (lb) by direct substitution 

wc have 

R ^ ( , (13) 

where 

m 

«, - 4*. ‘(f)44>,(0 I V 4>, r,). 

; I 

ITius. W, IS computed exactly as in (10) hut with 
0(f) replaced by 0|(O. and due to (13) R and W, 
have identical spectra 

Remark 4 The assumpiion of almost periodicity 
of <l»(f) in / guarantees the existence ol the 
uvciages (II) and (12) The ehminafion of this 
assumption results m admitting zero mean 
matrices /•(/) tor which 0(f) is unbounded In 
this case (11) and (12) do not exist One could 
potcnlially use Lyapunov’s substitution to 
transform i F(t)x into a time invariant system, 
find Moquet muliiplicrs, and reject matrices F(f) 
that give rise to univounded 0(f) However, 
currently there is no constructive method for 
finding closed form Lyapunov's substitutions for 
a general class of systems x - F{t)x with periihlic 
zero mean F{(y 

Remark 5 I heorcm 1 and ( orollary 1 show that 
as in the case of nonlinear systems with no 
delays (cf. Bellman et al , l^Hfia), the conditions 
of f-stabilizabilily of zero equilibrium ol (6) and 
hence of (I) by linear muitiplicutivc vibrations 
depend only on the prof>crties of the lineariza' 
tion of (6) or of (1) at zero. However, for other 
types of vibrations, this is not true as will be 
shown further in the paper. 

Remark 6. Ilieorcm 1 also provides a clue to the 
robustness of f-stabilizabilily properties with 
respect to small delays. It is seen that if the 
delays arc of the same order of magnitude as the 
period of oscillations, they cannot be neglected, 
except for the special system structures, since 





494 


J. Bkntsman ei al. 


quantities r, ^ d,It. 0(\} significantly affect the 
spectrum of matrix R, as can be seen from its 
definition (10). 

An example that demonstrates stabilization of 
a nonlinear time delay system by linear 
multiplicative vibrations is given next. 


Examplf I fluffing equation with time lags. 
Consider a scalar Duffing equation with time lag 
d “ con.sl in the states 

Ht)-^ «iJf(0 + - d) - h|X(f) - h.xit - d) 

f '(f ■ d) =^(l. 

a,, Uj, hf, hi. f I. Cj > 0. (14) 

which in the state space form is given by 

X|(f) «Xj,(/), 

i,(r) = -a,xj (0 UiXiU~d) 4 h,x,(/) 

+ />jx,(/ - d) - (,x,'(/) ~ r,.X|(/- d). 

X| ^ X, X^ ^ X, 

equation (14) can serve as an approximate 
model of un inverted pendulum with a cavity 
filled with viscous liquid Ihe term with the 
delayed first derivative describes dissipation of 
the mechanical energy in the system due to 
viscous liquid. 'Diis term is a lumped approxima¬ 
tion of a more complicated description of this 
dissipation by the retarded integrodifferential 
term given by Strizak (I9K2, p 23H). The 
linearization of (LS) al x, - (I has the form 


X,(0=''<f.!(0. 

Xj(t)« “ fl,Xj(f) “■ ■ d) + fi|X ,(l) ( 16 ) 

f /»..X|(f • d). 


IntrcHlucing vibrations /(f ) - (o/r) cos (f/r) into 
coefficient /»,. 

—• hi 4 c<*s (f/f), (17) 

I 


equation (K) is given by 


ii 


0 

III 

„ 


. a cos / 

(IJ 


and Its fundamental matrix is 


( 1 «) 


0(f) = 


I 

. a sin r 


0 

I 


(19) 


Replacing in (14) d by er and computing R of 
(It)) we obtain a corresponding averaged 
equation (9) given by 

i(f) + r|i(f)-frjZ(/) = U (20) 

where 

r, ••u,+ai, r:=-(7», 4-/)j) + ^. 


l -inifia; C<X)dfhOris 



- -4 if o 2 < 

X ! 

Fm; 1 Phase (Xiriraii of Duffing cquauon with ii time lag 
d 0 4;i. 


ITierefore equation (15) with d—r = 0(l), 
and vibrations introduced into the coefficient hi 
as in (17) has a stable zero equilibrium point 
when >0 and o > [2(^,b^)|‘for any 

positive f smaller than some to. the existence of 
which lor fixed r is guaranteed by ITieorcm 1. 
Consider the case when U; = (),4, 

and r, :=^0.()5. I'hen for 
a > V 2 , r - const. == 0( I). and 0 < f r,,. 
vibrations (17) must stabilize the originally 
unstable zero equilibrium point of (1.5) with any 

Such stabilization is indeed demon¬ 
strated in Figs 1 and 2 Figure 1 shows the phase 
portrait of Duffing equation with time lags 
without parametric excitation It is seen from 
this diagram that x, == (I is an unstable cqui 
librium point. Two other equilibrium points arc 
given on the graph by x, - ±V 10. Figure 2 
shows a trajectory of Duffing equation with 
oscillations with .t|(0 = 3 and jr^^(f) = 5 for / rir (), 
o - 2. d - 0.47r, and t, - O.OS. Since the 
trajectory in Fig. 2 converges to zero, we can 

I ir"’ rji „ f\r-d 'lOr* 

f ^ 

1 '|T>' 1,.','' 

i 

i 



V; 


> 1 

FKi 2 A irafectofy of Oufling equaiKm with a time lag 
d ^ 0 4jr and cndUAtkms 
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observe the qualitative changes in system 
behavior, and specifically, a t-siabili/ation of an 
unstable zero equilibrium. 


B. Vector additive Vibrations 
Consider the Taylor 
PXt IJ, k)^PXg. r/) around 
point X, ” I « rj = 0 

r-iJ 


expansion of 
an equilibnum 


where 


= . 

. v:„\'. 

. / ^ ^ 




■ . 

. ^ 

3 / 

V 3 T]y 

■ + 'In-^ -jpAB. r/)it .„.,„ 


/= 1.n. 


122 ) 


where subscript £ 0 means that denvaiives 

of a term p,/( , ) are evaluated at zero values of 
Its urgumenis /'(£, rf) will be referred to as an 
odd r,,, r^ydlfiehruit function in the incmitv o/O if 

(1) expansion (21) may have nonzero terms 
only for y e [ 1. r,,|, A: € 11, r,.), r,,. r,;*. with (he 
last nonzero terms at j - r,,. k - r,>, 

(2) expansit>n (21) has no terms with / " 2 m, 

k “ 2m, M “ 1, 2, 3 . 

In (21) a term (l//')i''^ with £ •" >' + u can be 
represented as 




r 


-ft + -~ .,v;v + H()T(M (23) 

/''' (/-I)! ' 


where the elements of vector are algebraic 
forms of order j with respect to the comptncnis 
of vector u. the elements of matrix ,S! arc 
algebraic forms of order j - 1 with resfK-ct to u, 
and HOT(y) denotes higher order terms in y 
For example, the element of matrix S\ is 

■ -f di„u„y 

n n 

, I A . I 

/, m 1. . . . M; r # A:, r ^ m, ^ # m 


where 


dL = d',„{p,{S,. 




and 


_ d^Paig. n) j 


(25) 


Similarly, in (21) a term with rf « y + u 

can he repretienied as 

> 1 . 

♦ (7 + HOT(> ) (2h) 

where the elements of matrix t'J iire algebraic 
forms of order / I with ies|Hx'i to u, and. for 
example the element id matrix is given by 
the right hand side of (24) and by (25) with 
diffeientiation with respect to r|. i e the second 
argument of Pf . ) 

Im u in (23) and (26) be the zero average 
primitive of vector /m(0 

u(r) ^ I in(/) cli and w(r) ’» 0 (27) 

IntriKiuce u matrix 


^ I ^\(u(f )) 4 ;V;(M(f j) 4 

4 ■ £;(u(0) ^ .’ 7' (2K) 

4' (^2 1)' 


r/irormi 2 Assume (hat in (6) each 

odd r,,. -algebraic function in a sufficiently 

large neighliorhiKvd of I) Then 

(i) 0 of (6) IS I'-siabilizable if (here cxisls ii 
PAZ vector ni(/) such that with ii(t) defined m 

(27) }J H, IS a Hurwii/ matrix; 

I I 

(ii) there exists positive r,, - const such that 

X, 0 of (6) IS P'SlabilizabIc by vector additive 
vibrations l(t) - {]/( f ()• r - where 

m{t) satisfies all the conditions of assertion (i) 
above 


(orollary 2 IxM an assumption of Ilicorcm 2 
hold for system (I) with fixed delays d^, 
r “ 1. . , m Suppose that there exists a set of 

constants r,, r ^ 1, . , , m, such (hat djr, « 

J, / = 1, , m. and x, -- 0 of system (6) with 

these constants r,, r ^ 1, , , m, is n-slabilizablc 

by vector additive vibrations (l/£)m(f/f). 

0 t s Vtf. 

Then the zero equilibrium of (1) is u- 
slabilizable by vector additive vibrations 
r, if r , 

Remark 7 Unlike linear multiplicative vibra¬ 
tions vector additive vibrations arc incapable of 
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stabilizing an unstable linear system. Indeed, in 
general, an unstable linear system has an 
unstable impulse response and is not bounded- 
input-bounded-state stable, therefore, any addi¬ 
tive time-periodic input will give rise to an 
unbounded growth of system state. Con.sc; 
quently, nonlinearity is necessary for the 
u-stabilizability of an unstable equilibrium of a 
dynamical system by vector additive vibrations. 

Example 2. Van der Pol equation with lime 
delays. Consider equation 

x(t) + p,(x^(() ~ i)x(l) +h,x(l) 

+ fdjix^d - d)- l)x(i-d) 

+ hiX(t - d) = 0 (29) 

or in slate space form with vector additive 
vibrations 

jf,(r) XjO) 

0 

.•• d) 4 d) - d)x,{t d) 


Here the right hand side of (30) with 
l^{t) ^ lj{t) - {) and d replaced by ir satisfies all 
aKKumptions of llicorcm 2 and it is an odd 
3,3-ulgcbraic function around Xi, - 4 ~ 0. 

Several trajectories of equation (30) without 
vibrations, i.c. with /,(0 “/,i(0 ■“ 0, shown in 
Pig- 3 for by - h 2 Mi ^ demonstrate an 

instability of an equilibrium x, 0 C hoosing 
n^y{t) « a cos / and m^lO - 0. matrix // of 
llicorcm 2 is given by 


0 



X 1 

Fto ^ rtiiMc porimit Van <kr Put (squaikm with a lime 
lag it ^ (I 4 jt 



?0 30 






Fifi 4 Solutions ij(f) kUK) i .(f) versus time of Van dci Pol 
equation with oscillations and a lime lug d 0 4;r 

Hence for (f>i“4/j;) >0 and (u,4^/i;) >t) zero 
equilibrium of the Van der Pol equation with 
delays (29) is r-stabili/able by vector additive 
vibrations /,(t) = (o/r) cos (r/r). /:(/) - 0, if 

n > V2 and delay d is sufficiently small. Such 
stabilization is indeed shown m Fig. 4 for 
J-0.4;r. llie last clement in the lower row of 
matrix Ff in ( 31) demonstrates that nonlincarities 
play a decisive role in the vibrational siabi- 
lizaiion of this class of systems by vector additive 
vibrations. 

Ill I’RANSIFNT BFHAVIOR ANALYSIS OF 
VIBRATIONAl.LY rONTROLLLD NONLINEAR 
IIME LAG SYSTEMS 

Vibrational stabilization considered in the 
previous sections addresses the local behavior of 
vibrationally controlled nonlinear systems aro¬ 
und an equilibrium point with the main emphasis 
on ailractiviry, i.c. on behavior as f-**. For 
control purpi>ses it is also of interest to analyze 
the nonlcKal system behavior at every time 
moment starting from r = i.e. the transient 
behavior of a sy'stcm. Analysis of trajectories of 
vibrationally controlled system (3) is a difficult 
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task; however, if vibrations arc of the form 
/(f) = (l/fl^ft/f). 0(-)-PAZ function. 0<f « 
1. f = const., i.e. sufficiently fast, then trajec¬ 
tories of system (3) are usually composed of a 
fast oscillatory part with the period of 4>(f/f) 
superimposed on a slow part. A comparison of a 
slow part of a trajectory of the oscillatory system 
with a trajectory of the corresponding system 
without vibrations for the same initial conditions 
reveals the qualititivc changes in system 
behavior caused by oscillations. 

In order to analyze the transient behavior of a 
vibrationally controlled system, a solution of the 
initial value problem for every delay equation in 
this paper will be denoted as Ji(f, .i„, (l) and 
interpreted in the sen.se of (Driver. 1977. p 2.57) 
as a continuous function t (-r, Af" 

that reproduces the initial data, curve r„(.v), 
.yej-r. 0|. and .satisfies the equation con¬ 
sidered for fs*() with i(t)) Iveing understiMKl as 
the right-hand derivative 
In this section we consider the transient 
behavior analysis of the system (b) with lineai 
multiplicative and vector additive vibrations on a 
finite time interval. I'hcn we relate it to .system 
(4) with fixed delays, i/. i ~ 1. . . m. as in the 

previous section Thus we consider system 

ni 

.r(/) “ X /'('‘(D. xd rr ,). A,,) 

I ' I 

^ C^((l/| )</'(f/i), x(f)) (.32) 

with the right-hand side defined in (1) and (4) 

and /■,.; = 1. m. being positive constants of 

the order 0( 1). 

Ixt x(f, where x((), Jt,,. 0)---r„ lu* a 

trajectory of equation (.32) In order to strip 
x(l, x,,. (I) of Its fast oscillating com|joncnt 
introduce a moving average along a irajeciory 
x{l. Xn, 0) as 

. 1 f'*^ 

-f(f)“ -. x( v, X,,. 0) dv, O'f' r. (33) 
1 / 

where 7 is a period of (p{i/t ) 

If the quantity x(f) can be closely approxim¬ 
ated by the trajectory of a time-invariant system 
then the Iraasicnt behavior analysis of system 
(.32) for various magnitudes and frequencies of 
the oscillations can be greatly simplified, 
resulting in the constructive procedure for the 
design of the parametric excitations that induce 
the desired qualitative changes in the system 
behavior. 


A. Linear multiplicative vibrations 
Lxt linear multiplicative vibrations in (32) be 
of the form (l/r)f(f/f)x(0 Assume that 


equation 

x(f)» F(t)x(i) (34) 

has a pei'iudr in i fundamental matrix <h(i). 

Along with (33) inlnxluce 

Jtiu(':(')l “ 4>(f),T(l. A., d). (-^-^) 

where 4>(i) = (1/7')/,^‘l*(/)d/. and 

r(r. Ai, d) with r(d, Ai. d)Ai* wmsi is a 

solution of the equation 

.'(f)™C>(;(t)). 

f' i'd) 

C>(v)** lim (1/7 ) v)d/ 

j — J„ 

where ». 

C>(/. >') *^ '!> '(f) ^ 

1- I 

/U‘l»(f)>. «I>(f - r,)v, A,,). (37) 

If stays cUm* to i(0 a time niters til 

of interest, then irw(:(/)) can he viewed as an 
approximme movinf;^ aiwrafif along a trajectory 
Ji((. lo.n) of (32) with linear mulliplicalivc 
vibrations on this time interval. ITicorcm 3 
below gives the conditions under which 
and i(r) can Ik made arbitrarily close on the 
arbitrarily large hmte time mverval 

Theorrm 3. Assume that (a) functions 
/|(C. r/, A,,), r - 1, . , m, of system (32) are 

continuously differentiable with respect to 
C, r/ f c R'' and (b) fundamental matriK <l>(r) 
of (34) IS 7 • periodic where 7 • is a period of 
f ( ) in (34) 

Then for any d as small as desired and h as 
large as desired there exists / < t)(«^, x ) such 

that for ()• t * (he following holds 

lii(r) iM(^(0)ll' *^1 / e [fl, x |. (38) 

where m, = 4>(l))v^(0) 


(i^rolJary 3. lxt assumptions (a) and (b) of 
Theorem 3 hold for system (4) with fixed delays 
d,, I ~ 1. . m, and linear multiplicative 

vibrations Suppose that there exists a 

set of constants r,, . m, such that 

djr, - djr^, /, / ^ 1. , m, and solutions of 

system (32) with these constants r, satisfy 
inequaJily (38) for given d and r for 0'^ i - r.j 
Then solutions of system (4) with vibrations 
/7(r)x(f)= (l/r|)f (r/f ,)x(r). r, ^ djr,, satisfy 
inequality (38) for the same d and tc if r, 


Example 3 Duffing equation (15) with lime lags 
and linear multiplicative vibrations 



f f 




(39) 
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Since ♦(/) in this caJie is given by (19), from (35) 
we have 

i*r,(z(/)) ® z,(0 and * Zjd) (40) 

where z(i)‘^z(t, Zo,0) is» a Milution of equation 
(36) which for this specific ease takes the form 

Z,(f) = Z;(l). 

Zj(f) = - (a, + fl.,)2j(0 

(41) 

+ (h| f hi - jzi(f)- (C| +cJZ|'(r), 

Figure .*! shows that ivi(z(()) and iArz(^(0) given 
by dashed curves indeed represent approximate 
moving averages along jc,(/) and XjfO. 
resf)eciively, given by solid curves for delay 
f- (l ()5, a,-0.6, a. ^0.4, 6,-6^ = 
0 5, and r | - Cj - 0.05. 

B. Vatoraddtiive vthrations 
l.et vector additive vibrations in (32) be of the 
form 

Theorem 4. Ixt assumption (a) of 31icorcm 3 
hold and u(f) be the 7’*-[>criodic zero mean 
primitive of m(r) 

1 0 r , . , , . ^ , 



V V 10 IS 


Fui s S4»lulH>n» uml vienius lime of Duffing 

equmion with o«cilbiu>nK ami a time lag d ^ 0.1 m ami ihcir 
apfroximalc nwiving averages ami versus 

lime 


Then for any d as small as desired and jt as 
large as desired there exists ic) such 

that for 0< f tci the following holds 

||i(f)-z(/)|(<d, re[0. rl (42) 

where a, = ufO) 'f Xf,(0), and z(r, Zo, 0) is a 
solution of an ordinary differential eijuation 

2(0 = ;^ f £/’,Iz(r) + u(.i:), z(f) 

+ u(j - r,), A<,)dr. (43) 

Corollary 4. Let all assumptions of Theorem 4 
hold for system (4) with fixed delays d, 
I = 1, .... m. and vector additive vibrations /(/). 
Suppose that there exists a set of constants r,, 
i = 1, . . . , m, such that ^/,/^ = i - 

1, . . . , m and solutions of system (32) with these 
constants r, satisfy inequality (42) for given d and 
IT for 0<f:^sro Then solutions of system (4) 
with vibrations /(f) - (l/f,)m(7/f,). i^^djr,, 
satisfy inequality (42) for the same h and x if 

f 1 ^ tu. 

Example 4. Van dcr Pol equation (3f)) with 
time lags and vector additive vibrations 












ir 1 


f < • 1' !f . * 

;'Mp, 

s 


’ I r '' 


n 



0 ;0 
' IML ) Si. C . 

FKi 6. Solutiom J,(0 *;(<) verms tune of Van dcr Pol 

equation with owrillatkms and a time lag d 0 2 and their 
approvimite moving average. z,li> and Syit) versus lime. 
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|(o/f)sm(//f). (o/f) sin (»/())' Equation (43) 
in this case has the form 

Z,(/) = 

= |(/>I + + (Ml + M;)ff'l-i(f) 

- (m, + M.')^;(<)-:(') 

Approximalc moving averages -:,(r) and ::>(/) 
(dashed curves) along wrlh ihc corresponding 
S4)lulion.s idO and !_(() (solid curves), respec¬ 
tively. are shown in Fig. 6 for 
d =- 0 2 and r - (1.05 

IV (ONCIUSIONS 

This paper demonsirates that under certain 
conditions, parametric vihralions approxim¬ 
ately introduced into a nonlinear lime lag system 
of the form (1) are capable of converting 
an unstable equilibrium (.»f a system into 
an asymptotically stable one or creating an 
asymptotically siable oscillatory regime with the 
average located at an unstable equilibrium [H>int 
J'he criteria presented enable one to investigate 
the existence of the slabili/mg vibrations and 
give procedures for the choice of their 
parameters While the theory presented is 
restricted to the delays of the order Oft), 
0< f «1. Examples 1 and 2 demonstrate that 
vibrations are capable of stabili/ing systems with 
delays of the order 0(1) The methiKl for the 
transient behavior analysis of a vibralionally 
controlled system is also given and is sup(>f)rled 
by numerical examples I hus. vibrational control 
IS shown to be a possible alternalivc for control 
of nonlinear systems with time delays m the 
situations where conventional methods are 
expensive, difficult, or impossible to apply due to 
restrictions on sensing and actuation. 
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APPI NDIX PROOF^ OF FHt FOkMAl 
S T A IT Ml NTS 

rroof of TTirormi 1 W'tth vibralionc 

Qifm 4(f)) - />(f)4(/) H/r)Fp/i p(r). (Itt) 

r'j and d, • ff, 1 , m. e(^uaiion (4) lakeii the 

form 

^ f'fjf rF * (r r,), A,,) 
di ^ 

♦ TtT)*( r) (2ii) 

IniriHtucirig into equation (2a) c^Kudinale transTormalton 

j(Tld>( I)l( r). ( la) 

which for the dclaved cialec iake% the form 

4(T r) ^(r /Jvlf r ) I - 1, , m, (4a) 

(2a I rcdua'% to a standard form 


X P,(<I>(t)>(!). <Kt rjy(t ■ rj. A,,) (Sa) 

Since Ftr) IS a periodic hf>un(kd zero mean function of t. 
by ATkI s lormuia (cf BnHketi, tV70, Theorem 3 3) ^ ^(r) 
IS bounded for r ^ , ^ ) and the right hand side of (Sa) is 

well defined for all r 

Averaging the righi hand side rd (Sa) with respect to r, 
Imean/ing n at v( r) i(f r) ^ o dropping the delays in 
rhe slates wc ohiain an ordinary diflereniial cquatimi 

4 V <i» • fTjiqt) (bn) 

Ihai for sufhcienlly small t governs the stabiiiiy properties of 
the tnvial solutnm of (5a) Finally. noijn| ihai Ihc avcrnited 
equaiwm corresponding lo (5«) is g^ven in lime i by 
r(r)“ Hiiii where matrix R it dchned in (10). and lhai if 
IS almost periodic then (3a) and (4a) are Mabilify 
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the jiJMcrtioftv af the ihecKem dircctJy Mjc>w fr<>m 
Throrem 3 3 of Hair (1%6) O E D 

Proof of Coroiiary Under ihc aaaunifHMJfii of C^oroUary ), 
condiliom of aanertMin (i) erf Theorem 1 arc tatiified tor 
Nyftleim (1) llicfefore. tor r, < r ihe pf(Jof of Corollary 1 
chreetly follows frtrm ataenkm (li) of llieorem 1 O E D. 

Pr(H)f of Theorem 2 Sytlem (6) with vector acUliltwe 
vihralM>nit ) in lime x^ th in given by 

did) v' 

r 2* /*(i(r), i(t r,j. kfj + rn(t) (7a) 
or , „ j 

With u(t) deHned by (27), kijb«fiiutiofvii 

lit) yi t) 4 uit) (Ka) 


and 


jr(r rj ^ y(T r,) f u(r - rj 
reduce (7a) to a standard form 


dv(r) 

dr 


* X V(r) u( r). y(r ~ r/) 

> u( T fj, A,,) 


F'Xpaiiding every f*(r). A,,) **»/»({, ?;) around 
under the aasumptKin of f heorem 2. we obtain 


dy( T) 
dr 


I -1 / -1 y 




n » M«I» 



(9a) 


(Hhi) 
r) ^ t), 


ilia) 


includtni the ten fence after equation (5a) Dropfiing tfoe 
dclayv in tiatc variable y( ) and averaging the nght hand sale 
of (5a) wc obtain 


‘*V^“e<?(z(/)) (14«) 

dr 

where Q{ ) w given in (36) and (37) 

Now by llicorcm 4.32 of Halanay <1%6, p. 46t)) for 
y(0) “ yJO) z(0) r„ and every a > 0 and d > 0 there 
cxciu Fj"* 0 »uch that for 0 r r i we have 

||y(i, y„. 0) -- z(t. z,,. U)[i < rj, Vr e |0. a/fj (I5a) 


Since 

id, i„.())-<I»d/f)y(M(,„0), (16a) 

T^Oir), and i(/) and y(r) arc of the order 0(1) in time 
r r/r, wc have 

1 r*' 

i(0“ 1 a>d/f)y(/)d/ 

“in 

“ 1 j <!>(«) <1* |.v(() + A'ltf ) 

» ♦(7)v(/) + A |(f). (I7a) 

where yd) - yd. i„. fO- /C,(i ) ^ 0(r ) and llA.',(f )ll uniformly 
approaches 0 as f -• 0 

Denoting z(f) — zd. 0). for the left hand side of 
inequality (3H) from (I5a) und (I7a) for any given r; and a 
wc have in time t 


Averaging the right hand side 4i( (I lit) with respect to r and 
ilroppiiig the delays m the states, wc have 

■ (£ ' H()l(.') (I2ii) 

d I \ „ I I 

where niiiinu's /(, i - I. . m, arc defined in (2H) 

rn 

AMtiime now that V H, is a Hurwii/ matrix ITicn. noiing 

that (12a) hax a zero e(|iiilibrium, by ibeorem V3 of Hale 
for every A -d there exists r.A'M vuch that (Ida) w'ith 
Ov f •> #,, has a unique usympiolically stable almost f>cruKiic 
solution >‘(r) characten/ed b> 


||i(/) i^(zd))|| - ||<lrd)y(r) f A,(f ) d»(f)zd))| 

T |t<I»(/)|v(f) - zd)l!l f )|i 

.V1|V(/) - ztdil f !lA,(r)|| 

•1 Al) 4 l|A:,(r)||. d- I f ,. (iKa) 

where A is H<»mc positive constant which exists siikt <h(f) is a 
coaviant matrix with hourulrd elements 

Finally, since wc can always cIkkim.* r „ ■ r . and r; such that 

Arj 4- ||^',(rJII '• tV Vr t Id. a l. 

Theorem is proven Cj F 1) 


lh*|r)|t A (Mil) 

Now. the pnnif Tbeorein 2 follows from (13a) u)xui noting 
that due to (Ha) 

3M U “ >*'( r) > ii| r) ^ ) '( i) 

O F 1) 

Proof of ( oroitarv 2 Directly follows from Thrtircm 2 
PnH*f of Jhntrem 3 Follows that of Tbeorem I until and 


Proof of Coroliorv 3. Directly follows from fbeorrm 3 

Proof of Theorem 4 Follows that of ibeorem 2 until and 
including equation (Ida) Dropping the delays in slate 
variable v( ) and averaging the right hand side of (Ida) wc 
obtain in lime r equation (43) Now the proof follows that of 
Ibeorem 3 after equation (14a). with q>(r/f )v(r. jr„, d) 
replaced bv wfi/t)vf r. .i„. d) and iv(-^(n) replaced by 
zir) ^ 0 F D 

Pro<*f of i'orollary 4, [>irectly follows from Ibeorem 4. 



voi 27 , No j pp m\ m mi 


tsm 

|V«|(«WMW f^NMk fAt‘ 


Generalized Zero Sets Location and Absolute 
Robust Stabilization of Continuous Nonlinear 

Control Systems* 

GILA KRUCHTLR+ 

An analytic method for findtnfi the location of the generalized zero set of a 
iiector-valued function is applied here to find the complete fea\ihle set of 
sectors of nonlinearities which allows absolute robust stability of a Lurie 
type system with linear part under uncertainty conditions, according to the 
Popov criterion. 
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4bflF»ct— Wc describe iin unalyiK mcihml (t»r tinding the 
kicatKin of the gcneriiilized /eru set ol a vecuir valued 
function which depends on m real variables and tn rA) 
cximpic* parameters Tlic melhix) in applied to a rohuM 
design problem of a nonlinear l.une lyise amlinuous-iime 
system, with the linetir part under urKertainiy conditions We 
f'ncl the complete Icasihlc sci of sccton of the nonlineantics 
which allows robust absolute siabilil) of the system 
according to the Popov criterion Illustrative numencal 
eiamplcs are provided 

1 INTRODUCTION 

Vahioi s PROHi PMs which arise in system theory 
can be reduced to the problem of locating the 
generalized zero set. defined as follows. 

A generalized zer<f set. Ciivcn an open set (J in 

R'”. m > 1. closed sets Q, . Q„. P, . P, 

in with xQn. P^ 

P] X y Pt and d continuous function / ; "x 
PxG-*U‘^, the generalized zero scl of / 
relative to Q, P and (7 is defined by 

M={seGaU'^:f{q,p,s)^i) 

for some q \n Q and all p in P). 

If we let f^,p(x)= fiq, p, v), q € Q, p € P, i € G. 

then 

A/ = n U 

p4P qvO 

In other words the set M can t)c written as 
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intersections of sets 

- i j /, ;,«)). r (. r. 

•4 * V 

where V'. are zero sets (Fruchtcr. 19HH, Fruchlcr 
ft a/., 19K7a. IWla. b) recently dcvelof^cd into a 
imil and used in solving problems in control 
theory Lstabltshing an algorithm to finding M 
makes more apphcalions |>ossihlc in a wide 
variety of ureas 

Walach and Zeheb (1982) consider this 
problem for ni - 2 and G M'. and when 
fiqrp^ ^) complex valued (unction, holo- 

morphic in q and p and a polynomial in the 
complex variable s - v, 4 yv., and when each (J, 
and Pj IS cither a piecewise smmilh simple art or 
a Jordan domain hounded by a piecewise 
smiKitb curve Fhcy were able to find necessary 
conditions for the boundary of M and thereby to 
develop an algorithm for determining M in some 
cases ITicir results have already been in* 
Mrumcntal m control theory. 

Here, we derive a new algorithm for IcKating 
Af for continuously differentiable vector-valued 
functions /and quite general parameler spaces (J 
and P 

Tlic mclhcxl is applied lo a problem of 
robustness of absolute stability of Lurie type 
(Lurie, 1954) continuous nonlinear systems, with 
linear parts under uncertainty conditions. By 
uncertainty wc mean that the transfer (unction of 
the linear part may have as coefficients 
parameters which may take values in a given set. 
Wc find all tbc feasible set of sectors of 
noniincantics, for which absolute robust stability 
of the system under uncertainty conditions in the 
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linear part is ensured, according to the Popov 
criterion (Fop^jv, 1%1). From the engineering 
standpoint, such a result will provide the 
designer of such a system with an excellent 
design flexibility, in choosing the optimal robust 
sector considering design constraints. 

A partial solution to (his problem was given in 
Siljak’s work (Siljak, l%9a,b, 1989), vSiljak’s 
method gives sufficient conditions for absolute 
robust stability, according to Po^x)v criterion, for 
a restricted class of transfer functions, with 
respect to the form of the appearance of the 
uncertainty parameters This is the price of using 
Kharitonov type solution by imbedding 
polytopes of dimensions equal to the number of 
the uncertainty parameters plus two, in the 
solution set 

The method proposed in this pape:r gives 
sufficient and necessary conditions for absolute 
robust slabiliiy with respect to the uncertainties 
in the linear part, according tt) Po(>ov criterion 
rhe method is unrestriefed lo the form in which 
the uncertainty parameters may apficar in the 
transfer function. The complete set of sectors of 
the nonlmcarilies is selected from the two- 
dimenMonal set: 

xUW Hk,q)cPr xU:k ' 

► Rc ((1 f r)| >0, 

Vo) -0. Vre ,^.7 ). 

where r is the vector of all uncertainty 
parameters and 7*7 denotes the parameter space 
in which r may take its values The set V' is a 
corresponding two-dimensional zero set of p<unts 
{k. If) \t\U* X (H It IS determined by the analytic 
methods described in (Fruchlcr et ai, 1987a. 
1988, I99lu, b) and illustrated in this paper. Fhc 
two-dimensional geometric intcqiretation can be 
done at any number of uncertainty parameters. 

The discrete case of this problem was treated 
m the previous works (Fruchter et at , 1987b, 
Fruchlcr, 1988). 

This paper consists of five sections. In Section 
2 wc present a brief summary on the methcxl of 
“zero sets hKation" (Fruchter, 1988, Fruchlcr et 
at., 1987a, 1991a, b). In vScction 3 we describe a 
method of finding the generalized zero set M. 
ITic mcthiid IS illustrated by two numerical 
examples with engineering meaning. In Section 4 
we utilize the algorithm in absolute robust 
stabilization of continuous-time Lurie type 
nonlinear systems. A numerical example is 
provided. The paper closes in Section 5 with 
appropriate concluding remarks. 

: PRFIJMINARY RFvSUlT5 

We present a brief summary of the method 
"zero sets ItKafion” (Fruchter, 1988; Fruchter et 


at., 1987a, 1991a, b), including notations and 
results needed in (his paper. 

A. The zero set 

Definition 1 (Fruchter et at., 1991a). Let 
K - Ki X X K„ be a set in C/* - C x ■ x C 
(n times), where each K, is a closed set in 
whose boundary 3K, is a finite 
union of piecewise-smooth simple curves and 
piccewisc-smrKXh closed simple curves. Let G be 
an open set in M'" and let / : A x C U {^} 
be a continuously differentiable function llie 
zero set of / " (/n . /j) relative to K and G is 

then dehned by 

V - (ve (; c R"’; 3A e K such that/(A, s) - 0}. 

Lemma (Fruchter et at . 1991a). L is a closed set 
relative lo (7. 

f) Zero \eL\ location—Outline of the procedure 
There arc Iwo principal stages in locating V 
In the first stage one finds an (m - 1 )- 
dimensional set L. L c V\ which contains the 
boundary of V relative lo G Next, by picking a 
point in each of the connected components of 
G\L one checks which of these connected 
components are included m V' and which are 
outside V. This stage leads to the original 
problem in a lower dimension, which can be 
carried out reductively until the final solution is 
reached l.et /),. , Di, be the connected 

comfxincnis of G\I. which are included in V \ 
then 

V' - IJ / ), U / .. 

r ’ I 

In order to find the set L one needs ncccs.sary 
conditions on the Niundary of In the 
following we present two theorems which 
provide such necessary conditions 

C\ Necessary conditions on the relative boundary 
of the zero set 

Theorem 1 (Fruchlcr e/a/.. 1991a) Let K, G,f 
and V be as in Definition 1. Suppose that is a 
point in the boundary of V relative lo G and 
A‘' = (A‘,\ ... Ali) is a point in K such that 
/(A**, .r‘^) - 0. Suppose that for r = I, . , 

Al’ belongs to the boundary of a 
connected compiinenl of K, having a parametric 
representation 

A. ==A,(6^.). :sl 

and that for i = ^ I.n. t A^^e 

int AV 

Suppose that . . , 6^1 are numbers in the 
open intervals (0, 1) such that 

a,(o=a:‘ 
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and z". yr are real numbers such that for 
i = ^ + 1, . . . , fi, * x” + /yl*. 

Let d 6 (0, 1) be such that - d. + A) c 

(0, 1) for j = 1-f and (xf- A. x" + A) x 

(y" - A, y" + A) c K, for i = / + 1. n. 

Denote 

r=(r;.r;) 

.»‘;.x';.,.>';., xi’.y'') 

and 

= . ^,) 

= (fli, . . . , X,« 1 . V/, I, .1 „. y„) 

for each point A e R' such (hat 

i£,~r;i<A, i-i,. 

Then, at points (/4", i"), where the derivatives 
of -4,(ft,) exist, we have the relations 
(,) y;(,4= 0. 1.,/ 


(ii) 


3{f, . ),) 


3(<„, 

1 / , 


K) 


{A", v") ^ U. 


»./ 


At points where any of the coordinates is x. the 
differenliability of f and the conditions (i) and 
(ii) should he evaluated after suitable changes of 
variables of the form r—• 1/: are performed 


Theorem 1 (hruchtcr et al . IWla) let K. (i, 

/ = (/,. f,). (A", .v"), — o 

and ; - (i',. . , cj. r -2. with A ~ >^(t) and 
a" - he as in I hcdrem 1. when d " 2 

Lc! k and q be m(cpcrs such rhut 1 rs k ^ d - 1 
and d k q - r - 1 Suppose that there is a 
(rn f r ty )-dimcnsional ncighborh(K>d N ^ 
i\\ y \\ of the point = 

(c'J,,. , $?, a'*| and a vector-valued function 

q A’—* such that 

(i) q is continuously diffcreniiahle on N 

(ii) gfi' , v ) = (?,, , s„) 

(ill) i'(A(qr(c'. v), 5'). for every (f',.v) 


in A, 



where 


. i) 

and 

*' “ (A ♦ 1 • 

u 

Ut ^ 

be dehned by 



i) = u(/t((;r(^‘ 

.0^ 


where u = (/,... . ) and g = (y,, 

Then at points (£' .r") wc have 

^r,(f'",.r") = n. y = l. k 

^Jfl. gA) 


.IJ 

<7 1 :s I, < 


(I' = 

< I* r. 


^k) 


D, An outime of thr prtpcrdurt of dedtrmining L 

Let /. K and Cr be as in Tlieoreni 1 and 

Theorem 2 For each Z' in {1.n), chixwir a 

iubsel ol / different indices from the set 
{1, 2. . . . n). For each indei i in this subjicL 
picL a amnected amponcni of ^^V Finally, 
applying llicorcm 1 aml/or llieorem 2 wc can 
And a set of pi>ints (Ai, . which is 

(m - I )>dimensional in We do the same for 
all possible choices of 1 ^ n. of the indices 

ii, , from the set {1, , . , /i) and of 

connected amiponcnts of 3K. 

respectively, and for Z »0. Wc denote the union 
of all the (m " l)-dimefisional sets, which are 
included in V. by 

Next, consider a finite set of points, say 

ti 

^i. , in U which conespond to the 

points where the derivatives of do not 

exist. In the sequel, we will label such points 
“bad" ixunis. Suppose that hi€ BKi By 
subsiilulmg A^ h^, f {A, v) - b reduces to a 
(vector) equation in the (complex) unknowns 
Ay, , and i. a c R'^ We apply Theorem 1 
and/or llieorem 2 to the new equation at the 

point (/)i,/i?.obtain (m-l) 

dimensional sets in included in V, in a way 
similar to the previous procedure for Next 
we repeal the prrxedure for hj, etc. up to 
Denote by L, the union of all these* 
(m ~ 1 )-dimcnsional sets for h,,. 

Next, we substitute in f(A,\)^-i) two bad 
points, say for A, and for A^, such that 
t4^k, and apply Theorem I and/or rheorem 2 
Wc denote by L> the union of all the sets, which 
are included in V. Next, wc chcnise three bad 
points, then four bad points, etc . and obtain 
l \ . Lp Ix-t 


L U/. 

(- II 

Then, since each T, is (m I )-(limensional and 
included in V, so is L and 

a,. V c T c V 
where <9,,T = 3Vr\G 

^ fiUNBRALI/J D /TRO SMS l <K ATION 
A The generalized zero set 
Let (? “ f 1 X • • • C, and /• ” /’, X ■ ■ • X r, 
be sets in C" = € x • • ■ x C (n limex) and 
C* ^ C X ■ ■ ■ X C. (k limes), respectively, where 
each Q, and f, is a closed set in L » (. U |»), For 
each i the boundary $Qi and df* is a bnile union 
of piecewise-smooth simple curves and 
piccewise-smooth closed simple curves, l^i O' be 
an open set in R* and let f Q x P x G-* R"' U 
(■*} be a continuously differentiable function. 
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The imi assumption meam that Q x P k G has 
an open neighborhcKx), where j)* 

^)) has continuous par¬ 
tial derivaCivcf with respect to all real c<Mirdin- 
atCH qj, pi. pi, and 5,, where q.^gl ^ jqi. 
p, ^ pi + jpi, q^iqi. 

ipy. iPk)^ and ^ ('/.'m) ^ G. The 

generalized zero set of / * (/j, . , f^) relative to 

Q, P and G is then defined by 

Af- (vcGc R"' ;Vp€ ^ 3r/€C^ 

such that f{q, p. 5) - 0) (1) 

In other words, r e Af if and only if/ (/^. q, v) f) 
for some point q in Q and every point p m P 

Our main purpof»e in this section is to derive 
an algorithm which will enable us to determine 
and describe the generalised zero set M of the 
vector-valued function f, for certain parameter 
spaces (J and P, and ojkii sets G. TTiis objective 
will be carried out by redefining M in terms of 
certain zero sets. 

H The procedure of determining the generalized 
zero set 

Let ly, P, G. f and Af be as in Section M. In 
particular it is assumed that (y x P x G has a 
neighborhoiKl where / is continuously 
differentiable. SupjHJse that T 3 P is an open set 
in f/ for which / IS continuously diRerenliable in 
Q X P X G\ Let V' be the zero sci of f relative to 
Q and G x P, i.e 

V - |(.v, p)t G X P c (ir‘ XL*; 3q e {J 

such that fiq, p, s) ^ 0} (2) 

Excluding points in which one of the 

coordinates of p ~ (pi. Pa) c is vve 

denote pA)ints (s, p) c G x P by 

..'m./'l./'i. pi-ri)- 

where ip', e 

Note that the differentiability of / at points 
(q. p, s) where at least one of the coordinates of 
(</,p) is X or at points (q,p. s) for which 
fiq* p. ') >s checked by means of a change 
of variables of the form z-*\/z, re C. 

l^ernma 1. K is a closed set relative to G x A 
The prwf is as in Fruchtcr rf a/. (IWIa, Lemma 
IIA), where the idea is to show' that V contains 
each of its limit points which are in G x p. This 
follows from the aimpactncss of (y (being a 
closed subset of €*') and the amlinuity of /. 

The set V has all the properties that the zero 
set V considered in Fnichter (1988) and Fruchler 
et ai (1987, 1991a, b), aitd presented in Section 
2, has, including the fact that V is closed relative 


to G X P. On the boundary of V relative to 
G X P wc have similar conditions to those stated 
in ITieorcms 1 and 2. Therefore, in order to find 
the kxration of V in G x P wc may apply the 
methexi briefed in Section 2. 

The following proposition is an immediate 
consequence of (1) and (2). 

Propositum 1. Lei Q, P, G, f, M and V be as in 
3A Then 

{sc G VpeP. (s,p)€ V). (3) 

Now. let L be an (m - 1 )-dimensional sei, as 
described in Section 2, i.c L is included in V 
and includes the boundary of the zero set V 
Then L is a finite union of .solutions of equations 
obtained from Theorem 1 and/or Theorem 2 In 
other words L, and consequently the relative 
boundary of V, is a finite union of (m l)- 
dimensional sets of the form 

{(.y. p) e G X P q,(p, \ ) 0). 

where the equations q, - 1) are derived from the 
conditions on the relative boundary of V which 
Theorems 1 and 2 provide From ihe implicit 
function iheorcm it follows that q, arc 
continuously differentiable real valued functions. 
Therefore, m many cases, the zero set V can be 
expressed as a finite union and intersection of 
the sets 

{(s,p)eG X r:qXp,s)^- i)} (4) 

Using Proposition 1 we obtain, m this case, that 
M can be expressed by a corresponding finite 
union and intersection of the sets 

M, -■ (.V e (/': Vp e /’, q,(p, s)--. OJ. (5) 

The complement of Af, in G, denoted by 
liecomcs 

.V, ” G\Af, " ( v e G: 3p e P, q,{p. a) 0} 

Note that 

q:,(p. J) >0 

is equivalent to 

q>,{p, a ) 4^ n = 0 for some n 0). 

I>enote 

h,{n.p.s) = q,{p,s) + n. (6) 

Then .V, becomes 

•S’, = {x £ C :3p e P,3n € (-*, 0) 
such thal h,(n, p, j) = 0}. 

It is easy to sec that 

5, = u s:, (7) 
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where 

S*={seG:3p€P. 3n€|-«, t] 

such that p, s) = 0). (8) 

The SCI S' is recognized as a zcn? set, prcscnlcd 
in Section 2 of the real-valued function h,. In 
conclusion the sets M, = G\S, and therefore M. 
can be found by the method presented in Section 
2 . 

In conclusion, M can be found by the 
following steps. 

Step 1: Choose ^ and determine the cor¬ 

responding set V (sec (2)). 

Step 2: Write V' as a tinile union and 

intersection of sets V, [sec (4)J. 

Step 3: Write M as a finite union and 

intersection of sets M, (see (.*')(. 

Step 4. Dclcnnine the functions h, from (jr, (sec 
(6)] and write the complements S, of M, as a 
union of the zero .sets S!, on r - 0, (see (7) and 

(K)l 

Step 5: Determine each .S', and M,. and then M. 
by Step 3. 

In the following wc illustrate the procedure of 
finding M by two numerical examples 

C. Numerical examples 
'file following example is derived from 
possible formulation of an absolute stability test 
of a certain nonlinear system by Jurv-I.A*c 
criterion (Jury and Lee, 1964) 

Example 1. Let G = (.i ~ (.v,, .s.) t R‘: .i- • 0), 
let Q = Q\'r^ Qi, where 

c, {q, eL :|(7,| = 1) 

^ ’ Rt* qy (I) U {. 

and let P - |(), l^t f Q ^ P d R" U 
be defined by 

/(<fi. Qi P' .Vi. .Vj) =:p((().3-().()5.r,) 

+ (0.1 -0.03i,) Re qf,J - (0 2 4 0.1 Re i/,) 

4 l/.Tj 4 q> 

We want to find the following set; 

.M = {.V 6 G: Vp € P. 3(<?1. </:) t Q 

such that fiqu q^.p. s^. t,) = 0). 

Deiermiruition of the set M. I.-CI P„ - (0. ar). It 
is easy to see that 

P=u P.- 

a ■<) 

Hcncc 

n Af". 

a 


where 

M“ = (jtG' Vpc P... 3 (i?,,9j)6 C? 

such that/( 9 ,. 9 ,,p,i,,t 2 )« 0 ). 

The set Af* is recognized as a generalized zero 
set of the complex-valued function /. In order to 
find M", and therefore M, we apply the 
priKedure presented above. 

Step I. We set ^ » K and find the set 

V = ((j,. jj, p) e G X R: 3((^,. e g 
such that f(q,, p. Jt,, jr.) «* ()|. 

In Fruchter el al. (1987a. hxample 2) wc found 
this set and we obtained the following result: 

V' “ ((ti. P) e G X R : - 0.3 + p(0,4 - O.ORv,) 
4 l/ij5.Uor -0 1 4p(().2-0.01r,) 

4 l/,iy SO), 

Step 2: The set I-' can be wniten as a union ol 
two .sets V'l and namely 

L = V'l U V';, 

where 


V’, 

- ((.1 

i, .V., p) f G 

X R . q.,(p, .s. 

. *;) 



e; - 0 

3 4p(0 4 - 

0.08i,)4 I/.V 2 

SO) 


and 







((i 

V2,p)f. G 

X U : q y(pi V| 

. Ld 




.1 4 p(0.2 - 

(Milt i) 4 1 Is 2 

0) . 


Step -V 

ITie 

set Af", can 

be written ais 

1 a union of 

two scls Ml 

and My, namely, 





Af" - M 

7UA/?, 



where 






Af“- 


V;.) ( G : Vp 

e rp,(p. », 

1. -G) 

.0) 

and 






M" - 


»/) f: G: Vp 

f P«- V'jfp. '1 


0), 


Now, let Mi ■=• n M" and Af; =* f 'l Af“, then 

a -11 <1 •« 

from (9) follows that 

MiU M. 

Step 4: The functions h,, i = 1,2 will have the 
form 

A|(n,p,,T)= -0.3+p(0 4-0.0ar,)-4 lArj+ n 
and 

Aj(n, p. ,i) * -0.1 4 p(0.2 - O.OZt,)—I/T 2 4 n. 

Now, the complement of M“ in G. denoted by 
.Vr, will be 

.ST*G\Af;« U AT *. f»1.2 

> • 0 


(9) 
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where 

S’ “ ■ {(i,, sj e 6': 3p e (0, «), 3n 6 (-*, f] 
Kuch that ht(n, p, .f) » 0 }. 

'I’hc complement of in (!, denoted by S„ is 
then given by 

U U-vr* « = l.2 

a '!» r- tl 

The sets .S’,, / « 1, 2, arc obtained from SI by 
taking f—•() and a -* + »■'. 

Step 5: Determination of .S' " and .S',, i = l,2, 
71ic sets .S' ", i-1,2, arc zero sets of the 
continuously differentiahlc real-valued functions 
h,, respectively, relative to | '£, r) x |fl, or) and 
a. For finding .V,' “ we use the procedure briefed 
in Section 2. As was mentioned above .S', is 
obtained from .VJ " by taking f-»() and 

As outlined in this priK'edure. first one finds 
the set L. In the present example L - L„U L, U 
For finding j 0, 1, 2, we apply Theorem 
I, with <1 ~ 1 (sec Section 2). 

Since 

3h. 

=^l/(), 1,2, (10) 

3n 

we obtain immediately by Theorem I that 

/.„ - 0 , 

Also, it IS readily verified that 


(13) are reduced to 

hfie, 0,.»I. Jj) = -0.3 I/J 2 + f = 0. 

Taking c-»0", we obtain 

jj = 10/3. (17) 

The equations of Theorem 1 for the case (14) are 
reduced to 

/i,(t. ffi.ii, J;)= -0.3-i (»(0.4-().0aj,) 

+ 1 /jj + E = 0, 

Taking f—*0 , we obtain 

.. 3(52 - 10/-^) 

" O .H as j 

Hcncc, taking or—» if 53 ^ 10/3. we obtain 

.s,-5. (18) 

Therefore, from (17) and (18) wc obtain 

L, ^ ((V|. Sy) e G: i, = 5 or = 10/3}. 

And in conclusion, 

L = ((.Vi, A;) e a A, “ .S or s> -- 10/3}. 

The set L which is a one-dimcnsional set, is 
depicted in Fig. 1 and divides G into four 
domains 1),, j -- 1 . . . , 4. In order to decide 
which of the domains 1 ), belongs to . we 
chm)se arbitrary point in each of the domains /), 
and check whether these points belong to ,S, It 
is readily verified that 


h,{ ‘ ^, p. V,, V;) # 0 . f - 1 , 2 . (II) 

ThcTcforc, from ( 10 ) and (II) wc obtain that in 
the derivation of /., wc have to consider only the 
following cases 

In the derivation of /,| wc have only the case; 

/i,(i, p, A,, A ,) ^ 0 , (I' p < rt, I - 1 , 2 ( 12 ) 

and for wc have the cases: 

^(r, O.A,, v>) -(), I - 1, 2 (13) 

rr, A;) - 0, / - 1. 2. (14) 

First, we treat the case / - 1, 

The equations of ITicorcm I which correspond 
to the case ( 12 ) arc 


.A,)- -0.3> p(0,4-o.oav,) 


4 1 /a; 4 r = 0 

(15) 

dh 1 


, '^04 - U.OKs, =^0. 

3p 

(16) 


From (15) and (16), taking r -^0 . wc obtain 
((5, 10/3)). 

Now. the equations of nicorem 1 for the case 


.s, - u n 

r- I 

The complement of in C7 is dashed in Fig. 1 
and is given by 

Af, = 1)4 = ((a, , A^) 6 ( 1 : A, > 5 and A; 10/3}. 

For the case i = 2 wc have similar computa¬ 
tions. We obtained that therefore 

M, o M 3 . Hcncc 

M = Af, U M: = M, = 7)4 

And in conclusion, 

M = ((v,. A 3 ) e G A, 5 and a. 10/3}, 
namely the dashed region in Fig. 1. 



FKi, I The gcticralued zero sc\ it« O4 for Flxampk I and 
the ctwnectcd components of G L 




Generalized bcalion and absolute robust stabilization 


507 


Remark 1. If P and M are subsets of R then is 
a subset of (see (2) Section 3B] and M can be 
found directly from the geometrical interpreta¬ 
tion of V. This is an immediate consequence of 
Proposition 1(3). In such cases we arc able to 
find M immediately after Step 1. as it will be 
illustrated in the following example. In cxmse- 
quence, in this case, we do not need the 
closed ness of the set P. 

Example 2. Let G = (.r e R ^ ; j > 0), let Q ^ 
Q,x Qj. where Q^ « Q, = 10. *) and let P - R. 
Let /; 0 X P X G—► R U {*) be defined by 

/(?!■ = ‘ -h/l-Vx/f + (5 - q\)') 

+ P(^ - + (-*' - + </.' 

We want to find the following set: 

.41 ~ (j e G: Vp e P, 3(</i. </,.) e 

such that f (q,. </:. p. v) - 0) 

Determination of the set .U Let (.^" = 10, nj 
and C^:=^[0./I). Then, ~ U ‘‘ttd 0.-- 
U Hence 

II -11 

M ^ LJ Af’ " 

o -II 

where 

M" = {.v c G: V/; t /^ 3((/,, q,) e ^ C?; 
such that /(</), q^i p, a ) - l)^. 

According to Remark 1. the vet W 'is 
recognized as a generalized zeio set ot the 
real-valued function /. In order to find M"' and 
therefore if. wc need to use only the Step 1 of 
the procedure prescnied above 
Step 1 We have P - P - H I.ei 

V" " = (G. p) e G xR :3(q,.q,) e x G? 
such that / ^q^ , q , p, . 

Then 

V'= u 

rt -tt 

a 1) 

The set T" ^ is recognized as a zero set of the 
continuously differentiable real-valued function / 
relative to x ~ [0. a | x [0, /?| and Ci x K. 
Therefore, for finding we use the 

algorithm briefed in Section 2. From by 

taking a and wc obtain V. 

Determination of V" ^ and V As outlined in 
the procedure, first one finds the set L. In the 
present example L - L„U L) U L?,- For finding 
L^. j =0. 1, 2, wc apply Theorem 1, with J * T 
(Sec Section 2.) 

Since 

Bf 

— ^\^{) (18) 

9q2 


wc obtain immediately by Theorem 1 that 

Therefore, in the derivation of L. wc have lo 
consider the following cases: 

In the derivation of T, wc have the cases 

/(</i. 0, p. a) ™ 0. 0 < qi< a (I9a) 

/((/i, (ii p, s)^ 0, 0 < < a (l^b) 


and for we have the cases 

/(0.0.p..i ) -0 (20a) 

/(O, (20b) 

/(a.O.p. a)«() (20c) 

/(a. /ip. a)-0 (20d) 


It IS readily verified that when 4 /(--♦ 4 x 

and A >0. only (IVa) and (20a) arc meaningful. 
Now, in ihc case {19a) the equation 

fiqy, 0, p, v) ^ A ’ fi/(36q; 4 (5 - qiY) 

47>(5 «/;)/(3<k/, 4 

IS equivalent to the equation 

» + (5 - 

- b+p(.S - <jf() ”0. (21) 

licncc. wc ahlain by Theorem 1 thal, in case 
(l‘fu). we have in addition to (21) the equation 
* 

, = .V 'f3b - 2(.*i q()) - p * 0. (22) 

3q] 

From (21) and (22) wc obtain the .tolulion 

p\\' - lips + 576 •+ 24jr - 0. (2.3) 

In the case (20a) wc obtain 

/(0, 0, p « a) s ' - fi/25 4 p/5 » 0 
or 

p -6/5 5 a *. (24) 

From (23) and (24) wc obtain 
L - ((A. p) e G X R llfis 4 576 

4- 24a 0 or p » 6/5 - 5 a '), 

The .set i which is a one»dimcnsional scf, is 
depicted m Fig. 2 and divides G x R into four 
connected domains /),. / = 1, . . , 4. In order lo 
decide which of the domains D, l>clongs to V, wc 
chwsc arbitrary points in each of the domains D, 
and check whether these points belong to ^ It is 
readily verified that 

V^ijllUL. 

The set V is dashed in Fig. 2. From this sketch 
and Proposition 1 we can conclude immcdiaicly 
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FKj 2 Tlic rero %ei V' for I'Xiiniple 2 iind the connccitiJ 
comptificnrs of H * x M / 

that 

M ^ (30, +« ). 

Remark. The complement of M in (i has an 
engineering meaning which will he explained in 
Jicetion 4 (Remark 4). 

4 ABSOl im; KOimSl STAHII l/,ATI(IN OF 
CONriNUOUS NONl INI AR (ONI ROI SYSIIMS 

The nature of the mathematical results of the 
previous section seems to he particularly 
pertinent to various applications in engineering 
system theory In this section, we apply the 
results to one such problem, which is important 
from viewpoint of practical design of systems 
under uncertainty conditions and which is 
considered very dilTicult to carry out. We 
consider the problem of robustness of absolute 
stability of Lurie type (Lurie, I9.S4) continuous 
nonlinear systems, with linear parts under 
uncertainty conditions. 

Lurie ■“Pt>slnikovs (l.urie and Posinikov, 
1944) concept of the absolute stability of a class 
of sector nonlinear (so-called Lurie) systems can 
be considered as the concept of the robust global 
asymptotic stability with respect to variations, 
uncertainties and imprecisencss of the 
nonlinearity. Absolute stability of a Lurie system 
is tested in the literature for a given (nominal, 
unperturbed) mathematical description of the 
system. However, it is of utmost practical 
im|^K>rtance to consider also the uncertainties and 
impreciseness of the parameters of the linear 
part of the system. Ilie robust absolute stability 
and stabilisation for a amtinuous sector 
nonlinear system with linear part parameter 


uncertainties, is studied in this section. Applying 
the method of '^generalized zero sets location", 
we find all the feasible set of sectors of 
nonlinearities, for which absolute robust stability 
with respect to the uncertainty conditions is 
ensured, according to the Popov criterion 
(Popov, 1%1). 

A System description 

A nominal description of a Lurie continuous¬ 
time system with one nonlinear unit <p is defined 
by 

X - Ax ^ h(p(a), X = .r(r) s R”, 

AeR""". aeU (25a) 

a»cx, ceR’ (25b) 

The nonlinearity <p (Lurie nonlinearity) is a 
continuous function from R to W sati.sfying the 
following sector condition: 

0 (0) ” 0 and 0 < 0 (a)rj ‘ < k for a 0. 

for a given positive number k, called sector 
number. Note that the above condition restricts 
the graph of the nonlinearity (p to within 
specified sector .V(^') which lies in the first and 
third quadrants of the plane and is bounded by 
the fj-axis and the line v = ko 
Assume that sc)mc or all the entries in A, h, c 
arc subject to perturbations and are only known 
to be within given intervals 
A perturbed model of the I.uric continuous 
system with one nonlinear unit is given by 

i = A(r)x h(r)(J)((j) (26a) 

a " (■(r)x, ( 26b) 

where r = (r,, . . . . r^), the vector of all uncer¬ 
tainties of the system, may take values in K;, 

f ' I 

where r, e K, and K, - [n,, ft,], I - \ , q. are 
given intervals in R. 

B. Problem statement 

Our purpose is to find the complete set of 
sector numbers k for which the system (26) is 

absolutely robustiv stable for cverv r 6 rt Kj, 

and for every 0(a) which satisfies the sector 
condition, according to Popov criterion (Popov, 
1%1). The significance of the siilution to this 
problem, relative to previous works, was 
explained in the introduction. 

C. Problem solution via generalized zero sets 
location 

Wc will assume that A(r) of the system (26) is 
a robust stable matrix. If this is not the case we 
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first stabilize ^^(r) robustly by a constant output 
feedback h as in (Fruchter rt a/., 1987a, 1991a) 
and replace ^(r) by 

^*(r)-.4(r)-i^b(r)hc(r) 

Wc consider now the design problem of 
finding the sector numbers k for which the 
system (26) is absolutely robustly stable For this 
purpose we generalize a criterion by Popov 
(1961) and apply our generalized zero set 
method. 

1.XI A, 6 , r, o and 4 >(o) be as in (25) Ixt 
6 \(A) = c(y4 - A/) ‘b. where A is the complex 
variable, be the transfer function of the linear 
pan of (25), from the input <p(a) to the output 
-a. Assuming that A is a stable matrix, that is, 
all the zeros of the polynomial 

A,(A)-|(A™ A/)| 

lie in the open left half complex plane Re A - (I, 
and assuming that the rational function (i|(A) 
has no cancelable factors. Popov (1%I) proved 
the following theorem. 

Theorem ^ (Popov, 1 % 1 ), The system in (25) is 
absolutely stable if there exist t- R such that 

k ' 4 Re [(I /<u</)(V|(;(/j)) • 0 

for all to > 0 . 

Now, let G^iA, r) = i (r)(^(r) - A/) ’b(r) be the 
transfer function of the linear part of (26), from 
the input <p(o) to the output -a, and assume 
that A{r) is a robust stable matrix, for all 

‘i 

rc n Ay An immediate consequence ol 

I 

Theorem 3 is the following. 

Corollary 1 . The system in (26) is absolutely 
robust stable if there cxi.st q e R such that 

k ’ Re K1 -f- ja}q )Gj( juj, r)] > 0 

for all 0 ) Sr 0 and ail r e fl AV 

1 

Ixt 

q){( 0 , r, /c) = A ‘ -f Re ((1 y(u^)G%(yni, r)J 

*4 RcC;2(/ri>, r) 

- qu) Im r). 

Then the objective is to determine the set 
of all points k e ft where 

R"= (A€R:A>0}. 

for which (26) is absolutely robustly stable. By 


Corollary 1 has the form 
VifKn « IA t R * 3c/ c H. such that 

g (fi>, r. q, i) > 0 , Vco ijr 0 and Vr e A'/j 

To adopt the above formulation to the 
generalized set location mcthcnl, wc use an 
auxiliary variable />, p « |li, f ), in the following 
way: Ixt 

/((If, r, p, q. A) ^ V r, q, k) i p 

Then 

</ ((U, r, q, A) " 0 

IS equivalent to 

/(of, r\ p, q, A) - (/’(<!>. r, q, k) 

4 f> # 0. Vp r |0. I 
and the set beamies 

such that f(w, r. p. q. k) ^O. 

Vfi) " 0. Vr f j 1 Ki and Vp c |0, |!. (27) 


Remark 2. Ixt to r 0, r t |^| AV p c (0, 

t 

q e R and A c U \ For stable matrices A(r), wc 
obtain continuously diHcrcntiable functions 
</((i>, r, q, A), and therefore, /{of, r,p, q, A) 

Remark .3 For each point A/' in our 

system is robust stable with respect to any r in 

f| A, and any nonlinearity 0 in the sector 5(A'V 

yI 

Remark 4 Rie complement of the set M in 
Fxampic 2 is exactly the set for an 

unperturbed system 

From (27), we obtain that the complement of 
in R * will be 

= R • \ - J A t R *: V.y e H, 3a>0. 

3r f fl K,. 3p e |(). *| 

y- I 

such that fiuK p, 9 , A) « o|. 
It IS easy to sec that 

- U 

n >n 
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where 

M“”=|a€H‘V</6R, 3w € [0, a|, 

3r€ 1*J Ki, 3p€ (0, ») 

I 

such that f{w, r, p, q, k) -{) 


'Fhc set IS recognized as a generali/ed zero 
set of the continuously differentiable real-valued 

function / relative to Q - (0, a] x | fl K 

(0, t*nd (i . Therefore, for 

finding M"' we may apply the prt^ccdure 
presented in Section 3 Since P ^ H and Af'* is a 
subset of R, according to Remark 2 we need 
only the Step I of this procedure Ixt 

xU:3{(o,r,p)e{i), o] 

X (fl Ki) X |0. X) 

'■ / * I 

such that f{u>, r, /t) - ol 


be the zero set of / relative to (0, ol x ( [^ Ki ) x 

[0, ■*'1 and R' X IR! Then by Proposition I we 
obtain 


/W’-liltf IR':V<y eH. (*.(/) e T"). 
and hence 

» {* e M ’: V(/ e R, (k, q) c V'). (28) 

where 


V* LJ 

(t -0 


The set V can be obtained from V''* by taking 

(ji' *—♦ 4* ^. 

In conclusion, the problem of absolute robust 
stabilization of a Lurie type cx>ntinuous-timc 
system with one nonlinearity unit, acauding to 
the Popov criterion, is reduced to the problem 
of locating a generalized zero set in the open 
subset R* of R. This set can l>e determined 
immediately after Step 1 of the algorithm 
presented in the previous section. In this way, 
the complete set of sector numbers k can always 
(for any numbers of unexTtainty parameters in 
the linear part, and all forms of their 
appearance) be selected from a two-dimensional 


set: 

xR\)/ = j(A.<^)€R* xR:*-' 

•f Re [(1 -♦- jioq)G(jiij, r)] >0, 

Voi 0, Vr e fl K,\. 

In the following we illustrate the procedure of 
finding by a numerical example. 


1). Numerical example 

Consider the continuous system with uncer¬ 
tainty, described in (26), with the transfer 
function r) given by 


GAX r ) = 


1 

A(l-KA)(lTrA4^AVl6)' 


(29) 


The uncertainty parameter r assumes values in 
the interval (O.IKIl, 1/2|. The nominal value of r 
is 0 4/16, 

Let AV,»p,,v be the set of points A in for 
which this system is absolutely robust stable with 
respect to any variation of the nonlinearitics (p in 
the sector S{k) and of r in the interval 
(0.001, 1/2|. By the above discussion we obtain 
that 


(A c R V 3i/ e H such that 

/(fii, r, p, q, k)^ 0, V(u ■* 0. 

Vre (O.OOl, 1/2) and Vp e |U, x)}, 

where 

/(io, r, p, q, k) - k ' ^ Re 0\(7c/>, r) 

- qo) Im (77 (/(u, r) 4- p, 
and r) is given by (29), namely 

(1 - CT/‘Vl6^r) 

(I ~ w / 16 - ru>‘) 

^ (t}( \ -I' ru')((l * (u ’716)‘ f r‘ o/7 

Evidently, for r m [0.001,1/2), G:(A. r) has no 
poles in Re A 0. and in conclusion 
/{(tKr,p,q,k) is continuously differentiable 
(Remark 2), 

Tlie cximplement of in R\ denoted by 

becomes = H = {k e 

H^. Vc/tR. 3 ui2=0, 

3re [0,001, 1/2). 3p e [0, x) 

such that /{(ih r, p, q, k)- ()}. 

Setting 

(A 6R^ V^eR. 3iu e [0. a], 
3r€[O.OOL l/21.3pe[0, x] 

such that/(cti, r, p, q, k)^ 0), 
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we obtain 

^PopHV ““ LJ 
a >»l 

The set is the generalized zero set of the 

continuously differentiable function /. relative to 
C> = (0. a) X 10.001. 1 12] X (0, *J. /* = R and 

C = R*. Following the discussion in Section .K', 
we define 

1/"= ((/t. <?)eR" xR;3(w. r.plefO. o] 

X [0.001, 1/2] X (0. *1 

such that /(u), r. p, q, k ) = Of. 

For finding V“ we apply results obtained in 
(Fruchtcr ef ai, 1901a) and briefly summarized 
in Section 2. 

As outlined in the prcKcdurc, hrsi one finds 
the set L. In the present example L ~ L„U /,, U 
For finding L,, j-(). I, 2, .1, wc apply 
Theorem 1, with t/ = I, 

Since 

1^ = 1 #0 (.K)) 

3p 

WC obluin immediately by 'Hicorcm I that 

U - 0- 

Also, it is readily verified that 

/((I), r, 4 k) # (I (31) 

Therefore, from (30) and (31) wc obtain that in 
the derivation of L, we have to consider only the 
following cases: 

In the derivation of L^ we have the case 
/(o), r, 0. q, k) - 0, u) c (0, a), r f (0.(KI1. 1 /2). 

(32) 

In the derivation of Li we have the cases 
/(u). ().(K)1, U. q,k)^ 0. CM t (0. a) (33) 

/{w, 1/2, 0. q, k) - 0. u) e (0, a ) (34) 

/((), r, 0. 4)-0. rc(().(KlI. 1/2) (35) 

/{a\r,{),q,k)-= i), r e (0.001. 1/2). ( Vi) 

Finally, in the derivation of wc have the cases 


/((), 0.001.0, *:)=() (37) 

/(O. 1/2,0. (/./t)=:0 (38) 

/(a, 0.001,0. ( 7 ,/c) -0 (39) 

/(a. 1/2,0, fl.it)-0 (40) 


It is readily verified that when and 

AX), only (32)-(35) and (37)-(38) arc 
meaningful. 

Lets consider the case (32). It is easy to sec 


(hat the equaiion 

/{w, r, 0, fl. k ) 

_ ^ (1 ' + f) 

(I ^ eir)((1 - a>Vl6)^ t r^^ar) 

^ _(1 - «i>Vlb rni') 

^ (X nr)((l nr’/16)^ 4 r'Vi') 

IS equivalent to the equation 

r. fl, k ) k ^(1 -f or')((l nrVlb)* r%o^) 

- (I iirVl6 4 / ) 

" fl(l " foVlb ' rn»*) ® 0. (41) 

Hence, we obtain by ITieorcm 1 that, in case 
(32). we have in addition to (41) the equations 

^ ; rr k ^((1 - ea‘/1fi)* t r^ir) r (1 4 ui^) 

^<i»‘ 

X ( i(l - nr /lfi) 4 r*) 

4 fl(i^4 r)-0 (42) 

^ - 2nrrA ^(1 4 nr ) 1 flni' 0 (43) 

3r 

Ilic conditions (31), (41) (43), yield a set of 
[Kiinls (A,fl)( R' xR denoted by (44) in Figs 
3a. b 

Applying Tlieorem I to the cases (33) and (34) 
we obtain the equations (41) and (42) with 
r-0(K)l and r”l/2, respectively. Tltcsc 
equations yield sets denoted, m Fig 3, by (45) 
and (4fi), respectively 

Applying llicorem 1 to the case (35) we 
obtain the equations (41) and (43) with w ^ 0, 
These equation yield an empty set 

Finally, for the cases (37) and (38) wc obtain 

/•(O. 0.001. fl. A) - A ' i.OOl 4 fl«^0 (47) 
and 

/•(O. 1/2. fl, A)- A ' -3/2 4 fl-0. (48) 

respectively. 

In conclusion, ihe set L is given by the union 
of (44)~(48). ITic set I, which is a one- 
dimensional set, is depicted in Fig 3 and divides 
X R into 15 connected domains In order to 
deade which of these domains belong to V, we 
choose arbitrary points in each of these domains 
and check whether these points belong to V, It is 
readily verified that 

kR\«, 

where D is the region dashed in Fig 3. Flencc, 
using (28) wc obtain 

“ (0.6, + x) 

Therefore, if kiSp,^, then, the ronsidcred 
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Fui 3 llic contpkmcni ol Ihc sei V' for lUnmpIc 4D 
and the connected components of R ’ x R\/. 


system is absoluicly robust stable, according lo 
the Popov criterion, for any nonlinearity 0 in the 
sector and any r€[tX00l, 1/2J. Following 

Fig. 3, we obtain that, the maximal sector in 


which our system is absolutely robust stable is 
S(0.6y 


5 CONCLUSIONS 

The generalized zero set introduced in Walach 
and 21cheb (1982) is extended here to con¬ 
tinuously differentiable scalar and vector-valued 
functions, which depends on several real 
variables and complex parameters. A new 
method for locating this set is established here. 

A design problem for a continuous nonlinear 
Lurie type system with a linear part under 
uncertainty conditions is considered. The com¬ 
plete feasible set of sectors of nonlincarities, for 
which robust absolute stability is ensured, 
according to the Popov criterion, is found. The 
generalized zero set method, proposed here, is 
applied easily in the solution of this problem. 
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AlMiracl -'-At Kawasaki Sled Mizutdiima Works, a new 
energy txmlrol system has been esuhliKhcd in ortlci lo clettl 
with energy and utilities in the sicclworks llie s>Mcm 
consists ol the works central computer, online computer, 
pn*ccss computer and digital instrumentation sysicm 'Hic 
software system is divided into the )>lanning system, 
csecuiion system and evaluation system As the repre 
scntaliYc topic of the eiecution system, an optimal gas 
supply anuiuni lor the |Oint electric jsower plant is 
determined An optimal guidance for the gas suppiv amount 
IS given \o OfKiaiurs hy solving a mixed-inicgci program by a 
decomposition methiHl in priKevs computer online realtime 
Iho new energy control system has brought a saiisfaclorv 
cnergs saving cITcct 

1 /ntraJui fKtn 

In I ni H(iS ( oNsi MtNCi processes, such as the slecimuking 
prcKess. the problem of iilili/ang energy eflicienlly should noi 
Ik considered as that of saving energy for each plum In 
these poK'cvscs, various kinds of primary energy lire 
consumed and, at ihc same time, arc converted into 
by priHluct energy A purl of necessary energy is supplied 
from this bv-product energy We then have a complicated 
iriierrclaiionship beiwcen generation and consumption of 
energy Consequently, the energy saving problem must Iv 
considered from the viewp^>ini <if total system management 
To this end. ciimpuicr control systems have liecn used so far 
and opiimi/aliori techniques have been applied lor solving 
this problem 

Kawasaki .Steel s Mi/ushima Works inirtxluccd a prcHxw^ 
computer into its l:nergy ( enter about ten years ago Wc 
however, experienced such events as severe shortage of 
fKtroleum during the oil crisis, greatly changing the situation 
of the tnergy C enter To cope with this situatnm, Mi/ushima 
Works has completely mi>derni/cd the old computer system 
and has established a general system which (>|x*rates m 
comhinalion with the prcKluction control system aivcnng the 
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entire W'orkii The new svviem hav iH'eri in ofyeraiion vimr 
January 19H8 

Various operation txmtrol vvstemv were dcvT|i>|x‘d m the 
construction of the new system This papei destiilvcs one ot 
the reprcseniiitive examples, the optimal gas supply system 
foi the |x»wei plant, which umts malheinalical piogriimmirig 

As an optimuation technique, linear programming has 
fx'^cn widely used mi far, Irccause we have to deal with m 
large-Male system In many ca,ves, a system to \k amsideied 
has Ixcn enpiessed in a linear pr4>gramiHUig itiihIc'I (Nishiya 
ri ai 1984, Akagi ff ai l‘W6. I Ictui ef al |9H(i. liar a rt al 
19K8) On the other hand, a mixed iiilr gei programming 
model IS formulated in order to optimi/e the combination ol 
various fxrformanccs of the equipments and to deal with 
coinpliiaicd requirements for actual plant o|xralion 

nils paper diHusves the optmii/ation of the energy 
supT>ly/demand balance. particularly as it ts applied to the 
by priHluti gas produced by various priwesses at the Works 
and supplied to Ihc |oini electm (mwer plant T1u' Mmuuiii of 
surplus gas priKluccd in aic'tirdunce with the proriuction |ibm 
within the Works fluciuates with time For the punt (‘leeiiu 
pown plant, however, a siiiblc suppiv of high-cnioric gas 
from the steelworks is dcviiable. and tietpjrnt changing of 
the luri for boilers shouhl Ih* avoided mi that gas is stored in 
the gas holder In consideration of these condifnins, ti is 
important to deiermirie an optimum gas supfdy series, in 
order to inform the joint rleclric power plant m advance ol 
what supply of surplus gas will Ik available, up to a ccriain 
jMnni of lime 

This problem can Ik lormuUled m a mixed integer 
program fxtyblcm with a siaircau: itruciurc The solution of 
the piYiblcm IS obtained hy the dccnnipoMiioii mcihiKl 
developed by SannomiyB and Okamoto (I9H^), m which ihe 
nested decomposition method in linear program proposed by 
(irusscy 1 1973) and Ho and Marine (1974) is extended to the 
mixed inieger program Hy tcfKUtedly solving small scale 
problems dcciimposed for each perKxl of nolifkalion. it is 
possible to obtain a fcasdvle sulniptimal Milulion The validiiv 
of the malhcmatical mixltlv and perlormance of (he 
algorithm arc investigated through c^imputaliori using n large 
cumpuier for several examples given on the basis of aefuai 
opcraltonal data The capabtlity of pulling the gas supfdy 
plan online by means of the p/fxess tompuier ai t(K site is 
also studied 

2 ( \}n/igurafwn o/ c ompuirr jydrni 

Figure I dn^ws the hardware configuration of the new 
system The hardware system consists of four levels, the 
central computer ((/< ) al the Works, online computer 
(O/C), prtHxrxs computer fP/C ) and the devices iiKluded m 
the digital instrumentation system This overall system 
handles such prrKerwes as fuel gas, eiccinc power, water, 
sieam ind cnvirunmcnial ami ml 

The software uf the computer syxtem can be divided into 
three subsystems, the planning system, cxecuuon system and 
cvaiuaiKm system The filanning system is installed in the 
< /C and calculates the supply/demand baUiKc of energy for 
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I i(i I Hardware configuration of the system 


each plant on the l>asi^ of information Irom the prmluction 
control system of the Works If there is any difference 
between demand and supply, the planning system corrects 
the plan so tfiaf (he energy fmlancc is maintained The 
methmlologv devclofic'd in (his pufHT is uiili/ed in the 
priKXws computer system as a part of the software (or the 
execution system. 

^ (ia\ yupply \y%tfni 

A steelworks generates three tyjHrs of hy product 
gas blast furnace gas (H gas), coke oven gas (( gas) and 
mixed gas (M gas) such as convener gas llicss' gases arc 
used within the Works, and (he residue is stored m the gas 
hohlei or supplierl to the joint electric fxrwer plant. In u.sing 
the gas supplied from the Works, ii is desirable, from (he 
view^Niini of the jmnl electric (Kiwer plant, that the gas 
supply docs not lUuluatr with time ami ihai the amount of 
gas supply should be known well m advance (normally K 
hours ahead) l or this reason, the steelworks must inlorni 
(he |omi electric fniwer plant of (he future gas supply in 
advance ("gas iioiilkaiion' ) 

I iguic 2 shows the gas supply system discussed here fhe 
left fxrrtion of the broken line m the figure is operated on (he 
basis of (he Work's production plan, so the optimal gas 
o|Kruiion plan to the right of the broken line will be 
c^uisidercd here (ias generation and consumption within (he 
steelworks (lueUiatcs widely over very short times, lire 

bahince is miiiniaincd on basis of the amount held in the gas 
hoUirr ami ihr M gus production M ga.s is mixed with B gas 
immediately before use by the joint cleeinc j»wcr plant As 
a result, the thermal values (in calories) of the H gas 
iiKTeascs. so the mixing of M ga.s is called the 
calorie iruTCHsing ofiernfion 

As shown rn Fig 2, the joint electric psiwer plant has five 
boilers. Boilers No I and 2 can use cakine'incrcused B gas 
and heavy oil as fued, while boilers Niv 4 and 5 can also 

use I' gas In order to stabilise ct)mhuatKm in the boiler, it is 

necessary Iti c«>mbinc the heavy oil or (' gas with 

cakMie'increased B gas. If. therefore. C gas can be supplied 
at a siaiKinary rate to boilers No 3.4 and 3, it is possible to 
neduix' the consumption of heavy oil. Operation of the Ixiilcr 
With gas only, without using heav^ oil. is colled 
ecKnhuxtioii-obga.S'Only Combusuon'Ol goJi-imfy reduces the 


consumpiion ol heavy ml fuel, leading to a reduction in fuel 
costs 

The entire jx’nod of the plan is divided into 7 periods 
corresponding to the gas notification time Phen we 
determine the series of gas supply noiihcalion amounts so as 
to maximi/e /' period profit when the seheduled gas 
pfoductinn and gas consumption in each jK'ruHl at the 
steelworks arc given 

4 Mathenuiucal Jormuiaiion 

Under the {i.s.surnption that the gas flow rate in any given 
pcriiKl IS constant, we define the variables m the |>cruKl 
r( 1 r • /■) ’AS follows 

^hb(H. f'luif). Residual gas flow rale in (he Works 

(Nm'/h) lor B gas, C' gas and M gas. rcspicctively These' 
values arc known 

V; (r). V^{t) Cias volume (Nm') held at the end of 
period t in the gas holder for B gas. C gas and M gas. 
rrxpeclivciy 
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M ga& Bow rate (Nm'/h) pnxlucetl fnrm B ga* and C 
fas. 

f^asO). ft-sO). /Ws(i) Cias flow rale (Nm’/h) uipplied lo 

joitil dcctnc power piani for B ga;^. C' ga% and M gat. 

rcspcciivdy 

Using these viruMes, the amsiriiimi» and ohjecitve fumriKm 
i>f this proWem arc formulaicd as follcms 

(a) CanriraifUs fi/r gat Mdrr The amount of gas held in 
each holder is giserii by 

^ ^ 1) *♦' A7 [fBn(t) /) n/'MidJ 

K U) - V|0 ~ 1) + ATlf; h(/) - A;^(/) - (I nlf^fr)! (M 

v'mM) ^ ^'m(' - u + Ar(f„K(»( - f„,(() + Am)!)! 

where AT^fh) is the time micrsal of period r and n is the 
miamg ratio of B gas and C gas. The amounts of gas held at 
the beginning period and the final period of the plan are 
given by 

V;,(0)-V‘;, KfOl-K'. VM(0)-V'i, (21 

Vafri-V;. V,(T)-.Vl. V'„(f)*V'M IM 

For the amount held in the holder, there are constraints, 
i c upper and lower limits, which cannot l>c caceeded For 
the sake of convcnicni'e. however, (he amount (discharge! 
exceeding (he upper limit for each gas is delincd as /,((). 

Fp^(/) and the amouni (gas shorlagr) lower than the 
lower limit for each gas as ^ mIO f^aniiing is 

dime so that these values equal ^cro In this way. the 
following constraints (or the upper and lower limits arc 
obtained 

Vh ' lif^l *' ^ H ^ k „(r) I 

V. V.d)'. v;{t) I (4) 

V'm V'm V'm(0 J 


wh^*rc Fii- ^ < Vm limit volumes lor the 

rcsjKctivc gas holders and V^ , arc (he up|Kr limit 
volumes 

Ihc amouni in the holder is allowed to (luviuaic within the 
range indicated by (4) However, with rclcrence lo actual 
operational results, it is found out that operators keep the 
gas volume in each h<ilder as constani as fv»\siblc Thivse 
results should be adopted to refkci operator expenemc 
Thus the normal value of the amouni held in each holder is 
defined as I V',^. and V ^ Using ihe vanalitin (rom the 
normal value, each amouni in ihc hoUlcr is c.xprcsscd as 
follows 


^(0 = v',' + , (0 

1'm(0- \Z * AV ,:,(/) A)'„(() 

where 


(5) 


AF|if/), AV'/(r) AV Increase (Nm ) from nnrmiil 

value of each gas 

AV'ntfl AV\ (r), AV'^^(r) ^^"b Decrease (Nm') from normal 
value ol each gas 


(h) ( onutramts for gas flow raif and quanuty of hrai Due 
lo Ihc boiler operation c'on.s(rainis ai the joint clccfne pi>wcr 
plant, the following constraints hold lor the supply amounts 
of B gas and ( gas 


^HS ^Bsf H f 'BS I 


fh) 


where and F< arc kmcr limit values (Sm\fh) for the 
supply amount of each gas, and and F^ the upper limit 
values (Nm'/h) 

The cxmstrainis for the supply amouni of M gas, on the 
other hand, is based on the calonfk value of the 
caloric-increased B gas The following relaii<m holds from 
Ihc ihermai balance before and after M gas is miaed with B 
gas 


where tf M calorics (hcal/Nm'I of II ga» and M gai 

rejfiecYivdy. ^n, ealottn (kcAl/Nm^) of B g«a aficr ihc 
calone•increase cipcraiNm For the fotbswing Upper and 
lower Umtis exist 


^aiIfni 

where ami are lower and ufipct limit values fin 
From formulae (7) and <H). the foDowing formulae are 
obtained 




(c) f om/hsimif for et^hwithm of C gai om/v m hfMiers of 
the fomt fiecinc fdant 

fit The minimum imouiit of C ‘ gas rec^uired for i;s:>mbustion 
of gas-only |>e r boiler n anaiumed to tse F* Since the 
iximbustion-of-gas-oiily n possible lor three IhmIcis. we have 
the following relationship between the amouni of C gas and 
the number o( Ivoilers n(/) for romhustion-of gas-only 


n(((»0 ir ' 

, „0) 

n(f) - : II =. ^,(l) • \ 

n(r) ^ 3 if 7, «jn(r) ** ^ 

T o cxprcM the relationship (Ml) in a form of the linear 
inequalities, fl I iniegei variable* n,(r). n.(0 and n,(r) are 
iniicKluced. and the following formulae arc thus obtained 

n(r) ■ n|(() * n,(/) < n,(() 

f,’. - l-'M 
A + 

('I I rt,(i»| ) (III 

A, .(f)-. :f,*. A-. l>n,(l) 

r, slf)■'f'l's < ’| I n.(fll 

f,^(f)A ♦ (/n.d) ^ 

where ( ' is u sufficiently Ititge constant and ^ is a protvcily 
.small pimlive cxinslant 

(ii) If (he supply amount of ( gas drerenaes and Ihe 
combustion of gas-iuily is no longei possible, heavy oil i» 
used as fuel of the boilcis In consideration of the work load 
required when swilching from ( gas lo heavy od. frequent 
switching of fuel ts not desirable When the crrmhusiion-tif 
gasimly is praciited. therefore, it should be conltniied at 
least during 2AT hours If such continuation is not poatiihlc. 
a penally should be imposed In addition, if the numlxrr of 
IxHicrs foi iomhusiion-of'gas“Only devreaves, the number of 
the decrease should be one at a lime For a simultaneous 
changciivrr of multipk Ixnicrs. a relatively heavy penally is 
impncd 

In order to express this constant, An*(f) and An fr) are 
introduced as vanables lor the time variation of nfr) Ihai is. 


n(r) •' ntr I) ♦ An ’ (r) An (r) 
An ' (r), An fr)0 
n(fl) *' n", nf T ) « free 


f12) 


For the decrease of n(r), An (r) is expressed as follows 
An fr) 4,(/) ♦ *?(/) + A^(r) 

' (H) 

(t|(r), A;(r). Adr) >* fl or I 

Funhermorc, in order to avoid that Ixwh An ' (i) and An fr) 
become ptniiivc in (12) wc have the following eomiiraini 


Or;. An '(/) f .TA,(D 3 


(M) 


When (he cxmibustionrif-gai-only cannot be conlinucd for 
2AT hours, wc have the following penalty. 


P(0 ‘ 


An (f) if An (r 1) .e 0 or An " fr • 1) ^ 0 


0 


If An fr - 1)« An'f/ - l) *0 


(15) 


(7) In rpfckr lo express the rclaiHHiship (T5| m a form of linear 
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ificqualilici, 1 fnicgier varijiblc /(/) ts inuMwxd, and the 
folktwing formuiac are thu» tihiatned 

it) 

An (r) U\\ Hi I)| 

p{t)^.in{t I) 

0--. V(O-|A/i (/) + An'(0|-‘ 3 
/(/)«() or I 
W)-f‘, /( 7 )-lree 

(U) Objfmilt funviion. T'he objective function coiuixti of 
the following itemft 

(i) l;viiJualcd value of gas supply amounL 
(li) profit obtained by reducing heavy oil con&umption 
through cambuntion -of• gim-only 
(ill) Penalty impMcd when the upper and lower limitn of gas 
volume held m holder arc viuluted due to gas diacfuirge 
or gas Nhortage 

(iv) Penalty for suppreMing fluctuation of gai voluine held in 
holder 

(v) Penalty im|H>aed when combuslioivof gas^tnly cantioi 
he continued 

(vi) Penalty impoMil when the tuel of muliipde boilers is 
changed Himultuncously from ( gas (o heavy oil 

Hy summing up the aNivc items, the objective function lo hr 
maaimi/ed is ns follows 

'r " X ,(7) 7,%«(()) ♦ </m7m>(0| 

J I 

^ r,A7|fi,(/) ^ n^lO ^ n,IOl 

4 r,V, (r) 4 ^P(/) 

|r,,,A V' n ( /) 4 1 A V ,1 (i) 4 r,, A V , (r) 

4 r'l^AV ^ (r) 4 ^i^AV n^(/) 4 7|^AV 

~ 4 i(t)| (17) 

where 

q^ : calorie (kcal/Nm') of (' gas 
r,; evaluated value of gas (yeri/kcal) 
ry profit (ycn/h) obtained through combustion of gas-only 
r, ' f„ io«M (yen/Nm') due to gas discharge or sfH)riage at 
each holder 

Um (yen) impined when the comhuslion'Of-ga.s~<inly 
cannot he coniinucd 

'‘m “ ''m penalty (ven/Nm') for suppressing the fluctuation 
of gas amount held 

r,^. r,; penalty (yen) imposed when the fuel of two or ihrce 
boilers are changed over sunultancouslv 


5 Solution 

flic optimal gas supply plan can he decided In’ maximi/ing 
the objective function (17) subject to the construinls (1) (b). 
(9), (1I)-(I4) and (16) In this section, wc discuss an 
algorithm used to quickly obtain a leaMhlc suhoptimal 
Mdution to this |Hohlem when the scijucnce of the residual 
gas amounts (f;,K(0. b\ h( 0 ^nd f-MwlO) iJi given 

rite variables defined in the preceding section arc classified 
into 0 1 variables and non ncgalive continuouii variables If 
a constraint of the problem includes a variable relating lo the 
adjacent peruHis. say period t and period r 1. the variable 
it handled a^s a aintinuous variable for convenience sake For 
this reason, /(r) included in (16) ri taken as a continuous 
variable, and in tit stead, (V I vanabk m(r) is mtnxluced 
Itial M. the fifth ettuation of (16) tx substituted by 

i{i) m(i), m(f) ^ (I or I 


Thut wc define the new variables as follows 

Kill "(t)./(/)!' 

•(() ^ (fij(f). 7,,;((). 77 

V';«|. VrU). vjl), V^Ul 

(IH) 

AV'ilr), AV'bO), AV,'(i), AV', (d, Al^ Ji), 
Al'Mid.ptf). An'(d|' 

»(d ^ \n,(l), n,tn. n,(i). k,{l), 7i(d. *i(d. '"(Ol' J 

where y(t) and m(t) are vectors of continuous vanables and 
v(r) IS a vector of integer variables A pnmc denotes the 
transition of a vector Some components of y(r) and nil) arc 
integer variables, but these components arc obtained as 
integer values from the constraint of the problem T'hercfore. 
they can he treated as cimltnuous vunahles 
If the variables arc defined by (18). the problem in the 
preceding section is expressed in the following form 
/ 

P min Zj ^ ^ li'yit) 4- h ■(/) > c v(/)| (19) 

t “ i 

fubjccl to 

y(r) Ay{t - I) 4 Hm{i) 4 f v(r) 4 %{t) 

Dyit I) 4 F»(o 4^ (iXr) dii) 

y(r).M), ii(t) Hj y CD) 

v(/) t H (v(f) j v,(7) ^ (I Of 1, ( 1. 2, , 1 

f - 1. 2. . T 

yH») y" (21) 

where A, H ( , />. t, (/ arc maincev oi appropnaic dimen 
Sion and a.b.c.Mt), d(r) and y" arc vector^ id appropnaic 
dimension All o( these matrices and vectors are known 
quantities 

rhe problem V has a constraint with staircase siructure, 
fiecause Ihe cocfhcient matrix id the second equations of (20) 
has the non zero elements disinhuiet) in siairca.se form 
A decomfHvsition algorithm has fH*en pr«)(>osed for solving 
the problem P (or the cave oi /t () (Sannorniya and 
Okumoto. l'W5) With a slight niiHlihcalion. the algorithm is 
d\so available for the ciisc id /) 0 

Hie priKcdurc is summarized us follows tn a manner 
siniiUr to the nested decoin|M>Mlion lor linear programs 
(Grasscy, 1974, Ho and Manne, 1974), the prt»hlcm is 
decomposed into a senes form of T small-si/e mixed-integer 
programs llicn. a multi level technique is applied lo the 
problem with T levels At each level, the mixed-integer 
program acts as a muster lor the following level and a.s a 
subprobicm for the preceding level lire solution tor each 
level IS obtained hy solving the small size problem The 
procedure terminates after satislving a restricted optimality 
check for each level ( onsequcntly. the algonthm gives a 
fcajubk suhoptimal solution. Hie detailed description of ibe 
algorithm is omitted here (sec Sannorniya and Okamoio. 
19H.5) 

The present algorithm di>cs not always give the optimal 
sidulion of P, because the optimality of the solution obtained 
IS checked m a rcsinctcd manner Anyway the result 
obtained at the termination of the algorithm is adopted as 
the solution of P Hie difference between the optimal 
objective value and the objective value Zf for the curTcni 
solutKm IS estimated in the following way By relaxing the 
firet and the sceemd equation of (211). we construct the 
(.grange problem, where the Lagrange multipliers are given 
by the simfilcx multipliers obtained hy the present algonthm 
Then, the duality gap for this problem is related to Zj 
and as 

The value is given by 

X ” y, - r«dr)'4(r)l (23) 



where 
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«i, « nun {(a + B n^it) - /: •<f) 

n,{t)\'wit)) (24) 

subject 10 ■(0 ^ 0. v(/) e 0 

In (23) and (24), ir,(/) and are the simpki multipliers 
corresponding to the first and second c-qualkm for the 
modified version of (20). rcsipcciivcly I Usually, the value of 
the duality gap is denoted by ) x IlJtM%) 



6 . Lxamplf of ctUculatum results 

In order to investigate the validity and the effectivcneKs of 
the preient method, an off-line numerical calculation has 
been cxccuied for several illuMrativc ciampks prepared 
cxirrcsponding to real operation data The whole planning 
period IS eight h<iurs (AT » 2h and T ** 4) The numerical 
computation has iKen made by a large-scale coinpulcr 
(FACOM M-382 al a Dala Processing C’cnier of Kyoto 
University) 'Phe mmpulalion has been also maile by a 
proems computer for evaluating practical applical>iliiy 

Firstly, in order to evaluate the validity of the 
mathematical mtxlel, we applied the dea>mposilion algo 
nthm 10 the mcxlel lor various values of y(0). ^ ) K(T) 

and Vn^(/') which are based on Ihe real operation data As an 
cxcunplc. Fig 3 shows a compariMin of the solution iibiaincd 
by the algorithm with the real operation daia We had zero 
duatiiy gap for this example Ihus the opiimnl solution was 
obtained Fig. 3(a) shows the real operation dala of the 
holder levels V’r (r). V'm( 0 ami the gas flow rate /'Mv(t). 

shows Ihe optimal solution obtained 
by the algorithm It is observed thal the holder levels loi the 
operation dala change wiih time in some degree and that the 
levels for the optimal solution fluctuate very little 

Furthermore, the lime variation of the boiler number nil) 
in the combust lon-of-gas-only ofX’ration is given by 
(.3. 2, 2. .3} foi the real operation dala, and by {3, 3, 3, 3} loi 
the optimal solution In addition, the objective value 
obtained by the algorithm was improved by t) 4'^ir lor this 
example as compared with ihc real operation data Similar 
improvement has been iibiamcd for the lUhci examples 

It IS concluded from these results that the present 
mathematical miHlcI de.scribcs the csscniiiil furution of ihc 
ical system with a suflicicni degree of rcliahilitv In the ease 
where the parameters in the objective function arc set as 
r uL (J lit, . 15), we have had a solution such as the 
holder levels change considerably with time within the ranges 
between the Uiwcr and upper bounti Hie solution is noi 
desirable according Ui Ihc operator s cx|>cricncc ITius. il is 
concluded ihai the parameters r,(i ^ Id. .15) should not 
be icro 

Secondly, we have had a lest run by using the existing 
procevs c'omputcr (FAC OM S 3MM) at l.nergy ( enter of 
Kawasaki Steel Mirushima Works, 1 HMIFS) C omputation 
lime was about 14 seconds under no other load condition and 
Hf^-ltld seexinds under normal operation condilion Such 
computafkm lime is considered lo be saiisfaciory from the 
viewpoint of practical application The system gives us a 
guidance for ihe gas supi^y amount automatically every 2 
hours corres^ponding to the gas rKUificaiion time The 
guidance is monitored by operators 

In the Works, the new energy control system has operated 
since January It has the gas supply guidance system a« 

a part of software Figure 4 shows the trend of ihr 
combustion-of-gas-only ratio dunng sixteen months The 
ratio mcrcaocs up lo wTicn C‘ gas is surplus Therefore, 

in order to use the value as a mca.surc for cffccrtivcneM of 
operation, the ratio divided by (called C“ gas rale) n 
xhown in the figure 

It IS observed from the figure (hat ihc uiility of C gas has 
improved successfully since January I'WiH Although not ail 
the effect results from this guidance system, it ts evaluated 
that the introducfum of the energy control syitem including 
Ihe present algorithm has given us quite an improvement 


_I_I_ \ ___I 
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Fki 4 T rend of rhe cr>mhufiti<m <if raiin C gus 

rate (cnmbmiion-oT'gaM imty ratio/reKidual gas amount 
(|(^*Nm')) Conihuitlion of gas-only raiio - (combustion-of 
gas-only lime/toial lime) 

7 (oncluMum 

An optimal gun supply system lor a p<iwer plant has been 
(hseus,scd in eonneclKJH with Ihc new energy conirol system 
ul Kuwasaki Sled’s Mi/ushima Works The problem has 
been TormuJated as » miacd integer program A sulH^ptimul 
s4iluiton has iKcn obtained by applying a dccomf^mition 
algorithm By showing the optimal solution to the operators, 
suIVkicnl redueiion of the heavy oil has hc'cn obtained 
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Robust Measurement Selection* 

JAY H LKEt and MANFRED MORARU 


Wor4»—Ri>busi 0 Dnli\>r. Benson, dtimatHYn. olwrvcn, ilnturhjiiKxr rejtciti>n, diilitUitHH) 
columns. 


AMnct- A mtasuremcnr vclcchon mcthixi ts ikvtlopcd in 
ihc conic*i of Siniclurcd Singukr Viilue (SSV) thck^ry Tbc 
method IS based on rt>busi peHormance norm hounds on 
transfer functions with direct implications on the sensitivity 
and robustness of the closcd‘l(H>p s>'sie.m Using a high purity 
distillation ciilumn as an c.*ampU\ it is demonsiruied that the 
new measurement selection mcihmi can be sucxessfuliy 
applied to a realistic problem to yield » mcttsurcmcnt set and 
a controller with robust performance 

I /nrr(f*durni>/t 

Si < i)NOAH> Ml AM'Ht Mt VTs arc ottcn an essential n.spcct of 
process control Tbc need for such measurements may stem 
from one of several laclors first, primar^^ variables may be 
unmeasurable for cither technical or economic rcas 4 >ns. 
second, secondary measurements may simply improve the 
system’s achievable closcd-lmip fie r form a net For example, 
in distillation composition control, temperature senMirs often 
replace expensive, unreliable composition analyzers that 
intriKluce significant time delays 

While there is a wealth of both thcoreiicHl and practical 
evidence that points to the inifHirtancc of correct 
mcaMircmcni choice for feedback control vystem design 
(leading to desired performance). there is an apparent lark 
of systematic measurement selection criteria llie imfiortancc 
of measurement selection has long Kn'n recognized A 
numixr nl different approaches have been proposed for the 
temperature .semsor placement in distillation C4>tumns and 
pinkcd'bed reactors (Hequcitc and Udgar. Kumar and 

Semfekf )d7Ha,h. McHirc rf al l'^7) as well as in more 
general contexts (Joseph and Hrosilow, W7K, Moran anf! 
Slcphanojvoulos. 1980) Hequette and Udgar (1*^86) proposed 
a st‘i of criteria for the temperature sensor placement in 
distillation columns, based on a compromise fieiwecn 
'inlercnlial error ‘ and the rneasurenients' sensitivity in the 
manipulated variables Mcnirc ei al (1987) pr(»posed a set of 
empirical rules lor the same problem using the singular value 
dccompkiMiions of stcady-statr gam matrices Weber and 
Hrosilow (1972) and JoM;ph and Hrosilow (1978) examined 
the problem of measurement selection in the context of 
infercntiul control, their wori was extended hy Moran and 
Stephanopoulos (1980) to incorporate system cfynamics, 
based on the Kalman filter A number of people, notably 
Kumar and Seinfeld fl97Ka.b). studied the problem in the 
stochastic framework and proposed measurement sclcctum 
criteria rnmimmng a^ipropnatc scalar measures of the 
covanaiKc matrix of the siaic-cstimaiion error 

Unfortunately, very few- of these propo»scd entena have 


* Received 29 March 1989, revised 3 January 1990; reviied 
14 May 1990. received in final form 4 August 1990 The 
onginal version of this paper was not presented at any IFAC' 
meeting fins paper was recommended for puNication m 
revised form by Associate Editor R V Patel under the 
direction of FUlnor H Kwakemaak 
t department of Chemical Engmeenng. Roux 23<J, Auburn 
University. Auburn, Alabama 36849-5127, U.S.A 
t Chemical Engtnccnng 21 (Ml, California Imtilulc of 
Technology. Pasadena. C^ifornia 91125, USA Author to 
whom all correspcindcnce should he addressed 


been tested m the laUuntory and lai Irwri have been 
applied suixecsfully in industry Ihe aiipareni lailurr of 
extant seleciion methods in letrm of their general and 
practical applicabtliiv can W attributed \o the following facts 

• The methods were rcsiiKled to specifH' lyfH^in of txmtrol 
vchemes or pimc^Ases 

• The issues of pmtaual miporlaiKT (such as mthiel 
uncertainty, system dynamics, unmeasured disiurluinces/ 
noise, lesinctions on the amirollci si nurture) are not 
incorpiuaicd 

In this paper, wc prop»»se a new measurement selection 
mcthcKi that aildtesses all ol the aforementioned practical 
issues m the ^tmiexi of Structured SinguJai Value (SSV) 
theory (IX»yic, 1982, fXiyle rr u/. 1^2) The propoficd 
selection mcihotl is designed to be Ixith numerically simple 
and for which the subsci)urni design of robustly piMfotming 
controllers is straightforward Skogrsiad and Morarl (I9KH) 
showed a means for iranstormmg a necessary and lufbcitni 
umdilion (oi robust performance in the m terminology inlti a 
sufbiient condiinm m terms of norm Ixuinds (maximutn 
singular value) on y)>ccifK transfei fuiHtion mnfrures We alMi 
base our cnicna upon norm lxiund.s on particular transfei 
function matrices (c g vensitivity. complement ary venMtiviiy) 
with direct implicalums on the M‘nsiiiviiv arul robustness of 
the closed-loop system 

Hie meth<Kj is rvidently very geneial since the SSV 
formulation allows us to incorporate all the relevant 
robustness issues ;is well as all desirable performance 
features (eg user-specified disiurbamr and |>eriormance 
weights) Furthermore, the subsequent design of the robuMly 
performing controllers is simple wnie the obtained 
norm-bounds can be used directly for the controllei design 
fhc mam drawback of the method is that the derived bounds 
can f»r conM'rvattvc However, we will show ihai the 
conservaiivencRs of ihe mclKknl can be leduced sigfifuantty 
by restricting the controllers to a Kpecilic form 

We apply I he meihcnl lo an importani c hema al prrxrss a 
high purity distillation column The pliicemenl o( icrnpcra 
lure Mcnsors in high purity diMillatum columns is known to tx? 
of crucial imprirtancc for satisf{M;iory ckUilrol ol Ihe priHliMt 
compositions The example will dcmonsiraic that the new 
proposed selectK)n method tan be .Miccrssfiilly applied lo a 
realistic problem to Imaie a measuternent set for which n 
robustly performing c.onlrollcr can fxr easily designed 
Although the method is applied lo only one process in this 
paper, wc believe that out mam oontribuimn lies in the 
introduction of a general pKxedure f<M measurement 
ncleetion in the face of practical issues including model 
uncertainly, unmeasured distiirbanies, measurement noise, 
aiKJ restrurtions rxi the cxmiroffcr sfruciurc 

Thoughoul this paper, it is assumed that all plants can fw 
described by linear, lime invariant, stable transform function 
mainccs The assumption of stable plants n only fr>r 
simplioty and the meibrnl is not rrxtrKricd lo aiahle plant* 

2 Grnerai framework 

2 1 t>t!frripium of dixiurhamn, prr/omuirM'r fffn tfno 
f$oru and uncrrimnttei Figure 1 show* the general diagram 
of a cksaed loop system with secondary mcasufemeni* and 
x-nomi'brnjndcd uncertainly bk»ck* Wc use an input/rniipul 
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ut »hi: ^yticm where CV,, rcprciurnui ihc iramrer 
furKitoii from the V4riahfc Jt id ihc vanahlc v A brief 
Ktimriiary uf h<m performance rctiuiremcnttv. and miKtei 
uncertainly ikftcrihcd in the conirjtt 4)f hiructured angular 
value Iheory in given in ihin ccction 

• Deicrtpunn of prrformam r requiremenvi 

Performance ui rncii.%ured by the of the 

ilowrddoMtp transfer malria from d' to iwhere the 
A/, norm o( a Mablc, cauioal (i c analytic m the ck>acd 
RHP) trariwfer matrix fV ic defined an 

lie’ll ., cup (2) 

Ihc A/, norm mcacurcc the worst fumilok weighted 
intcgriit nqiiarc of the output fur n clasc of riorm-loounded 
inputs 

• Dfsenpium of mode/ unctrimniy 

As xhown in Pig 1, model unccnamty ii deiwribcd as a isct 
ol norm (i.c maximum Hinguliir value) bounded 
|)cr1iirbalions to the nominal nvHlcI ai each frequency li is 
acHumed that all pcriurfied nunlels have the came number 
of RHP j)oles (hence, stable m our study) ns the nominal 
model 


by the uncertainty dexcriptiofi lYte following theorem by 
Ck>ylc (I9H4) shows that a necessary and sufficient coihIRkki 
for robust performance can be formulated in terms of a 
l>ound on the SS\' ip) of a particular transfer function maim 
fsee Appendix for the definition of the function p) 

TTieorrm I Suppose f\ ^ (K, A„) in Fig. I is stable when 
A, « d Then 


max li/-; ^ {K, AJIL^: I (4) 


if and only if 

■ a: 

supp 

where 


j(A,,(j“H A’,:.A:(/ - S\,K) - I 


. 4 ;- 

A { A : A f ) -'(tio.il'! j 

Pnmf See Doyle (ldH4) 


A.e V'‘ 


(f)) 


2 2 Strtit turrd %inf^ular pu/ur ami rohuxt prrformam r In 
this section, we summuri/c (he deliniiiuns of robust 
|[>erfnriniifice and structured singular value and how we may 
formulate the mcasujcincni select mn problem in the 
sirueiured .singular value framework 

[irfinitinn 1 Unhurt prrformam r I'he chised litup system 
sh<iwn in Fig I is said to achieve "robust jK-r forma nee" if the 
closed Itkip system is nornmally stable (i e stable with 
A,, d) and 

max II A, j{K, A„ )I1. • I CH 

A*i A „ 

where A j (A, A,,) is the closed ItHtp iransfci turictiun miitrix 
from »/' to ( ' 


Rofiusi fKiformunie implies that the ps^rformance 
specification is satisfied foi anv plant within the sel defined 



I h. I I oriniilation of riu isuremcru seleciion (uuhleni in 
the cunlcxl of sliucuireil MiiguUir value iheorv 

i controlleil variables 

d disiiirbaiue (di/runsc (n) vecivu 

I n I 

c weighted controlleiJ variables 

d' weighted disturbances'noise 

V, a l;lh) SCI of measured variables 
rn manipiilnicd variables 
A„ “ / , iHtrm tHuinded riUHlcI uiicertainis 



A| Ajjni)) “^^ f V(f,» I *'■ f i 


where 4, denotes the set of rcul-rational transfer 
function matrices 

min mm max !iA. (A. A, )l|, O 

I XirH, A„*A., 

min mm sup M!* |(,V,, t \,.A(/ \..A ) 'A..) 

I ... I 

(Aiire A' nui> or mav not be con»iraaned to a dcccntrafued 
structure) 


2 ^ (irnfrai approm hrs to mrMurrrnrni srlrciion The 
following arc Ihrce possible approaches for measurement 
selection in the context ol SSV theory I'he approaches are 
not mutually exclusive and rnav fse combined in locating the 
best possible measurerneni set 

Approach 1 Select the measurement set mmimi/ing 

1 

min sup u 

X*W, r,. I A^, 

f V,,(fi7i)-f ,V|, A'l / A .vA ) ’ \',|i|if;)) (7) 

where K, is the set of rational iransfei tunciion matrices that 
slabili/c the closcd-lcHip system nominally with the parijcuiar 
measurerneni set under consideration k, may t)e resincled 
to a diagonal/blix’k'diagonal structure if the coniruller is to 
be dccenlrali/cd 

Apprtuich 2 Fliminate the measurement sets for which 

I A,: 

nun sup p 

X.K, .. [ 

X (,N\,(J|U) ,V,.A(/ .V,;A') ‘ V;,()'^>)) 1 (H) 

Approiu h ^ Find Ihc measurement sets for w hich 

mm sup p 

X> W, |J> 

X ‘-S.(jm)) ' 1 l*^) 

In approach I. wc synthesize A' achieving the minimum p 
for each measurement candidate, then compare the ps and 
select the measurement set and the corrcsptinding controller 
achieving the lowest p Although the approach seems both 
slriiightforward and immediate, there arc significant theorcl 
ical and practical drawbacks to this formulation The 
mtmimizaiion problem expres.sed through equation 7 is 
compulalionally formidable I'he algorithm available cur- 
rcnily li e u-synthesis [Dovlc, W84|) is unreliable and 
rcquirc.s large CPD-timc In addition, it docs rnn allow 
rcstnclion of the controller to a dccenlrali/cd sirueturc In 
view of the combinatorial nature of the problem, this 
approach alone is clearly not a feasible solution 10 the 
measurement selection problem for large-scale problems 

In approach 2, ncceixary cxrtiditiom for Ihc existence of a 
controller achieving robust performance arc used as 
screening tixd.s to eliminate the candidates for which no 
controller exists that achieves robust performance These 
screening tiK>ls. when "tight " and numerically >itmple. arc of 
great practical value, since they allow the engineer 10 reduce 
the number of measurement candidates dramatically so that 
more complex entena may be afiplied. An example of such 
screening lixds is a conditKin based on the achievable 
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foe nominW petioniuiice. If wc assume thai 
dim (c ) « dim(m) and dim (e) dun (d), (he (ollowui| 
simple screemng tool can be used (see Appendix ftir 
denvaiion); 

Eluitinatc the uicasiijemcni set for whkh 

> i (lo) 

where denotes the antisiable factor, the 

Haxikel-nonn ( ) an ad|oini operator (le A# 

and ( ),, and ( )„ inner and oomner facton. 

respectively 

The odculation of the Hankcl-norm of a transfer matnx 
requires sotviiig only two Lyapunov equations ITie cx>ndtiion 
(10) is a ncoeasary and suffkaent conditum for the cxiMcnce 
of K meeting performance requirement in the abserne o( 
model uncertainty; henoe it is a necessary condition (or thc 
exrsience of K achieving robust performance For cases 
where dim (m) < dim (r) and/or dim (i) < dim (d), an 
Iterative search procedure (e g y iieration (Doyle. I9H4)) is 
required lo cakulaie the optimal f/,«-norm for nominal 
pedormance. For more of su^ screening tools. readers arc 
referred to Lee (1991). 

In Approach 1. sufhcienl conditions arc used to kwaic a 
nieasuremeni set for which a controller achieving robust 
performance exists There may exist more than chic 
measurement set with this property In this case, wc can 
either impose more stringent performarux .spccihcalions, or 
select B measurement set for which a robustly fKrforming 
controller can be designed most easily. DcveUipmeiu of 
“light" sufTicicnt conditions useful (or meaMiremcnt selection 
and controller design is the focus of this paper In Section 
2.4. wc will develop a methodology lo derive rt>buM 
performance norm-bounds on particular ininslcr matrices 
(that paramctrac the controller AI These norm bounds art 
siiflicicni conditions for robu.si (icrformancc and can be used 
In select a mca.surcmenl scl for which a robustly fierforming 
a utrolkt can be designed in a straightforward manner 

2 4 Mrth4niohfiv for cirnt'injif rohiLst per/ormumr norm 
hounds In this seciton, wc preseni briefly the mciluHl (oi 
deriving robuM performance norm-lxiunds on desired 
iransfer fundion matrices Wc make use of ihc following 
rheoicm by Skogestad and Morari (l<^KH) 



Fiu 2 Ciencrai method (or deriving rHirmTHHimis (a) 
general rohusi (lerformanix priiblcm, (b) parameinrjition of 
k in Icrnu of /., (c) paramclruaiion of M in terms of f, (d) 
derivation of luirm-bounds on / 

The pKKrdure for denving the norm bounds is summarised 
as follows 

Strp 1 FTgiifc 21 a) rrpreikrnts the general nibuM perfor¬ 
mance pnsblcm (iiee Theorem I) The (irat iilep is lo 
parameinre (he amirollci k in terms of the tranalrr 
function maim T on which the norm f^ufid i« ilmired, aa 
shown in Fig 2(b) 

Step 2 After aimbining the matrices N and J inlo H |FTg 
2(c)|. the matrix /. is tfcaied as a real parametei 

times an uniertamiy block as shown in Fig 2fd) 

.Viep \ Ihc norm fiouml on / guaranteeing robust 
performance is calculated by clkHising the (requriKV- 
dcpendeni Si-almg factor r *fm) such that /(rffm)) » I Vui 
According to nieorrm 2, the prtHcdure provides a 
(rcqucncy-byTrequcncv bound on rVf/Tjro)) guaraniecing 
robust (x^rformance (assuming k is chosen such that (he 
closed-)<H>p system is noininallv stable) Wr emphaiuire that 
r*(cii) IS the tighiert norm-bound on L in Ihc srnae that, lor 
each <;(io) M'*(<ii) (or some ui. thert exists at Iran one /. 
such that (>f/4jw))’"’ C/(ii>) and sup/fCi (i<i)) I 


Theorem 2 Let A# f i'”’"’ Ixr wnflcn as 
M ^ /?,, 4 /?,>/.(/ R:J.} 


(II) 


where 

and / « (12) 

Define 


/(f/) “ ft 


where 


A: A ^ 


Assume 

ftJK 

then 

If 

where cj ftofvea /{cj) « 1 

Proof Sec Skogesiad and Moran (ISNih) 



11 

«u 1 

1 A 


f , «;.> 1 

A,. 



1^ « m 

( - 1 

A, € €' 

^:AF 


Ve.«- 

/ 


1 ind 

del (/ - 




<HL)<c; 



(H) 


(14) 


(Ih) 

<I7) 


Remarks 

• f(Cf ) IS a nrmdrcreaiing (unction of *, Thus the scaling 
factor (J can be easily lound through a simple 
search proceduie (eg hiscciion method) 

• There may exist many sets of J, t. paramcinnng k The 
norm-bounds on different Lh can be combined over 
(iiflcrcnl fretjuemy ranges For example, suppose that 
Ivrth and parametn/c k Then, robust performance 
i.s met if. lor each (U, d(f,,(ju/))^ r *,(»•») ot At/.j,()iii)) * 

t ;,(rj») 

" Sufficiciicy of tlie condition (17) arises from (he faci (hat 
rrtbust (icrformance must be guaranteed for every /. 
.satisfying 0% d(/ )(in)* i/(>«>) (as r>f>posed lo a parliciilar 
/ ) 

• * I requires (hat /(r, ) - 1 lot « 0 

• Tightest bounds can be obtained if we reslrict /. lo be a 

scalar times identity matrix Then, p can be calculated 
with respect to S, A r '€) 

1 Measurement selrcuon r rireno Aaird <m rvhmi 
performance norm hounds 

T wo philosophicalfy different approaches are possible lor 
ixiniroDing vanabies through wecors^y measurements 
Opfurn 1 Select the seamdary measurements with input 
output behavux similar lo (hat of the primary vanabies 
and control the selected secondary variables 
Opiton 2 Use the secondary me a«u re men Is l« estimate the 
primary variables and control these estimates. 

O^Km 1 can he advatitagecms over option 2 in that the 
required a>nirolkr design effort and ami roller compkiity 
for optirm I may be sigmficanily Ids than ftsr opium 2 
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Hfiwevcr. option 2 is more general, unce ihere may noi c*i*i 
iuiy Hcumclary mcaaurcmcni «ei with similar input/output 
behavior 

fn this section, we use the robrnt perrormance 
normbounUft inirrMlueccI m Section 2 4 to develop 
meaMircment selection mcthiHls for the above two optioas 
The mam question concerns the choke of the tramfer 
malriceft on which the robust performance rM>rm bounds arc 
to be derived 

VI Mfa.iurrmfr\t trlfcuon entma for option I Fnr this 
apfiroach, the objective o to select measuremenK with 
input outjHit behavior similar to that of the primary 
variables so that the aintrollcr design can be baaed on simple 
techniques such as shaping of the sensitivity and complcmen> 
lary sensitivity functions 

Choict* itf funiUonx fnr robust perfnrmarue norm- 
bounds It IS logical to make measurement selections based 
on the robust performance norm-bounds on the sensitivity 
function S “»(/ 4 ^ and the complemcniary sensitivity 

function 7 ^ since these (unctions have 

direct implication on the closed loop response* of the 
secomJary variables. The secondary measurement sets with 
substaniially different inpul/oiitput behavior from that of the 
primary variables will yield infeusibie iHiunds, .since shaping 
of these functions is unlikely to result m » controller 
achieving robust jKrforrriance 

f'lgurc 1(a) represenlN a parafricln/ation of the controller 
A.“ in terms of the complementary sensitivity funciMin / The 
parumetri/aiion of K m Icrm.s of the sensitivity function S 
can Ih* obtained by using the fad the S - I / I he robust 
performance norm bounds on /' nnd .V can then lie 
calculated by using the procedure dcscTibcd m Section 2 4 
However, there are serious drawbacks in making measure 
mcnl .selection based on these norm-hounds f irst. 
u right inverse of may not exist Second, the stability 
and causality of /' (and hence S) d<H:H not ricccssanly imply 
the internal stability of the closed-lmip system and the 
causality of the controller K In fact, in order to have 
internal stability and controller causality, the transfer 
function */ (0 has to Ik stable and causal Ilcnce. 7 

is restricted to .share the same nonminimum-phase 

characteristics with Ibis restriction on I' may put severe 
limitations on the achievable (t(.S()n»)) lor some measure 
riiciit sets, and the bounds may not provide a meaningful 
basis for selection 


l-k 


.\ 

I- I 




i', n' 

H i 1 - 


l-.l\ 




K- 



fTci } Partimclrization of. (nj controllers in terms of 
aimplcmenury sensitivity funciHiii /'. (b) cxmiroller in terms 
of IM(' filter T, (e) cloaied-ltH»p operator M in terms of f. (d) 
closed-loop operator M in terms of .V «* / » T 


M,, 


I w;. 


R^^ " A7,1 4 <*W|j 






Wc can overcome these probicim by rcplaang (G^), ‘ in 
Fig .T(a) with the IMC! (Inicmal Model Control) controUcr 
and deriving the norm-NKinds on f and 5 / - t 

inatcad (see Fig. ^b)|. An explicit formula for /7j-optimal 
C^ip^ in the com; of zero input weighting exists and can be 
found in Moran and Zafiriou (l^K^). Tins particular choice 
of C?iM< corTespemds to an approximate stable inverse of 
hence, f can be viewed ax an ‘'approximate" 
compicmeniary scnxitivity function Indeed, if ' exists 

and I.S stable, the dpiimai (7 ,m< G»J yielding T - T and 
A « .V More general opliinizaiion techniques (Kwa- 

kemaak and Sivan, 1^72, Francis, 1^7) may be applied to 
irbiain if ncccwuiry Becauac the resulting ^imc 

always stable and cau&al, the only requirement for internal 
.stability and controller causality is the stability and causality 
of t Hence, the robust performance norm-bounds on f and 
A can be u.scd directly m controller synthesis, and they 
provide a fair basis for mea.sureincni selection The 
norm-bounds are ea.sily derived using the melhcxJ desenhed 
in Section 2.4, as shown m Fig 3(h)-(d) The most 
noficonscrvativc bounds are derived by rcsincting t and A to 
be icalar-times-idcnlily transfer matrices 

Steady-state Cf^nduton for etLsirnce of feasible 
bounds. Although numerically straightforward, it may he 
cumlxrrMime to derive these norm-bounds for all candidate 
.sets if the number of candidate sets is very large Wc can 
reduce the number ol candidate sets which have to be 
considered significantly by noiing thin the Icasibic tHtund> 
can be nbiaincd only if the robust pt*rformHncc condition is 
satisfied at u) U with A - 0 


Theorem .1 (Referring to Fig S) -d it and only it 


where 



A.. 


(«(!•))■ I 


IlSl 


K - 




I ly) 


PrtH*f Note ihul /(i ;) m I heorem 2 is a monoioniLallv 
non decreasing function of r, Hence, in order tor i •((!) * 0. 
It IS ncccs-sary and sufficient that the robust pc'ilormancc 
condition is satisfied at steady slate with A (• From F ig 
Md). It IS evident that this corrcs|>onds to the condition (!K| 

Wc cannot expect a teasiblc* Ixiund on d(T(tl)) because' 
d implic.s opcn-lmip Siticc the condition (IK) can he 
checked very ea.sily. it can l>c used to elimtnaie efficiently the 
measurement sets for which the resulting robust norm 
tK»und.s on 7 and A will not be feasible It i.s then ncccssarv to 
derive frequency dcjx'ndcnt norm-lwiunds cmlv on those 
measurement sets that satisfy the condition (IH) 

ff C^iMt fbl ‘ (G',^), ‘(0). .V d ( 7 ^7) implies ‘ perfect" 
steady-state control of the sccondiirv variables .v This is the 
case if the controller K has integral actum on .v Hence, the 
condition asks whether or not steady-state performance 
s|>ccihcations will be met when a controller with integral 
action (.such us diagonal FID) is implemented It is 
interesting to note that, if there exists a direc'l linear 
relationship between the pnmary varaible vector r and the 
secondary vanabic vector % (i.r c ^ M.% where M is a 
constani matnx). then the condition (18) reduces to a much 
simpler condition 

' 1 ( 20 ) 

Note that the condition (20) docs ruil depend on the 
performance weight and the disturbance weight Since 
the amount of uncertainty (expressed through and W^) is 
relatively "small" a1 steady sure, the conditum (20) will 
almosl always be satisfirxf 
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Fui. 4 ParamctnzBMon o( dcveniralucd uituioUcT K,i in icim^i td fj l«) anil 


(ompanstm with cxisan/^ mramrtmmt s^lnthm 
cnierm Neat we want lo ctimparc tHir mienu with other 
availahle mea&urcmcnl «clectK>n criteria When the uncer 
Uinty is Ignored {W, » 0. ^ 0) and C^Mi *(d). 

the lefl*hand side of the inequality ()H) tKiorncs 

Iliis IS equiviilcni to ihc 
maaimum singular value of the "inferential crTor * matna 
that Bequctle and E:dgar (198h| suggested to mininit/c hv 
measurement selection vSince our cnieriM account tor mmlel 
uncertainly and system dynamics, they arc more general iind 
complete In addition, Hcquelte and t'dgar (I’^Kh) stated in 
their article, ihai the measurement selection should Ik- based 
on the compromise between inferential accuracy and 
sensitivity of measurements lo manipuIiticJ v.iriahles llie 
senMiivity ol measurements to manipulHied variables should 
not impact measurement yclection since the amount ol 
cxinifol action needed to eliniinate a disturharue in Ihc 
primary variables (which is the ultimate objective) docs ni>i 
depend on the choice of measurements However, an issue of 
great importance is the sensitivity o( measurements to 
(iofurhiinrr.v In our entena. disiurbantes could itulude 
measurement muse so that a compromisi' fH'tween the 
inlcrential accuracy and the signai/noisc ratio o( the 
measurements is reached 

Lxtensufn to drtrnrru/ircf/ ctmirot Ihc alvive approach 
can be easily extended lo cases where the contoillcrs arc 
restricted lo diagonal/block diagonal siriu lures (A>./ 
Figure 4(ii) rcpres<‘ms ii para 
mciriration of the decentralized controller k,, in lerniN ol 
"block'diagonal complementary sensilivHv" function J,, 
diag fcrj,, .{TJJ ( G), ^ 

' H'irtJj- I ' <■' «, represents the /ih diagonal 
bliKk o( Using the same argument as hclore. wc chtMive 
to derive norm bounds on 7’^ and -- / /., instead ol 

and as shown in Fig 4(h) A condition siniilar to (IHj can 
be also derived straightforwardly, we omit further details loi 
Ihc sake of brevity 

3.2, A/rflLfwremenr jrfrrtron crurna for opium 2 In this 
approach, the controlkr design is based directly on the 
performance of the pnmary variables using ihcir csbmaicN 
from the .secondary measurements Assuming a large enough 
number of linearly independent measurements (greater oi 
equal to the numlxrr of linearly mdcjicndcnl disturbances), 
"perfect ' estimation of tfic pnmary variables is fHfKSible in 
ideal iitualKins (that is. in the absence ol mcrtsurcmtrit 
noise, miKfcl uncertainty, and nonminirnum phasc charai 
icnsiics in the measurement responses to disturbances) 
Hence. Ihc ob|cctive i.s lo select the measurement set that is 
lca.si scasitivc to these laciors preventing "pcricct ' 
estimaiitm. 

Choice of /unctuffu for rohuM performamr norm 
htyunds In order lo apply Ihc robust norm brrund method, 
we must seek transfer matrices with direct implications f>n 
(he performance of the primary variables Figure Ma) 
represents the par ante tnzation of the controller K in terms of 
the function H It represents the transfer function from the 
setpomU r to the pnmary variaMcs c, and hence wc will refer 
to It as the "compkmentary sensitivity-like ' function 
Similarly, wc can dehne the •scmitmrydikc" function P as 


/ li P repirsentii the transfet (unctHW from 4 lo r when 
the effects ol the disiurbwmes on the controllesl vanabir* are 
normalized i» i* f) I'hev funtiions tlelermine the 

closed hHip res|xmsr ol the primary variables ami have direct 
rrlcsaiicc toi closcd-hHip lohusttieM as well Hence. it n 
logical to brt.se the measurtnKiil selection on Ihe robust 
pcibumaiHT norm bounds on ihcMr fum:lions 

As was the ca.se with sensitivity and compicmeiilary 
vcnviiiviiy luncdons. however, there are serious diawtHicks in 
making the measurement Mrlection b#iiM:d on the norm 
(sounds on P and // lirslly. (fi.j)* a left inverse 
and ‘ a right inverse ol (f»,^ may not exist Seaindly. 

the siiibilitv and i:ttu.yalily ol H d^Hrs not necessarily imply the 
mlernal siability of the dosed Io«^ system and the cauuilily 
of the controller k l>ue to the unernal stability and 
controller cauvahiy requiremcnls, Ihc (raiislcr funtlion H is 
icstncted to those transfer mat rices yielding stable and caunal 
(f*.^). V Ihis reatnetion may put severe 

limitations on achievable d(7*(|tij)) lot some measureincnt 
Mi^ts and Ihe (xiunib may not provide a lair baais for 
selection 

Wc can overcome these problems similarly as we did for 
Option 1 Wc replace (fi,^), ' and <V,,/(fV,^), ' in I ig ^(ii) 
with the IM( e^mirollrr and the estimator f in Fig 

S(b) l*hen we can u.sc the norm (sounds on H and /* / H 

instead lor measurement selection |see lig 3(b)) Ibc 
advantage ol this is that the only requifcmerit lor iniernal 
stability and omtodler causality is the stability and causality 
ol // Hence, the robust (x-iformance norm (>ounds on H and 
7* can Ih‘ used directly in controller synthesis, and tfK‘V alMi 
pi<n-u1c A Ian basis (or mrasurcmeiii srlcrtion A giHKl 


, .i" U..:A , )'■ i-.jA., 

: ■- i I- ■! , ■ •'t' jAk-i; \ 

! ' ■ ’ - ■•-.u ... 1,- i i ; I ' , , -J , '1. ! 

; -'h 

■i . ' h* ■ ■ ' 




Fi«» 5 FttramciriZiiiion of («) coniroilcr in termy of 
"complcmcniary scnwiivity like" fum.tKin H, (b) conlrallci 
in terms of IMf filter //, (c) dosed-UKip operator M in terms 
of /F (d) chwed'kaip operator M in terms of “ H 
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cKoice lor (/im< //.-opnmal C/im< 

inpui-wcighimg, aJihoui^ other more general //-///.^ 
opiimi/ation icchniquc can he tmpioycd If corrciiponth t4i 
an approximate, arable inverse of A gtxkl choice for f. 
IS w^bcrc rcprcacnix ihc aKnjicr factor of 

ihe aiinncr cooulcr laciorizaiion of («uch that 

“/) ff ranciH, IW7) However, more generally, f. 
can be chosen as the Kalman filter (fir miKlified Kalrtian 
hlier) F'or detaiU on the design of t, Ihe readers arc 
referred to Moran and Sicphanopoulos (IVWlt Jhc crptimal 
choice (in the absence of input-weighting and measurement 
noise) for C^M^ ^ '^**1 be ‘ and ‘ 

respectively, if they arc both stable and causal 


SitaUy rtair condition for fjaiitrncc rtf femthic hounds As 
in Section VI. we can obtain a nccessarv condiiion for the 
existence of a fcamiblc bound iin f* at to II 


Thtorrm 4 (Referring to Tig S) t7<(ll) '0 if and only if 


where 





{Hwn< I 


f2l) 



/i(i 




a^C^.Mr Ff, 




Wjf/.,. 





/ f', 



t^roof Siruighibirwanl Iroin the prtwd of Ihcorcin A 

We cannot expect a feasible Ixnind on d(//(())) l>eciiuM: 
H ' 1) implies opcn-lfMip Using the condition (21), we can 
drumatically reduce Ihe nurnbi'r ol the nicirsureincni sets lor 
which the nt»rm bounds arc lo be derived II C^imi l,b) 

«mi /■:((•) '(()), • o(//(0) v. /) 

implies "perfect” steady state control of the primary 
vanuhlcs i' in the alisrnee of nuklel uncertainty and 
mcfiNurcmcni noise lienee, the left-hand side of the 
inequality (21) is the measure of (he sensitivity to uncertainly 
and measurement noise 

( omparuitn With noring measurrment sclrctum 
t ritrna Wr would like to draw u corripunson between our 
criteria and the "condition nunilH'r cnicrum' proposed by 
Wcl>er and Rowilow (1^172) 1 he minimi/.ahon ol the 

left-hand side of the incqualiiy (21) wnh CVm* (^*1 
(f ',«,'(^M i*t>d /’((•) \d) IS equivalent to the 

condition numix'r criterion il we assume no meusurcnieni 
noise and a spi’cihc type* ol uncertainty, namely rnultiplica 
live "full" imiput uncertainly on |sce Lee (1991) for 
detail I Our cnlcriB arc nuire ctimpicie sirurc thev 
incorpiirale a more general description of uncertiiinty, 
measurement noise and system dynamics 

4 Numrnail cxampic Htf^h purtix liiMiilation 

As an exanipk'. we study the high-puruv diMillaiion 
column shown in f ig h Lhe column and Ihc imnlcl are 
dc.scTified m detail in Appendix A ol Moran and /aliriou 
(I9H9) ['he control prohleni of the column is presented in 
Fig 7 

f^roNfm dexertpiton 

• /)errM/-h4jm:e.r / no we 

Most common disturbances are ih^vse in the fcciL ii often 
changes according to the a>i>iitions in another plant unit 
such ttj* a reactor. Mcasurvmcni error (mnsc) is often another 
impxiriAiit lacior We wdl study Ihe effect of one physically 
motivated measurement error: uncompensated pressure 
variation f'hc following set of disturbanccs/noisc is 
itmsidrred: 

Feed ftowrale (f) 

Feed composition ) 

UiKsimpeiwuilcd pressure vanotion (T) 

■ Mfuxurtd tmrmbirs 

Measurements are usually mit limited to a spccifk number 



Fill 6. High-punly distillation column 


although It IS common to use (wo tray temperatures for 
two-pr.)in( composition control In this example, for the sake 
of simplicity, we restrict ourselves to two tray temperatures 
(7„ and T,,l In addition, for brevity of presentation, we 
consider only Ihc placements symmetric with respect lo the 
feedtray (such as tray #I/tray 941. (ray 92/tray 940, and 
so on) This IS logical since the column is symmetric with 
rc-spcci lo the feedtray 
• UncerlMnty 

We limit ourselves to uncertainty in the manipulated 
variables Iliey have been shown to be the dominant 
uncertainty for high'puniy disiilintion columns (Skogesiad n 
al . I9W() We chfKisc the .yamc uncertainty weight W, (hat 
Skogestad c( al (19K8) used in their study 


• Performance and dLslurhance wetf(ht 
The performance weight and the disturbance weight 
are chosen as follows 


lOvfOOl 


W',, 

-1/ 


where 





5.1 f 1 

\,ip' 

h ; - 0 .1)4 


0 125v ^ 1 

1 - 

As usual, much lighlci 

' specificaiions arc 

frequency region in 

order lo 

ensure 


(24) 


(2.V) 


response 

• CVioirr of functions for robust-performance normhisundls 
We take Ihc more general appitiach of Option 2 and 
chiKise the scnsiiivtiy-likc and complementary scn&itivitydike 
functions described in Section 5.2. 


Steady-state perf ormance We apply the steady-state 
condition (21) to reduce the number of measurements to 
consider Tlie plot of the left-hand side of the incquaJiiy (21) 
vs measurement sets is shown in Fig. Hfa). It represents the 
measure of Ihe "worst-ptiMiblc" performance when the 
controller is designed yielding no steady-state oflfseis in 





Fill. 7 Control problems in the disliUatitm column. 
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Fui H. RubiiKt |)crk>rmanc( measure £it ihc sicady suic wiili u»iiii\>ncrs vtckiiivi: ih* sicaily siale ofl^ets in 
ct>mpt>silions nummally fP -- ()) (ii) Sica^ly %uic robust fsefbummiix menMirr. (b) iombhon numlKi ol 




conipiisiiions nunnnallv (m Ihc iibscrKC of uiucriuini> iiml 
measuicmcnl error) The mcasureincni sel of /. anJ 7,, 
'(bows Ihc bcsl sicady-slale pcrformiincc In fact, it is ihc 
onl> mcasurcnicnl set lhal satisfies ihe n>ntliti(*n f?!) Ihis 
result can Ik* inlt*r|nclcd physiaillv Ihc lempeiaiuirs 
measured close lo the rclHiilci and the condenser have fnior 
M)!f)al/noiH* ratio hccausi* the ^aiits from disiurhanccs lo 
these measurements ate small ' On the other hand, the 
measurements far away from the rclHnler and the condenser 
are sensitive to miKlcI urueriainls since the relationships 
iKlwecn the end prvmi comp<iMiions and the measuiernenis 
bi'comc less direct Hence placement of Ihc icmpciaiurc 
stiisors involves a compromise iKiwecn these iwo factors 
This IS apparent from the plots shown in l ifi H(a) that 
represent the values lor the left hand side of Ihe mequalits 
(21) when measurement error (unc<mifH*nsatcii pressure 
variation)/nu>del uncertainlv are iicglecled live measure 
ment SCI is apparciitls the Ix'si comprcmiivc between 

the signal/noise ratio and the scnsiiiviis to rmulcl 
uncertamtv Note that neglecting either the mmUT 
unccriamly or the measurement error would have resulted iri 
d wrong choice of rncasureTneni f igure H(h| represents the 


condition ruunlH't'K of the steads stale gam mainecs from the 
diftiurhainecs to Ihr mrasufcnH*nts (f»\j(<l|f Note nliio ihtil 
the eonditiirn numbri (Brtmilow's eriicnon) ibites not rettcci 
the measuiemenis' scnsiitviiy to uiHf rimnity i-orrci’lly in this 
pariicular prirblcm 

Hifhiui prr/ormrfjnce norm t^>unds on /* md H Since the 
only measuremcn! m*» satisfying Ihe stendv stale comlilion 
(21) IS all that is left lo do is lo check that, for ihis 

pariiculur mcasurrmeni u*!. we can design H such Ihnl 
robust fK'ilonnarue is achieved This can be easily done by 
deriving ibe robust [Krlormance norm Urunds on l/i{(tni)j 
and !l g(jr«»)l The robust irerforniMncr bounds on P and H 
foi the measurement set /r//u arc shown in Fig *>(«) Tlie 
Ivounds are Teuviblc' since the following tramrler lurHiion 
meets at least one of the IsoumJs at evciy frecfuency as we 
can see from f ig 7|a) 


“(UKl. . .M7S.1M2.* I)' 


The u pfot for lohuM (KiformiiiKC |Fig '>(b)l shows that 


(a ) 



1C ^ .1 JO 10^' 30* 

Frequency (rodions/minute) 


Fit. 
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Fki 9(b) 

Fin 9 Meeting the mbuJil pcrbirmancc norm bciunds on f'>(/*()«>)) «iniJ wiih A/ *-^(t)/ for the 

mciiKurcmcnl m:i T 7 / 7 ,,. (a) Meeting the norm bcuincis. |h) SSV' for robust performance 


-Ixiund i)n <>(F(ji^0) -hound on ()(//(jru)) 

- " |I ■ 


rohuMt performance is achieved for the measurement sei 
T-y/ J\y. Figure 1(1 shows the simulated rcsp<ms4.*s of x,, and v,, 
to unit step diHturhanccs in and F and a mcasuremcnl 
noise in the form of a pseudo random binary signal of 
unit magnitude filtered through I he specific mulliplic 
alive input uncertainly (1 e used for the simulation 


0.2 

0 


0 

(12 


1710 siinulutioiis conlirin ihc physical in 


tcrprciation given earlier 

Although not shown here, the option 1 approach 
(selection based on the norm-hounds of the sensitivity and 
the compcmcniHry semsitivity functions) identified the exactly 
the same measurement set as the hc.sl measurement set in 
this case 


02 T <al 

'M 

3 ; i, 1: : ; 

lU : I;'’ 


IDO ;!0o ;.i(>o too r»D(> 

T tme 



0 J 
II I 


(b) 


5 (Vifir/aoon 

ITiis paper intrinfuccs a general nieasurcmeni selection 
method in the face of practical issues (such a.s mtKfcl 
uncertainty, restrictions on controller structure, and so 011 ), 
cast in the framework of the SSV theory It diflers from most 
of the previous work in its theoretical rigor and general and 
practical applicability ITic meth<id is based upon norm 
hounds of Ihc transfer function matrices with direct 
implication on the .sensitivity and the robustness of the 
cfosed-UKip system. Hence, the denved norm-hound.s arc 
useful not only for mcu.Hurcmcni selection hut also for 
suhscqucnl robust amirollcr design llic choice of matrices 
on which the norm-hounds arc based depends on design 
philosophy. We identified two philosophically distinct 
appmaches to ct>ntrolling variables through secondary 
measurements, and shtrwed how the robust performance 
norm-b<iunds on certain matrices can be used as the basis for 
measurement selection. Ihe example of a htgh purity 
dtstiUntion column demonstrated that the propc^d selection 
method can he applied successfully to a practical problem in 
locating a measurement set leading to robu.st performance. 
As a final note, we would like to point out that, although we 
developed this paper in the context of measurement 
selection, the proposed norm-bound metfunf is applicable to 
more general control structure selection problems. For 
example, il can he used to select an appropriate set of 
actuators among the available candidaies 


0 1 - 

----------1- x -y , .- <■ I I I---1-,---"-n 

(I 100 :M)0 ;ok) -lOf' 

T irrw 
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Fifi 10 Simulated responses of x„ and to the unit step 
disturbances m z,. and F with 2(f% input uncertainty and 
pacudo-nindom binary measurement noise (a) Measurement 
set tray # 1/Tray #41; (b) Measurement set tray #7^Tray 
#35; (c) Measurement set tray # 17/Tray #25, dashed 
Unc —► 1 »: solid line Vp 
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Appendix 

Definition ttf the .Sfruefured Smgu/ur Value ITic Structured 
Singular Value (p) is defined as follows 


Dfftmnon A l,ei M * 4^'** and dclinc the set A as follows 


A* ' 

[ A . A ^ 

A, _ 



i 


.. 


A, f V * m, V n, “ « I (I) 

f -1 / -1 J 

Then (p of M with rtupeci to Oh: wnceriailOy 

structure A) is dchned as 

l|min.irt(&) dcl(/ + MA)-(», A<i All ' 
to if 3 no A A such that det (/ 4 MA) 0 

I>en\Hition of the Hankel norm nmdttum Wc derive the 
condition (11) in Section 2.’I < >ne can easily obtain the 
following et^uahly by using the (laramcifi/atton of all 
stabilizing contiollers 

mm |||/-; (A. olU - 

a* a, 

min (|W,.((;., IM 

tuw/#, 

where RH, denotes the set ol all rational irunsfrr (unction 
matrices unalvtic in the closed Righi-HaK Plane (RHP) 
Suppose and W;, were chosen so that RIT, 

Assuming that ^(jio) and 6',„Wrf()o») have corisiani 

ranks lor (l-yfn- we can easily jx'rlnrm the following 
inner inner and coiiiiicr coinitcr fiicioiizaiions 



(4) 




For sincily projHrr systems, the assumption of lonsiani uinkh 
for I) ‘ 111 % ' does noi hold, however, they can Ix' 
iipproaimaicd as pro|>cr systems up lo arbiliaiily high 
Ircqucncy 

Theorem A Assume that BJ.f*,ami fi,./B'< me square |i c 
dim (4 H dun (m) and dim (^^s) * dim(d)| AImi assume that 

exists and is anHlyin in 
jru-axis where ( ) denotes the iul|oini o|K*ialtn |i c 
M (v) »)| Ihcn 

min III/-; ^ (A, AJU, . • I (fi) 

if unU only if 

where | |, tlenoies the anlisiabic factor and H ||,y denotes 
the Hankel norm 

Proof Siraighilorwaid from Nehan's ITicoiem (Francis. 
1W7) 
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Reduced Order Process Modelling in 
Self-tuning Control* 

C. C HANGt^ and D C’HINt 

Key Word# —Mixkl based nelf tuning control; reduced order model; deadtimc, ticqucncv rchptMiH’ 


Abstroct—One major objection to the mtKicl-haved auto- 
tuning and self'tuning control i> based on the obscrvuiion by 
Bristol that a reduced order mt^MicI being identified would not 
yield g(Kxl control of the actual high order pnxx'ss In this 
paper we have re-examined the work of Bristol and argued 
that this obscrvaiKins could not be gcncrali/ed We then 
consider reduced order modelling which incorporates a 
deiidtime element It is shown that the dcadtime crruld help 
Ic) provide a close match of the freqency rcsjHmsc near the 
critical frequencies Lxlcnsive simulation sluilies have also 
confirmed that reduced order modelling with deudtimc 
included could fn* an adequate mmlel lor practical sc'lf-tuning 
control 

1 introduvnon 

An PSSi NliAi purl of the sell tuning control involves 
parameter estimation of an cxplicii or implicit poKcss model 
(Asirom, i‘t ill., 1*^7, Astnim and Wiiicnmark. I^H4) In 
iiidcr to reduce the number ol parameters to fx* estimated 
for practical ondine self-tuning control, the ordei of the 
pKKess model chosen is often smaller than that ol the actual 
prtxcss hence intrtHlucmg a jxilenlial mismodclling problem 
This was highlighted by Bristol in conjunction with his work 
on a pattern recognition based adaptive control concept 
(Bristol, 1^70, l‘^77. I^HK) I'hc study ol mismodclling 
addresses principally ihc process structure errors, which are 
difTcreni from paramcinc errors Bristol conjectured and 
demonstrated successfully through some examples that a 
reduced order mink I so identified would not yield gtxHl 
prixcss control Djxm this premise, he objected to the 
concept of self-tuning control based on prixess nnxlel and 
inslcad developed the now well-known and commcreiaJly 
successful pattern recognition-based IlXACT adaptive 
ainirollcr 

In this paper we have re-examined the problem of 
mi.smodelling We shall put forward the argument that 
though Bristol's work and conelusii>ns on mismmlelling were 
relevant and correct. they could not be generalized, 
particularly when a dcadtime elemcni is included It is 
inspired and supported by a study of frequency rcspmsc 
matching as proposed by Wahiberg and I jung ( llic 

paper is organised as follows Section 2 summarizes BrisioPs 
work and questions the generality ol the results and 
conclusions drawn Section 3 presents ihc study of frcqueiiey 
rc,spon.se matching and simulation results when a dcadtime 
element is included in reduced order modelling. .Section 4 
discusses the relevance of this study to adaptive control and 
gives the conclusions drawn, 

* Received 16 June 1989, revised 12 July, 1990; received in 
hnal form 29 August 1990 I'hc original version of this paper 
was not presented at any IF AC meeting This paper was 
recommended (or publication in revised form by Asscxiatc 
Editor L VaUvani under the direction of Editor P C Parks 

t Department of Electrical Engincenng, National Umver* 
ity of ^ngaporc, Kent Ridge, Singapore 

t Author to whom all corrcsp^cAcncc should be 
addressed 


2 7iNr mismoiiflhnifi rxprnmrnL\ 

Hie dclatls of the miKmodclling ex|Mriiincnis conducted by 
Bristol were given elsewhere (Bristol. 1970, 1977) I'HC 
cx|>crimcnls compared the cloM^J-hHip step res|Hmses 
between a high order prixtss controlled by » PI controllei 
and a reduced, seamd order mmlcl idcntiLMlIy omtiollcd 
The model was drnved m two ways open-ltHip and 
closed-ItKip step response mulching 

In essence, Bristol obsc-rved that Ihc model derived under 
open-hxip ideniiliLaiion gave unacceptiible control j^erlor 
rnamc when the lixip was chmrd around Ihc pnxxss 
Likewise the nuxlel derived undci closed l^Mip ideniifkation 
gave grossly diflereni open-loop responses when compared 
with Ihc onginul prix'css However. ;i convergence to 
satisfactory control jki formance could be obtained in the 
case of ciosccl-lixip idcntiliaiiion alter several ileiations But 
for the cast' ol the sell tuning regulaiois, suth a convergence 
to uicepiahlc control pt'ilormunct could not lx* assured since 
the scILluning regulator structure uses un equivalent of 
oiKndtxip idcniihcalion sirinture (Bristol. 1977, I9KK) 

It IS noted that BriMoPs ex|H’rimcnls uiilizeil step 
responses as the basis lor modelling in Ixiih ojKn liaip and 
closed-liHij’i Kleniihcaiion Such an approach may not be 
appropriate as il may rn»i sufTicicntly excite the lelcvant 
natural mrxics ol the process foi the purfHise of system 
idcniilicalion (Aslriiin. ri al , 1977) ruriheimore. the 

cnienon used in ihc idcniilicalion priKxss was the intcgriil 
squiue crroi o( the step response, this means that the 
identification was csscntiallv skewed towards the steady state 
portion of the set of data poiiiis 'Ihcrelorc. the matching 
would favour Ihc low frequency region of the pnxess's 
frequency response, again increasing the possibility of 
mismodellmg at the criticnl trcquencics (Wahiberg and 
I jung, 19K6) rmully, since the matching pnxess involved 
only step responses, the results emphasised a magnitude 
match. 'Hicre was little consiilcratinn lor the phase of the 
prexess and no attempt to match the model and pnxess 
phase frequency res(>onses 

f rom the aNovc discussion, it is not certain that Bnslnrs 
ol>scrvations could be generalized to compkiciv reject the 
concept of sell-tuning c^inirol with reduced-order mixlclling 
It has been shown recently by Wahifxirg and I jung (19H(>| 
that frequency response matching near the critical jioinl is 
mote appropriate for assessing the accuracy of the reduced 
order modelling for the purfXiM:; of stable feedback control. 
In the ease of Icnsi squares paramelcr eslimation, this can be 
achieved by suitable choice of data filtering to fixus on Ihc 
frequency range of impcmancc In the following section, we 
shall attempt another approach involving the use of a 
dcadtime clerncni to address this mismodclling problem. 

.3 Rfdured order modellinfi with deadnmr 
In order to facilitate easy comparison, the experiments 
were conducted on the same prrxcss as used bv Bristol 
(Bristol, 1970, 1977) 
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Impirccl by Wahiberg and Ljung wc shall approach 

the atudy of reduced order modelling from a frequency 
domain penpcctivc. First, we shall consider continuous 
miKkls klentiAed by matching the time responses, simiUr to 
the approach used by Bristol except that a pseudo random 
binary sequence (PRBS) lest signal is used instead of a step 
input. Iwo models were identified The mcxlcl. A, assum^ 
to be second-order with dcadtime, was idenlifted to be; 

o„(r) • (2) 

For comparison, a second model, B, assumed to be 
second’Order but without deacliimc as in the Bosiot’s 
experiment, was identified to have lime constants of 4 H and 
16.7 llie criterion used for evaluating the goodness of fit for 


Tabu. 1. PI Con'iboi.i i h sm iNtis 


Controller settings 

K 

T, 

Fig* 1(b). 2(b) 

2H 

17 

Fig* 1(c). 2(c) 

5.6 

17 

Figs 1(d). 2(d) 

6 63 

10 


both models was the integral square error between the 
process and model open-loop responses 
Consider Fig. 1(a) which gives the open-loop step 
responses of the process and model A, and Fig. 2(a) the same 
for the process and model B Note the closeness of match of 
the two models to the process. From the process open-loop 
response alone, one might have accepted the plausibility of 
representing the process by a second order model without 
dcadtime, if the process was not known to have a higher 
order structure. However, when the loop was closed around 
the prc»cesfl and the mtHlch, each identically controlled by a 
proportional-integral (PI) controller, deviations became 
apparent. These deviations arc obvious from Figs 1 and 2 
which give the doscd-hxip rc.Hponses for three sets of 
controller settings (proportional gain K and integral time 7^) 
as tabulated in Table 1. These settings were chosen to 
operate the closed-loop prtx^ss near optimal, with poor 
damping and near unstable modes respectively in order to 
examine if these characteristics could be rehected in the 
models, as suggested by Bristol (1970, 1977) 

The discrepancy between the open-loop and closcd-hxip 
respiinses for mixlcl H is evident from the plots, whereas 
model A can t>c seen to represent the prix^cs-s sufficiently. To 
understand the underlying disparity, we examine the Nyquist 
plots of the process and niodcls as given in F^ig. 3. This is 


' <1 •* Nyquiot pi of for prore^.**, ano mrxiel 



"O* 0 0.8 0.4 O.B 0.0 
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Rg, 3. Frequency re^tponsc of process, models A and B. 
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where the crux of the mixmmiclling argumcni re«ick*i In 
model H, the opcn kK>p rcxfKiriM: matching did not yield a 
gocHf match of (he frequency rcfip^mse at higher frcc|uenctes 
Hut the inclusion of a suitable deadtime element in model A 
provided a chance not only to match the magnitude hut aliso 
the phase frequency response of the model to the prixess 
resulting in a close match in the Nyquisi plot between |he 
process and model A 

Tluii observation affirmed two points staled earlier 
Firstly, opcnloop step responses arc piMir guides for 
mcHlelling They may lie used as supplementary guides in the 
matching process but cannot be the sole basis to arrive at a 
reduced order mcKlcl If anything at alL the frequency 
resp<iiisc' of the process should form the basis for mfMlel 
identification or vcnhcutifin Secondly, an opcn lrxip step 
rcsp<insc favours a low frequency idcntilicHlion as evident 
from the Nyquisi plot ol model tt However, it is the higher 
frequency end of the pnxxss frequency rcsjKinsc, especially 
the region around its Nyquisi frequency, that is of 
Mgnihcance in dosed-liMip control (Wahllu'rg and Ljung. 
IW)j Tins IS because closing the loop around the process 
will create its rc.s<inani clo.sed-UKJp modes that must l>c 
modelled Brishil's observation on mismodclling was due 
largely to these LinmtHlellcd modes 

Hut for model A, the phase lag introduced by the deadtime 
overcame this problem of rnismodclliiig It could he seen 
from Figs Ife) and (d) (hat even in the limiting eases, the 
rnoders rcsp*Hiscs corresp^uidcd very closely with those ol 
the priKTCss This points m the direction that a reduced order 
model With dcadlimc can be an adequate representation ol 
the original process and hence a basis for control analysis and 
design 

As pructical scU-luning control is invariably implemented 
in digital form, a di.sciete time model, i\ was also identified 
using a FKHS excilalion signal T he closed-hnip responses of 
(he model and process, given in Fig 4 had the same 
controller settings as the continuous lime case, by means ol 
direct discreli/aliun The simulations confirmed the ap 
plicahility (d the model in the discrete lime domain This 
IKiinl IS evident b<i(h from the frequency response matching 
and the closctlToop responses of the model and the process 

Note from the closed-loop response that model ( was 
nonminimum phase 1'his came about because the dcaiiiime 
approximated was lower than what the process actually 
exhibited From extensive simulation exf^ieilenee, it has been 
found lluil as long as the majority of the dctullime has been 
exfilicitly modelled, the residual dcadlimc can he safely 
rcMccted as nonminimum phase zero (l>e Sou/.a n al , 1988) 
which IS automatically identified by the estimator In discrcte 
identiliculion, variable deadtime can further be identified by 
ovcrpariimcicrizing the numerator jx>lynomr.il of the process 
miHlcI 

4 ( onr/izYiom 

In general, no pradical prmxss can lx* precisely modelled 
implying, then, all modelling eflort is inherently faulty 
TTicreforc, techniques considered should reduce some 


mismodclling to a minimum Even with cuct knowledge of 
the proceiis order, a fullnirdcr parameter cUimalor may run 
be practical due to consideratKin of the speed of parametric 
convergence, computational efficiency and precision. On the 
other hand, a reduced-order model requires only a hxed and 
small number of parametric estimates. TTiis simpler mode) 
not only improves (he convergence of the estimates but may 
also avoid the explosion of sensitive inlernaJ process 
idcntificaiion data In the example cited, the rcduccdnirdcr 
miHlel has only 3 parameters compared to K of the onginal 
process It has been illustrated that the inclusion of a 
deadtime in the model may be sufiicieni to compensate for 
the grovs misrepresentation of the prtKcss order TTiis 
augments the technique of data filtering (Wahiberg and 
Ljung, 1986) to improve the estimation accuracy near the 
critical frequencies for closed-loop stability. Thus, the 
problem of mismodelling which Bristol highlighted becomes 
much less sigriificani. 

TTic results have direct relevance and application in the 
area of auto-tuning and self-tuning control. TTiis is because 
(he nHidcllmg structure (hat was employed in the simulation 
studies LS equivalent to that used for auio-iunmg and 
self-tuning, as both essentially make use of opcn-lmip 
identification. 

The mam conclusions can be summarized a.t follows: 

(a) Bnslol s results based on step-response matching could 
not be generalized Frequency resfKinse matching near the 
critical frequcncic.s should instead be used to judge the 
adequacy of reduced order modelling 

(b) Reduced order modelling with deadtime can cornfxns 
ate for the phase lag disparity between the prixcss and 
model T his suiiahly augmenl.s the technique r>l data filtering 
to ensure that the estimated model could be an adequate 
basis for the piirjH>se of controller design 
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A Sensitivity Approach to Optimal Spline 
Robot Trajectories* 

A DE LUCA.tt L LANARIt and G. ORIOLOt 


hey Words—kuhois; spimesi, optimization; rumliiirar prA>grammiiij|{. scnsiitivity iiniit>‘^i»i; ir«jct*iory 
planning 


Abstmcl—A robot trajectory planning problem is con- 
^ickrcd Using smixith trucrpt>lating cubic splines as joint 
space trajectories, the path is parameterized in terms ol time 
intcrvaK between knots A minimum lime aptimizaiion 
problem is fomiulalcd under maximum torque and veliKity 
constraints. Sid is solved by means of a first order 
derivative-type algorithm for semi-infinite nonlinear pro¬ 
gramming. Feasible directions in the parameter space arc 
generated using sensitivity cocfificicnts ol the active 
constraints. Numerical simulations arc reported for a 
iwo-lmk Scara robot Ilie proposed approach can Ik used for 
optimizing more general objective functions under different 
types of constraints 

lnintducHi)n 

OniMAi TRAMf'TDRv planning may considerably improve 
robot performance in industrial applications, particularly 
when pnKiuctivity rale or energy consumption arc of primnrv 
concern In order lo provide true optimal motion under 
actuator limitations, Ihc full nonlinear mampulalor dynamics 
has to be explicitly con.sidcred in the trajectory planning 
phase Tbe interactions l>ciwccn gcomcinc, kmcmaiic and 
dynamic issues .substantially increase problem complexity 
with respect to purely kinematic approaches 

Specific classes of optimal rofnit motion planning problems 
have been recently solved, with minimum lime as objective 
and torque limits as constraints When the task is a 
point-to point motion, a number of numerical approaches 
arc available to minimize the traveling lime, e g a modified 
gradient-iypc algorithm (Wcinrch and Hryson. the 

multipIc-shiKiling technique for nonlinear TPB\'P (Geenng 
el at.. IWb), and a dynamic programming scheme (Sahar and 
Hollcrbach, 19K6) All the above solution methods arc 
computationally intensive Moreover, Ihc introduction of 
slate constraints—like joint limits or maximum vcIcKity 
bound.v—brings in additional complexity. In any ca.se, the 
mam limitation of point-to-poini motion planning is the 
unpredictability of the obtained path, which can be 
dangerous in presence of obstacles 

Alternatively, the robot may be required lo follow a sale 
prcspccificd gcomcinc path joining the initial to the final 

• Received 24 February 19H9; revised 1(1 July 199(1. 
received in final form 25 August 1990. The original version of 
this paper was presented at the I FAC' Symp^-Miium on Robot 
Uontrol (SYRCXX) 'HH) which was held in Karlsruhe, 
Germany dunng October 19H8. 7'hc published proceedings of 
this IF AC Meeting may be ordered from: Pergamon Press 
pic, Ficadingion Hill Hall, Oxford 0X3 OBW, U K lliis 
paper was recommended for pubiK'ation m revised form by 
Associate Editor R, V Patel under the direction of bA.1iior 
H Kwakernaak. 

t Dipartimcnto di Informaiica c Sisicmistica, Univenii^ 
degli Studi di Roma “La SapienzaVia Eudemtana 18, 
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poinl, either m joinl or m cartesian space Asauming that a 
continuous parameicnzaiion can be given for the whole path, 
Bobrow ri at. (198.*>) and Shin and McKay (198.5) have 
denved an efhcicni solution algorithm for the minimum time 
problem, dircclly working in the parameter phase-plane It 
should be emphasized that the effkirncy of their algoiithm 
strongly relies on the particular form of (he cost cnlcrion 
Also, the a pnon specification of an overall geometric path 
and Its c^mtinuous paramctenzation are requirements which 
may be too restnclivc or cuml>coiomc ho real applications 

Most commonly, the imk planner provides the trufertorv 
planner with a robotic task dcKTipiion which is iniermcdialc 
between Ihc above iwti Es|ircially in complex environments, 
Ihc typical output ol the task plannei is a sequence of 
cartesian pi>ses (i r positions and orientations) for the 
end-cflee.tor. which have to be interpolated In pnnapit. 
inicrmcdialc poses arc not resincicd, but a safe overall path 
can t>c guaranteed by increasing the number of specified 
poses in proximity of obstacles llic problem laced here is 
how the trajectory planner can perform this inicr)x>laiton in 
an ophmal way The class of mirrpolaling functions should 
be chosen .so to give nice snuMiihncss properties, thus 
avoiding excitation of the mechanical siniclure. together with 
a low curvature profile 

The most appealing class of lunclions for generating 
robotic paths that satisfy the alxivc specific a lions arc spline 
funciions. which are piecewise cubic polynomials nmosilhly 
micrpAilaiing a sequence of knots (dc Bemr, 1978) Splines 
with amlinuous second derivative (f'^ splines) have been 
widely used in roboiK applications, c.g. to obtain mminiuiii 
time trajectories under purely kinematic consirainis fijn ef 
at . 1983) The mmimizaiion algorithm was the Nclder 
Mead flexible jmlyhcdron search. Ixring based only on 
function cvaluatioiu, it has slow convergence and may stop 
in false constrained minima Hobrow (I9HH) used f ' splines 
for approximating jH>inl-lo-poinl minimum time paths in 
presence of obstacles 

In this paper, a new method is presented for planning 
smcRith optimal robot trajectories interpolating a given 
sequence of points. 7Tic trajectory u a f'^-splinc passing 
through n knots, with boundary umdiiions on initial and final 
velocity ITic n - 1 time inlcrvaU between the knots uniquely 
parameterize the path A minimum time problem will be 
considered here, with both maximum torque and velocity 
limits It turns out to be an optimization problem wilh 
infinite-dimensional constraints, which is solved via an 
eflicicnt algorithm proposed by Gonzaga ri at. (19W)). lliis 
requires computation of the gradients of the active 
constraints, namely the sensitivity functions of the constraints 
with respect to variations of the design parameters. As an 
intermediate step, it is necessary to compute the sensitivity of 
the spline functions, which has iu own interest and may be 
rclevanl also for other applications 

It must be stressed that the approach proposed here is 
conceptually different from the most amnmon one, that 
would require fini to build a spline interpolating Ihc knots, 
and thm find the optimal lime history on this assigned path, 
using the algorithm of Bobrow et al (1985) In fact, the 
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fulhminK iiikpcL'U chiiracierL/c (he prcM^/K meth«jd 

• Hic (liAcrett par'iimc(cri/;ilii»n allows duc to handle any 
cml funcinm of interest (e.g. energy con^umptHinj, while 
well csiubli5»hed exaft Mduiionn cxi»( only in the minimum 
(jme chm: ; 

> Since the in(crp<»laimg upline a (unction of lime intervals 
between knot%, the resulting cartesian path changes 
throughout the opiimi/ation proccs^s, possibly yielding a 
shorter (inal (raveling time than the one achievable on (he 
’first guess” path; 

• Veliiciiy Ixiunds arc exphcilly considered, moreover. 
snuMilhricss up to iht? second derivative is guaranteed, 
avoiding torque discontinuities 

After restating the esfiential steps lor the generation ol an 
mterpiluting spline tra|cctory. the minimum lime problem is 
formulated as a semhinfiriile nonlinear programming 
problem and solved by the algorithm of (inn/aga et a/ 
(IMHO) lo this goal, the sensitivity analysis of spline and 
torque functions with respect to time intervals will be 
derived. Numerical results obtained tor two planar robot 
arms arc presented In the conclusions, some possible 
extensions of the proposed approach are outlined 


Splsnr tru/n rorv generrinon 

For a robot with A joints, let the task be assigned by a 
sequence of n cartesian ptises /*,, to be assumed 

by the encl-eficcior at unsfHrcilicd time insianls /,. . t„ 

Initial and finul cartesian veicHrities are given Using inverse 
kinematics, these diila arc transformed into joini conligura- 

tioris .. and into initial and final joint 

velocities and r,,,, with / I. . A Uct /i, t,, i - t,, 
I - I. , /I 1, Ik the lime intervals iK-twccn knots, and 
h |h,. . ,/i,, ,1' For a generic joint /. a trajectory is 

ohtaincd hv interf^^ilatiori using a r*-spline C^(^l. 

piecewise cubic polynomial Denote by ru,, the value of the 
;lh joint iicceleraiion ai the Mh knot F.ach of the n - I cubics 
constituting the spline can Ik written in terms of the 
(l.in ft ai . 1) as 




(/( M 0 

b/i^ 


if f, 

(l/l 




h, 



it M ^ 


ff. 


h,(i> 

/ iU 


where ,i| Spline veloeilv and aceclcraiion 

(),(r) are piecewise qiiiulraiic anti linear functions, 
respccnvclv Ihc conimuiiv rcquireineni for the acceleration 
at the inlernal km^is is automaticallv satisfied, since 
Q /1 l(^) ((*() “^( f oven a liming lor the trajectory 

(i e a vector h), the micrpoLiting spline is completely 
sfKcilled by (I) once knots accelerations are computed 
Denoting by U, the vectoi of knots aeceleraiions for the ^ih 
joint, and im|>osmg the eonlinuilv lor vehniiies ai the 
internal knots ;is well as boundary conditions, for each joint 
u tridiugonal linear system is derived in the form 


AD, -h,. ;-l. , ,V, C) 

where 
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-2i,, 

h, 2(A,4A,) 
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For k >9, matnx A is diagonally dominant and the sedutioo 
of f2j ix unique and continuous in the clemcniB of k. Note 
that A Ls the same for all joints. Solution of (2| is 
cfliacnily obtained without the need of pivoting by the 
following Gamuv-type algorithm (Slocr and Bulirsch. 1^1): 


i w " I. , . . . 1. (3) 


with 




AT,-' . a:.- .^ 

“ll lO. . 
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where a^j, arc the elements of A. and of b^. 

For any choice of parameter vector h. a unique spline 
h) is built for each joint, forming a vector function 
Qit, h) It should be nuted (hat changing one or more of the 
parameters A, will modify the whole interptilating spline Tins 
IS true unless a uniform scaling is performed on aJ/ the 
components of h (Hollcrbach. 1^84) 


7'hf optimizanon problem 

Fach spline trajectory Q^ii, h) is paramclen/ed in terms of 
vector h 'Die optimal value of ihis vector can be determined 
according lo a specified criterion and subject to proper 
constraints. If a minimum time problem is considered, typical 
constraints arc symmetric velocity and torque limits for each 
joint, V] and U, respectively Some |Kculiar features of the 
problem are cxploilcd to obtain a eompuct formulaiion 

Velocity i(>n,sfniir\ts Since spline veliK'itv is a piecewise 
quadratic function, its maximum value in any subinterval is 
iiltained cither at the knot instants r,, or at ime 

intermediate instant t* c It,. t, ul v^here h) I) riiis 

4cro-acccleralion instant exists iff b holds, in 

which case t* - i, -f ^, ,) and 




' (ttr 




Torque constraints The maximum torque value can he 
attained uns^vhere along the spline trajecttirv; this constraint 
should he checked m all path founts using robot dynamics 


u(t) = IVI(q(/)(q(r) 4 c(q(f), q(r)) 4 e(q(r)), (6) 


where qc R^ arc the joint ctmrdmaies. b arc the actuator 
torques. M is the inertia matrix, c are the C nriolis and 
centrifugal forces, and e is the gravity term The torque 
u,(r. h) arising at joint ; during motion along a spline 
trajectory is obtained by setting in (b) q(0 - 0(r b), 
together with its time derivatives. 

Time interval corvitraints. Since parameterized splines arc 
defined only for h "O, this constraint should he included m 
the optimization problem The strict positivity requirement 
can be replaced by a lower fH>uniJ derived from velocity 
limits In fact, since Iq,, , i - tnusl hold on any 

subinterviil. h should satisfy the ci^nslraint 


/i, :.r k; • U where 




max 

,V 




/ - I. . n - 1 

A.S a result, the following optimization problem is 
formulated; 

M t 

min V h, 

j 

S t h)| v; (i - 1, . . . n), 

(j-l.n-D. 

max b)|( U,. / ^ I, . S',. 

m~k^9, 

This problem is an instance of the .semiinfinite nonlinear 
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prof^nunming class 
mill/(h) 

i t *'(k)sO. (1, , p, 

mai h)^0. / a I. . r. 

T H 7 

where h € R" ' is the vcclor ol design parameicrs,, g' are 
convcntiofuil constraints (vckxity constraints plus lower 
bounds an h). while functional (mlinitc-dimcnsKmall 
constraints arc represented through the (torque 

ctmslraints) The ^main T over which the funckK>nal 
constraints have to be Mitisticd is |/,.r„| In the rrimimum 
time problem,/(h) and g^h) are continuously differentiable. 
^(t, hi arc continuous in both argumenis. while giadicnis 
V^^(T, h) arc continuous w r t. h. 

For this class of problems. Gon/aga n ai have 

developed an cfficicni solution algorithm which is a 
combined phase l-phasc 11 methixl of feasible directions. 
The method dcscs not require an admissible starting point, 
and recovers feasibility in a bniie number of iterations, 
already considering the objective function at this stage. At 
each iteration, a low-dimcnsional quadratic progrummmg 
(OP) subproblcm is solved In generate a search direction il in 
the space of parameters h. Directional denvalivcs of the 
objective function and of the #-active (i c active or almost 
active) constraints are needed in ihi.s (.)P The algorithm uses 
a proper diMTctiration of the fuiiciional consirainis, 
replacing the Ciintinuous domain / with a sci 7, of mrih 
insianLs 'Dus discrciization must t>c tailored to the problem 
at hand Since T i.s itself a function of the current h. an 
adaptive strategy is devised to discrcii/e 7 inio 7’ At 
iteration q. the following set of mesh jvnnts is u.ved 

7'!'''= (f|:'I'!i' 

m - 1). 1. , V. I 1. . n 1 ) (7) 

where ( 1 ^ - m/.V <F |l), 1| In this way. each suhinierv.il 
|r,.r, ,,| is uniformly s<impled and the knots aie alwav 
included in the disercii/ation 

Setutiivity analvsL^ 

F'or the soluiion of the minimum lime problem, the 
following directional derivatives arc needed by (he Cion/aga 
rf al (1VHO) algorithm 

(r/(hi,d) - V 

I 1 

(Vg'fh), d) -- i V , wiih T ^ I, or r*. 

\,'L9u,(r. h| 

(r. b). d) - ± with r (K) 

A - i 


In (H). the evaluation of spline (namely (,1^. 
sensitivity wirh re.spcct to changes of the generic time interval 
is required. As a first step, the sensitivity of the solution to 
(2) (i.c of knots accelerations w- r !. variations o\ has 
to be derived. Since 


A(h) 


dh. 


3A(h\ 

3hi 3h^ ' 


the sensitivity BQJShi, is the .solution of u linear system 
having the same thdiagonal cticfficicni matrix as in (2) with 
con,siani bj*' in place of b^. Ilius, it can be found using again 
the recursive algonlhm (3) Lotting , these 

are obtained as 


dij*’~ AVijjVi 1- i = , 1. 


with 


0|| “m - A. l". . I 

The elements o( vcclor y*’ arc 

bj,*' = (), , = 1__ * - I, A + 2, . n. 


"/.A * I 




£(k} 

k . I 


* I 

W; *. 1 . 




A more expbcii treatment t)f the above exprcswutrns is 
pursued in (r>c loica ft al, \^) flic above analysis is uicd 
to compute the seniwtivny of the /lb (/ «» K . spUrse (I) 
at A gtncnc mci^h point r^ (r L . n l,m * U. , r) 
which IS 




1(1 

ur;“4 


(1 

- rt., ,1(1 

^ ill"', 

. 1 - 

(1 

1. l>rmg 

ihc Kronecker 


Similarly, the velocity sensitivity at is 




, (1 . rut,, 

' '> 


h 


while at the zcTO-acceleraiion mslanis one has 


Jh, ' 


. <‘l 

2(l/>, "^rl" 




I % «/m ■ 1 ' */;- 

(^ ^ h: 


I . I “V) I 

I inally, the sensitivity ol spline at^cleraiion is simply 




(Ml- 


Ihcsc quantities entci directly miii the .st'iisitiviiy of (he 
functional constraints 


V / V ^ >>Ci 

5A." ,r.' .'r, t>c>, Oh, ah, 

*■, aQ, ^ at, aQ, ^ at, aQ, 
* OQ, ah, aOi aQ, ah 


'). <•*) 
A ' 


where rttf,, and r arc the clemcniv of M. c and c in (6) 
Note ihm in fV) licnvalivcs of the dynamic mcKlcl terms 
w r I. joint positions and vcIochick appear. These depend on 
the specific robot arm and can be computed automatically 
using symbolic manipulation languages (Neuman and 
Murray, 1984). 

Numrrtcal rrsuks 

The proptjscd approach has been used to generate 
minimum time vmcKith spline trajectohci for two different 
two-link SC’ARA-iypc robots Programs were written in 
Fortran 77 on an Al personal computer and. at each 
Iteration, the routine h()4NAF erf the NAG Workstation 
Library was u.scd In solve the quadratic programming 
subprfrbicm which prrrvidcs the search direction The 
dynamic mcKlel fh| of both arms lakes on the explicit form 

u, ^ (/7, + 2/7; cos Qiiqi ^ (//^ 4 Hy cos 
- + </5)Mn</2 

uy ^ (77, 4 Hy COS i/;)<7, 4 Hyijy 4 Hy^] Sin q , , 
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Tabu I pARAMtn of 1F^^ robots usi d in tui lkampu s 

/, /. dj m2 y, J. 

(m) (m) (m) (kg) (kg) (kgm ) (kg nr) (kgm") 

Example I (J.5 0 .*5 i) V> 1 0 0 (W4 0 l>H4 0 

fixampk 2 0.4 0 2.^ 0 125 15 6 16 0..^ 0.01 


with 

//, - y, ^ J2 Jf, ^ rrtjli T m/l] T 

tl, F . //^ y, ^ y,, + 

Nt»tc (hat r(q)^ 0 hinct the motion in constrained on a 
hori/xmlal plane. In the alx^vc cc|Uu(ioris /, and 

y, (i < 1, 2) are (he mass, length and moment ol inertia w.r ( 
the axis of (he driving |nint lor link t. while and y,, are (he 
ma.sA and ceniroidal inertia of (he payload. AKo. dj is (he 
dixtarice between (he axis of the second joint and the center 
of ma.sM of the second link 

As a first example, a very light robot arm has fH*eii 
considered, whose parameters arc rcfHirted in Table 1 T1ic 
limit values arc V\ - V, - 2rnd w:c ' for the joint velocity, 
(/, ‘Z- 7, U, 2 Nm ftn the torques TTir robot task requires 
the arm to move along a C' spline irujcciory passing through 
a sequence of six joint knots (in rads) (q,) - 
(U. 0,5. 0.75. I. 1.25. 1.5}, (q,,) - (0. -0.5, I. 15. 1. 

0.5}, with /CTO initial and rinul velocity The chosen initial 
design puiametcr is h " (1,0,5, 0 .5. 0 5, 0 5| V so that 
t„ Vsec On the reHultmg spline, velocity and torque of the 
Kccorul joint are Ixith unfeasible, rciichmg the values of 
4 rad sec ' and 2 7 Nin f igures I ^ refer to the optimal 
solution found after 40 iterations. Ihe optimal design 
parameter vector is h* (0 37,0 2V 0 34.0 43, 1 (I7|^, from 
which r2 2.4b see fioth torques are saturated at the initial 
instant, while the .second joint vehxMly saturates twice, near 
the second and fourth trajectory kruits 

T*hc obtained results deserve some comments It is known 
that the minimum lime torque profile along a paramctcn/cd 
trajectory i,s such that at each instant at least one actuator 
provides its maximum liirque (Hobrow rt ul . I0K5) The 


I 


Fu. I Example 1. Optimal solution: position 


; 




FKi 3 F\xample 1 Optimal solution torque 


icuvon lor the absence of these saturated “(lal tops ” in the 
obtained profiles iv twofold First, the presence of vclcKrity 
iHiunds prevents the torques from reaching their maximum 
values Second, the requirement of a continuous acceleration 
excludes a bang hang form for the torques 

As a second example, a planar motion of an IBM 7S3*' 
robot has been considered Its parameters are shown in 
Table 1. while Ihe bounds are F, ■ - I rad sec *. and 

fy, 9, tA ' 25 Nm ITic task is spcciiicd by a different 
sequence of six knots in the |oiru space (q,) {qj 
{0 1.0 2, (I 25, 0 .1. 0.35. 0 4} (rads), again with zero initial 
and final velocity The initial design parameter is 

h “• |0 3. 0 3, (1.3,1) 3.0 3]^. adding up to - 1 5 sec Ibe 

joint torques on the corresponding path arc unfeasible, 
leaching the values ol 45 nNm for the first joint and 
~12.2Nm for the .second Feasibility is recovered after 5 
itcru(ion.s, wiih - 131 sec Note that feasibility is 
recovered with a lower value of the objective fiinciion. as a 
result of Ihe combined phase 1 -phase II algorithm Figures 
4 6 refer to the solution found after iicratiims The 

optimal dc.sign parameter is h’ - |0 29, 0 (17, 007, 0 (W, 
(I 2 V, giving a traveling time r’ - 1) 71 sec 

It IS intcrcsiing to note that the obtained torques 
approximate a hang-hang behavior, although such a profile is 
out.Mdc the -class. Two intermediate time intervals (i.e 6 , 
and h^) are in fact brought clove- to zero, while saturated 
torques arc obtained in the first and in (he last two intervals 
ITicsc torque solutions arc allowed since there is no vekxiiy 
saturation in this case. If acceleration continuity is relaxed on 
our final path, the algorithm of Shin and McKay (19K5) can 
fH- applied to obtain a lower minimum lime wilution 



fT<i 2 Example I Optimal solution: vcUxTly Kio 4, Example 2 Optimal solution; position 
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Fit I ^ F’Kamplc 2 Opiinml snluiiun vcUk iiv 


l it. 6, Lxaiiipic 2 Oplimal sululmn. itirquc 

However. omIv a ntpligihic irnprovcnicni is gamed wiih 
rcsp<*cl to ihe profioscd method, since /* 0 7(17 see resullN 

Other simulations, together with further details on the 
opiimi/ation algorithm, arc reported m l)c l,uca tf ul 


C on< /u-sron.i 

A new method has Ixeri presented lor rninimi/mp a 
general ob|cctivc lunetion along a spline trajcclor) under 
kinematic and dynamic eonsirainis In pariieuhir. minimi/a 
tion of the total traveling time along a path sp<.*eified hy a 
sequence of knots has been considered f he pt'cuhariiy ol 
the propi»sed approach stands m the following aspects (i) the 
problem is paramctcri/.ed by .i linite iiumfHrr o( variables (i c 
the lime intervals between the knots), thus alhiwmg the use 
of an eflicicnl ntmlinear programming algtmlhm. (ii) generjil 
constraints on the rob<M state can be included directly in the 
formulation, (iii) the optmii/alion is performed over the class 
of ( ^ splines, thus ensuring smiKilh generated trajectories, 
which arc graceful for the nicchamcal siructiire id the rof>ot 
llic inclusion of ci.>nstrainis on both vchKity and torque, 
together with the continuity requirement assumed for the 
trajectory acceleration, produces interesting minimum time 
torque profiles 

lilt* numerical optimization algorithm used is very robust 
and eflicicnl. being based on gradient infoimalion ITie 
sensitivity of the spline with respect to changes of the time 


intervaU bciwcen the knots has been cKpliciily (knved. The 
oNaiiicd expressions am prove useful lUso in purely 
kinematic apprxvaches to rolxn trajectory planning, as well m 
in othei applK'aturns 

Vse of the prtipswed mciluHl in opiimtEaiion protilcms with 
more general tshjeciivc functions under dillcrciu types of 
amstramls, hie veUKity depemlent lormie bt>und* or joint 
limits, requires only little addiUonal ctimpkiuty 
Nondiffereniiahlc functions may alw> be treated, folhiwing 
the theoretical developments of the same huiuc algonlhm ai 
presented in iPolak ri u/ . IVH,l) This is of iruerrsl for 
tackling folxii imjeciory planning problems in the piesence 
o( obsiades. where nondiftereniifthle dustanev fuiKtk>ns come 
into play (C'olhefi and JohnsAin. IWS) 
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An Algorithm for the Assignment of System 

Zeros* 

W. A. BERGER.+ R. J PERRYt and H. H SUNS 

Key Woed»- 1 linear systems, icros 


AhrtnNrI—This paper presents an algorithm for assigning the 
kKTations and number of 2 :cros to a linear system through 
synthesis of the system input and output space couplings. 
The approach imposes no rcstnctioiis on the state-space 
miKJel. can assign both real and complex zeros using only 
real arithmetic, and is computationally cfheieni Numerical 
properties of the algorithm arc disc'ussed and examples are 
given to illustrate its performance 

1 . fntroductum 

An iMfDRlAsn topic in the synthesis of muliiviiriahlc systems 
IS the problem of obtaining a system having the desired 
properties, i e the outputs rcs|X)nd in a desirable manner to 
reference inputs (Fallsidc, 1977, Patel and Munro. 1982. 
Ohm ri al , 1985) ITie concepts of eigenvalues and zeros 
(Macfarlanc and Karcanias, 1976, Kouvnntaki.s and 
Miicf arlane. I‘f76) form a natural link iHMwceii frequency 
c ponse and slate-space approaches, and ihcir l(H:alions in 
ihc complex plane can be interpreted in terms of geometrical 
relationships involving the system (A. B. C, D}. 

The eigenvalues and zeros of a system arc values that 
completely specify the system restxmsc The field ol 
eigenvalue assignment by siale variable feedback has been 
well dcveloficcl, and a number of numerically reliable 
Milutions are available (Patel and Misra. I9H4, Kautsky ef al . 
1985, Mirnmis and Paige, 1988, Pclkov e( al , I9H6) Hie 
approach of Pclkov has been proven to be numerically stable 
(Cox and Moss, 1989). It is assumed here that the system 
under consideration already has all of its eigenvalues ui 
desired liKations. 

The zeros rcprcsenl Ihc nature of the couplings between 
the system's characlcnslics modes and its environment They 
depend on the matrices B and C' and on the way in which 
these matrices are rclaicd to the cigenframework of the 
matrix A. Hy suitable variation of the null space of C and the 
range of B. i c suitable choices of input and output 
couplings, zeros can be placed at any possible locations in the 
complex plane (MacF-arlanc and Karcanias. 1976) In terms 
of system rcsp<)nM.‘. the concept of zeros is miimatcly related 
to the physical situation in which the system has an 
identically zero output while the states and inputs arc not 
themselves identically zero 
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Dunng the past decade consider able attentnm has been 
paid to the computHtion of the zeros and especially to the 
devek>pmeni of reliable numcncal software (Ijiub and 
Moore 1978; Emami-Nacim and VanD«H»rcn, 19K2a.b; 
Ijiub. 19H5) for this pitibicm. llic problem of aaiugnmeni of 
system zeros has been addressed in Ihc lileralure 
(Kouvariiaki.^ and MaeFarlane. 1976; Sadeghi ft at . 1986; 
Bhailttchaiyyii rr al., 1986; Perry n al . 1986, 1988), 

however, these approache.s arc numerically uimable in 
general due to their use of ill-conditioned transformations. 

'Ilus paper considers assigning u pfCM.Tihrd set of element 
zeros to a linear system described hy a slate space motkl 
(A.B.C.O), where the system internal dynamics A are 
given and the external inpui-outpui couplings |B.C',D) are 

10 be synihe.sizcd In particular, we present an algorithm for 
assigning the values and the number of finite zeros axiwKtaled 
with an individual transfer function between any input and 
output through synthesis of rhe output space maj^ping. ITiis 
new' Mlgonlhm is a key part ol a method lor complete 
a.ssignmeni of a mulii input multi-output system polc^zero 
configuralion (Berger. 1988), where the problem of zero 
as.signmeni is first reduced to a sequence of one or m'prc 
suhproblcms involving Ihc individual elements of the tranafer 
function matrix 

The H.ssignmcni problem can be formulated in a similar 
manner in terms of multivariable transmission zeros and will 
\yc presented in another paper. A meibixl was preio^nied 
(Misra and Patel. 19HH) for irarisiTii.sKion zero assignment 
using only Icedihrough C4>mpcnsaimn D. whereas in our 
approach boih the output coupling C and feedthrough term 
U arc being synihcsi/cd 

11 A iMtf^nmrnt of xyMfrn i rros 

('onsider lire stale-space model of a linear lime-invariant 
system 

A« ■* Ax ^ B« 

y-Ci^Da *** 

where 1 IS an n-dimensional vector of system states, « is an 
m-dimcnsional vector of system inputs, y is a p-dimcnsional 
vector of system outputs, and where A can be the differential 
or the delay operator A, B and C are constant czsefhcient 
matnees and D represents some direct "nondynamical" 
coupling between input and output. 

In general, the Transfer Function Matrix H(A) is a 
p, m-matrix of individual tran-sfer functions in the form: 

fi (A - 4"') 

H„rA) - c;(AI - \) 'b, + ..- (2) 

II (A-p*) 

*• I 

representing the transfer function between input / and output 
I, where c,^ is the ith row of C. and is the jih column of B 
This form shows the poles and zeros before any pole-zxro 
cancellation has been taken into account, 'fhe system poles, 
are the eigenvalues of A Each transfer function has a 
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Hatn raci(:>r tind term which arc the finite zeros uf 
the Jiyiicm matrix, the (n f 1), (n -f 1) pencil. 


S,(A) - 


Af •' A 

.. c/ 



(3) 


1lic problem conxickred here ik to chtHMie d,^ and the input 
and (lulpui coupling vccKm’k b. and c/ *iuch that the rctiultin|; 
clotcd-lcHip tranKfer function has a prcxcnkicd set of finite 
zeros Axiuming that a Nuitabic value of i.s given, such that 
the pair (A. b) is controllable, the following algorithm can be 
used to determine c,' and d,^. By duality, c/ could bc‘ given, 
and a dual form of the following algorithm, using (A',rj in 
place of (A,b^), u.sed to determine the input mapfiing b^ 

We now present an algorithm which, given A, b, a 
prescribed gain (V and a set of finite zeros, z*. k -- I - 
determines values for c' and d ITic assignment ol /cri>s is 
achieved m two steps; a Kcdutiion Algorithm and an 
Assignment Algorithm, llic Reduction Algorithm proceeds 
by reducing the system matrix to u finite structure pencil 
(Kailath, 19H(I) of size (/ f I), (/ + I) llicn, the problem is 
reduced to an eigenvalue assignment problem which is solved 
using an existing numerically reliable method (Patel and 
Mixra, l*ifH4) based on the implicitly shihcd OH algorithm. 
Finally, the Assignment Algorithm transforms the computed 
results back lo the original coordinate .system 


Heduititm alfzonihm The system matrix (A) is reduced to 
size (/ f 0, (/ + I) as follows; 

(liven; llic system state matrix A and an input vector b 
Compute ‘Phe reduction of the system matrix (3) to a linitc 
structure pencil of size (/ + 1). (/ ^ 1), where I i.s the number 
of zeros to be assigned 
Step 1. Initialize 

F-A, g* b, 

I, IJ- I„ .,. n 


Strp 2. (’heck reduced .system size 
If r; i, Slop 
Reduction is completed. 

Step 3. Use a Householder Iransrormaiion Q such that Q'g 
is reduced to ||g||« where e,, is the last column ot 


O'FO U» U 

f/ ♦- fj 1 


Q 

0 


(folo Step 2. 

lilt similariiy irunsformalion using U does not change the 
trnn.sfer function, but ii reduces the cflect of g into a .scalar 
Hill? multiplied by u unit vector, which can be accumulated 
and saved for future use as n gain factor 

At each iteration of Step 3. ¥ and g arc reduced in size by 
I and the la.sl row of Q'lQ is discarded. The cumulative 
cUcci of the reduction prtKcss is saved m the parameter /f 
and the n, n orthogonal (ransformiition matrix V 
It can be .shown that the reduced system. (F. g. v'.rO> 
where v' and p are as yet unknown, will have the same finite 
zeros as the system (A.b.c'.b} 'Phis can Ih* demonstrated 
by examining the effect of the first iteration of Step 3 on the 
system matrix (.3). 


fQ' 

0 ] Al-A b 

ro "1 

1 0 

ill c' 0 

.0 ij 


lAI-Q'AQ ||b||,.,| 

I -c'Q <1 I 

llic nght-hand side of (4) can then be transformed by 
unimodular row and column transformations L(A) and R(A) 
to 


L(A)0(A)R(A) 


V I U 
v' p U 
(I 0 I 


(5) 


Equatiom (4) and (5) illustrate that Ihe assigned zeros are 


invariant to transformatKins uf the reduced system back to 
the onginal physical coordinates For the above Reduction 
Algorithm, the form of the unimodular matrices MA) and 
R(A) can be expltcitly denved; L(A) interchanges the last two 
rows of Ilf A), and R(A) divides the last column of il(A) by 
llbjfj and reduces the last row to |0 0 ]|. It should be 

clear that the actual algonlhm d4>es not use LfA) and R(A1, 
which are not in general orthogonal transformations 
ITicrcforc, by inductuin, each iteration of Step 3 yields a 
reduced system with the same finite zeros 
The next step in the generation of the system output 
mapping is the a.s.signmcnl of the desired finite zeros. 'The 
zeros of the reduced system arc known to be the eigenvalues 
ol F~g(v'//J). where v' and p arc as yet unknown 
Reformulating this expression as F-gb', the problem of 
assigning zeros is reduced to an eigenvalue assignment 
problem for which a ginxl numerical method cxist.s (Patel 
and Misra, 1984) The inputs to this algorithm arc the set of 
desired finite zeros, k - \ / (tniih real and complex- 

conjugate pairs, arranged consecutively) and the reduced 
|>air (F. |) On the output, the gain vector k is obtained such 
that F -gk' has all the desired eigenvalues, i e finite zeros 
of the system matrix. It is worth to point out that there is no 
numerical difficulty with the division by f) in the term v'//i 
since the term is l>cing determined as u whole. Once k is 
determined, wt: can transform the rcsull back to the original 
coordinate system and find c' and d using IJ 

Assijznment alfptnthm 

(oven F, g, fi, U from the Reduction Algorithm, a 
pre.scribed gain (i and desired zeros, z^. k ~ I / 

Compute k and the vaiucs for c and d. such thai the system 
|A.b,c*, d} has the desired set of zeros 
( me I. / - 0; 

li -I). c' - ^j|l I) ■ • l»|ll' 

( me 2. I ^ () Use a numerically robust meth(»d such as Patel 
and Misra (19K4) to determine k such that the eigenvalues ol 
F - |k' are equal lo the desired zeros, A - I / 

( Var 2a. / - n 

rf-f;, c' - (.h'l)' - (.fc' («in<rlJ' «IJ 
( me 2h. 0 ■ I * n: 

d - 0, c' = *'|k' 10 0|ll' 

P 

Ihc parameter represents the contribution ot the vector b 
in the system gain factor (/’ of (2). llic multiplication by the 
scale (actor (i/^ in the assignment algorithm cancels the 
contribution of b and produces the desired gam factor G 
Note that m eases 1 and 2b the number of trailing zeros 
involved in the formulas for c* is equal to n ~i.c the 
number of zeros at inlinity. 

Ilf. \urnen('ii/ properties of the alf^orithm 
Ihc algorithm is computationally efficient and we have 
reasons lo believe that it has gixnf numerical properties since 
only orthogonal transformations arc used throughout the 
algorithm, as well a.s throughout the .solution of the 
eigenvalue assignment problem 

The solution to Ihc assignmcnl problem involves finding an 
orthogonal matnx N and a state feedback gam row vector k 
such that N’(F" gk*)N is m Real Schur Form with the 
desired zeros along the diagonal. The algorithm (Patel and 
Mi.sra. 1984) enables assignment of real as well a.s 
aimplex~a>njugate pairs of zeros using only real arithmetic. 

The computational work is divided between the reduction 
algonthm and the assignment algonlhm depending on how 
many zeros arc being assigned. For example, if n zeros arc 
being assigned, the reduction step is not performed and the 
assignment algorithm is apiplicd lo a n, n system. At the 
other extreme, if the number of desired zeros is 0, the 
assignment algorithm is run performed and the reduction 
algorithm proceeds through n iterations. At each iteration. 
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ibc system size is reduced and thus the sue ot the 
trans/armaiion matrices and the number of compulations 
performed are reduced. This is a numcrioilly advantageous 
feature of both our reduction algorithm and the asstgnment 
algonihm (Paiel and Misra« 19H4) 

A Householder transformation acting on a i, r matrix 
rc 4 ]uircs 2si operations (Wilkinson, 1%5). Thus, step 3 of our 
Heductioa Algorithm requires 2t) operationA to compute fi 
and the Householder transformation, iff’ operations to 
update ¥, and 2rfn operations to update U llic total numbei 
of operaiiom required to reduce the system matnx 
(limcmuon by (n - f) is 0(n' - I*), and is equal lo 

n(n -f \)\{n + 1)4 2(2n + l)/31 

-/(/+ l)((n 4 1) 4 2(2; 4 |)/31. 

ComiHJialion of the gain vector k requires 0(/\) operations 
(Patel and Misra. 1984) and cxcculion of our Assignment 
Algtinlhm requires n(/+l) operaiKins. f*he complete 
reduction and assignment process therefore requires a grand 
total of f>(n\) operations. 


Exampk 2 Hus* example illusiraies the numerical atxuracy 
of out algorithm In the system of Example I, has zeros 
(19/9, “-I, ' 2, -3), and gain lacloi f»,, ^ 9 Ijc\ Ii equal the 
hrsi column of it and let the desired irros and gain factor be 
the same as those <*f ApplicatKin of the reduction and 
uaaignmenl algorithms tlntuld yield c‘ equal lo row t of C 
1 C cf Hie capiNCted and ct>mputed results arc 

0 (I OtMMNXMltllMkMKMH) 

- 1 I (XJOtMlll(ICtUK)tN)l 

2 2illlOfMgKMKk)rilMt(IO 

1 I (aitMICMWMMN)IKMm2 

1 

Exantftlr ^ This example will illuhlrutc the numerical 
accuracy of the methcxl presented heir in coninist to the 
results obtained using a methfHl hase<l on non "orthogonal 
similiinty transformations and reduction to phase variable 
caniinical form (Perry rf at., I9W») 

( onsidcr a UHh order nystem 


IV. Examples 

Hie algonihms for assignment of zeros were impicmcnicd 
as MATEAB (Molcr. 198(1) prtK'cdurcs and the computa 
lions performed using double precision <m a VAX computet 
The numerical mclhcKl (Emami Naeini and VanDofiren. 
1982Ui. b) for computation of system zeros was used to verify 
the assigned zeros. 

Example 1. Consider the rectangular system (Kouvaniakis 
and MacFarlanc, 1976; tlmami Nacini and Vanl)cK*rcn, 
19H2a,b) 


2-6 3-7 6" 


“ 2 7" 

0 -S 4-4 K 


■■ H .S 

0 2 I) 2-2 

B 

- 3 0 

0 6 3 .S -6 


I .5 

(1 -2 2 -2 .S_ 


-“8 d- 



"(I -1 

2 

- 1 1" 


0 

(1 

()” 

C - 

1 1 

1 

(1 ™ 1 

D - 

(1 

0 

0 


0 .3 

-2 

3 - 1 


0 

0 

(1 


Ixl the desired zeros ol //j, be (1, 2 + j3, -2 j.l. - 4) and 
desired gajn factor f» 2 i ^ Since there arc 4 zeros to be 
assigned, only one reduction ol the system matrix is 
required After Step 3 of the Reduction Algorithm wc have 


A djugimW i2*\ 2 *, . 2 

b‘'|i I I I I I I 1 I II'. 

c'- 11 I I 1 I 1 I 1 1 l|. </ ■ <' 


let the desired zeros iiiul gain factor be the same as those of 
the above system Application of the reduction and 
assignment algonihms should yield the alMm- exact c* 

The results shown below indicate clt>sc agreement Ikmwccii 
the conipuied c and the exact c, whereas the third column of 
the table. showing the equivalent puiumeter r‘*' as computed 
using the method with noii-orlhogniial iniiislormiitiofis 
(Perry ei at . 19K6). has fewer digits o( accuracy 


csaci c 
1 
I 
1 
1 
1 
I 
I 
1 
1 
I 


umiffutpii r 

I.INNItNKMNMMMMMNII 
MNMMMtfKMMMMXIOOl 
1 (NXMNNKNIOfMIfNNMy 
I INMNXMMMMIOfMMNNI 
0,9^)99999«88m99‘i 
1 IXMNMXNXNKMXXMM) 
03><>9999‘/99<>9<m9 
I (XXXXKNMNIfNKNN)l 
I fXMXNNXXXXNXXXI3 
0 9*>«/‘>9^»9999*W997 


^,'•1 

0 ‘>9<^*>9963K42I474 
0 W88W.6KK2II2SS 
ri 9'8/*WHSri42H6334 
(l3W9W>Htili:VriK93 
II 9<>9992H9S24|K70 
(I ‘W;K276473^W»SI 
0 WKW4462H2154 
1 (KXIIMf)92%9HHH3 
(I ‘>99969.5(12995 560 
MXXI114IKH3H2926 


[: :i 



/I- 

11 9164 




"-4.6130 4 1617 

- 2,6873 

.5.0377 

U 3549 


-1.99H9 0 775H 

-0 K320 

3 OH60 

-0.3164 


-4.9295 4.9H60 

- 1 5045 

4 5547 

1 .3079 


-4 3160 5.7122 

-2.2332 

4 O60t) 

0 7948 


^-7.4661 7 9749 

-3.9.327 

4,8355 

4 2817 

"-() 6713 -0.6713 

' (> 251H 

0.0839 

-0.1678“ 

-0.3859 0 6141 

-0 1447 

004K2 

-0 6713 

-0.1447 - 0 1447 

0.9457 

0 0181 

-0 2518 

0(W82 0.0482 

00181 

0 9940 

0 0839 

^ 0.6I4I -0 3859 

-0 1447 

00482 

-0 6713. 


In the Assignment Algonthm wc have: 


(15 4619 - 3H.4597 8 4297 -28 89351 

c^-|lK(M)0 -5 5167 1.7667 -4.9667 3.533.3| 

d »0, 


The computed assigned zeros arc: 

0 99999999999999H6 

-1 999999999999995 4/2 999999999999996 
-1.999999999999995 -/2.9999999999999‘>6 
-4 (JOOOOOfJfWriMJOflH 


V C one favion.1 

An algorithm for assigning a prescribed set of finite zeros 
associated with the individual trun-slcr functions Ik tween any 
input and output has iKen presented 'Hie algorithm im|>oses 
no restrictions on the Male spate model, and enables 
as.Mgnmcn( ol fvnh real and complex zeros using only real 
arithmetic Hie method is eflicient since leduccd si/e 
matrices are used in each step, and has favorable numencal 
behavior since only orlhogonul iransformalions are 
performed 

Examples were presented to illustrate the numerical 
performance of the algorithm Furthermore, a comparison of 
the results with those obtained from a incthiHl using 
non-4irthrigoria) similarity transformiilions showed the supc 
nor accuracy of the new algorithm presented here 

A MA7TAB implementation of this algorithm is iivaiiahic 
from the authors 
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A Lyapunov Robustness Bound for Linear 
Systems with Periodic Uncertainties’*" 

W L CHENt and J S GIBSON* 

Kc) Wm 4»-1 yapunov rtihustncivs; slnbihiy; {KrtiHiic ccKrBWicnts. rohuiii a>nini| 


Abfltrscl—For linear sy^U'm^ involving underlain paramclcrs 
with known, amsiant nommul values anil uncertain 
perturbations (hai vary sinuM>iilally with lime. I vapunov 
robustness anslvsis is used to deternune a stability Ixmnd, oi 
margin, for the ampliludes ol (he parameter pi'rUjrbutnms 
I’his Ixiund IS (he si/e of a hypcreulH' in parameter space loi 
which aNyriiplotic s(abilii\ is guiiranded The bound, which is 
based on a quadratic 1 yapunos lunclion that depends 
lincarK on piirame(er |x-riurbiitions. vanes with the 
frequency of (he uncertain parameier pcriurhations Ihe 
IhuiiuI is assmptotically protKirliorial to the s<|uare ro<u ot 
this frequency as i( becomes large 

I IntrtHlui tt(»n 

Ni'Ml MOi s Ktc(Ni pafvers have used quadradc l yapunov 
functions (o develop robustness bounds lor linear systems 
with uncertain parameters .Some pa[X.'rs (Hyland and 
beinslein, Paiel and loda. PiHtl. Yedavalh, 

\cdavalli and Liang. /hou and Khargonekar 

have dealt with robustness analysis only, while some 
(Bernstein. l^^KT; Haddad and Herrislein. Keel vf al.. 

P)Kh. Petersen. P/KS; Petersen and Hollot. P>K(i, /,hou and 
Khargonekar. P>Mh) have usi'd Lyapunov-based robustness 
analysis as a basis lor design o( robust conirolleis A 
common lealiirc of the references |iisi cited and most related 
wcuk IS (hat .i single Lyapunov function is used for the entire 
set of parameters for whicfi stability is guaranteed liceause 
of this, the Lyapunov robustness analysis applic's to 
time-varying uncertain parameters (although the nominal 
plant must be constant) However, (he robustness fvounds. oi 
margins, produced by such analysis involve only Ihe 
magnitude of parameter varialionv: the analysis cannot 
detect how the allowable magnitude of uncertain lime 
varying parameters depK'ruls on their Ircqucney 

In Leal (WHK) and Lxal and (iibson (IWP). a quadratic 
l.yapunov function was developed that vanes linearly with 
uncertain plant parameicrs Because of the linear depend 
cnee on parameters, the method used is called a Mrst-ordcr 
method For all bul one example to date, this first-order 
method has yielded larger robusincss bnunds than the 
sharpest possible method based on parameicr-indcptuidcnt 
Lyapunov functions |.vcc Ixal (I9HH) and L-eal and (iihson 
(19M())] Lbc first-order method dives not apply to problems 
with time varying uncertainties, though 

Lhis pafxr extends the approach in Lxal (lyHH) and L-eal 
and Gibson (1W()) to linear systems in which rhe nominal 
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system is time invannnl but the perturbations in uncreriatn 
ccxflicients vary .sinusoidally with time As in these studies, 
the l.yapun(fv function here vanes Uncurty with uncertam 
panimeicrs I'hc lirsi-ordcr term m the Lyapunov matrix 
satisfies a differential equation in which the loicing term 
contains the sinusoidal |xnuiha(ions from the nominal plant. 
As a result, the Lyapunov function and the resulting 
robustness margin dctKinl on the frequency ol the piiramelci 
perturbations In general, the robustness margin is 
pro|M)rlioriul to the square rtMU of ib( frequency of the 
jK'rlurhiiiioris al large Irrqucriciev 

2 Tht Muir and /.vu/iuiifO' rifuuhom 

We consider the system 

1 (f) 4(r)i(r). ^ (2 I) 

where i(f) is a real n veebM and the n x n matrix A(f) hiis 
the form 

/Ml) Aif, ff) * A„ I (Up) sin Hit (22) 

where (he real matrix (iiff) is a linear funclion of the 
constant parameter vector /> |/>, />, /»„,)' f H"' and the 

real maiiix At, is constant and mde|X'rident of p 

Ifefimiufn 1 A real n matrix function fUt) is a 

Lvupii/ioi' mafriA lor /Iff) if (i) /’(f) is iKnodic with penml 
2 ji / w , (II) /*(f) IS symmetric and f>oHitive definite lor each f. 
Its maximum eigenvalue is bounded unilormly in f and its 
mmirnum eigenvalue is Ixiunded away Irom (I unilormly in / ; 
(III) /’(f) IS piecewise continuously dincrciiliable and the real 
symmelnc rnaliix 

e(/)“ Adi'rt/) * rii)Ai/)i lU) 

IS non-ncgaiive Furthermore, /’(f) is a irrirf /.vupunov 
rnufriK for A(f) if (Jff) is fxisitive definite with its minimum 
eigenvalue hounded away from 0 uniformly in / 

Ihrifrrni I Hie system (2 1) is unilormly expoiicnlially 
stable d and only il ihcre exists a strict I.yapunov matrix lor 
Ad) 

Wc assume that the eigenvalues ol 4,, all have iiegalive 
real parts, so that for each ptisitivc definite Nyintnciric real 
n ri matrix (>„ there exists u unique positive definite 
symmetric real n x n matrix /’, satisfying 

4/,/; 4 - y., (2 4) 

We Will factor (J,, uniquely as 

(2?;) 

where L is a real n x n lower iriaiigular matrix with positive 
diagonal elements. 

3 The ftnt-order fnrihod 
Vit define 

PU,p)^ /’„+ Tdt p) (3 1) 

where, for each value of the parameter vector p. /’(r, p) i* 


S4S 
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the unique perKidic Miluiiun to 

f\{i,p)^ P,U,p)A,, 

^ P„G{p)\MnuH (3 2) 

TTiai (3.2) ha» cuictiy one pcnotlic !H>lu(ion foJJown from the 
foci that (he cigcnvatucfi of Ai, uU have negative real parts, 
fhc matrix Pi(t,p} is a linear function i>r the parameter 
vector p, !uncc (i{p) l^ Furthermore, P,(^ P) 


functions is convex and since the square of a nonncgaiive 
convex function b convex, 


p(Po'PtU.ip))-s-s(y limjtx 


where 


(3.10) 


rW,((?n) - PA[(>iPu 'P. f ^ PiPu (3 I I) 

We factor Cip) as 


P\(i, p) " PJp ) cos iJit + P,Ap) sin un (3 3) 

where the real symmetric n ^ n matrices PJp) and Pjp) arc 
the unique /i x n matrices that satisfy the equations 

u>PJp) f A,\r,,{p) + f’^(p)A„ -\<i'{p}P„ + /',f»'(p)| 

(3'l) 

u,l>Jp) 4 A,\rjp) 4 PJp)A„ - 0 (3 5) 

To motivate our terminology, we note that, if the scjiution 
P{t, p) to (2.3) for fixed ^ is expanded as a l aylor 
senes in p, the zero-order term is /*, and the hrst-ordcr term 

is f'lii.p) 

Next, we define some quantities that will he u.seful in 
dclermtning whether Pii.p) is a f.yapunov matrix for 
A{i, p) First, 

Wit,p)-^L ^\<J{p)PAt, p) ^ P\it. p)(iip)]l ' sin rt>/ 

(36) 

where L is the matrix in (2,.S) F'oi a matrix M: 

“ maximum singular value of M\ (3.7) 
p{M) • spectral radius of M (lor .square M) 

- max ||A|. A IS an eigenvalue of M). (3 K) 

Since P^^ is a slricl I yupiinov matrix for /4,,, the following 
two conditions, togciher, are sufficient for P{f> p) to be u 
slricl l yapunov matrix for Ait, p) for a given p 

('(mtlitum 1. p(/*()'r,(r. p)) is fmunded strictly below I 
uniformly in i 

(Vindniofi 2 W(r, p)) is iKuindcd slniily below I 

uniformly in t 

Definition 2 (IlypcrculH* in K"’) For v ^^rO, 


Gfp)- fV,(/,(p) (3.12) 

where Gf, is independent of p and 0,(p) is linear in p. Since 
(/. ‘/a(p)G(,| and |G,(p)L ’] are linear functions of p. 
o^^iL 'PJp)(jj and o,„^,(G,(p)T ') arc convex funciions 
of p, and similarly for Pjp) lliercforc, Lemma 1 and 
elementary properties of o„i„( ) yield 

/»)) - 7’,(f. p)(i„ sin tot)) 

■ ')), pc((l) (3.13) 

[Recall p,( ) from Dcfiniiion 3) F>om 
2(Pfl(p) cos u}t + Pjp) sin tot) sin (ot 

~ Pjp) ^ Pjp) sin 2ioi Pf ,(p ) cos 2ujt, (3 14) 

It follows that 

+ 'PJp)(!u)'* <’ . {I '/’,.(plO-„)T - (3 1.“^) 

lienee (3 13), (3,l.*>) and Lemma I yield 
»^„«(VV(L vp))- r’ 

IHi** 

P f f (1). V. t -0, (3 16) 

where 

+ .)■]'■) (3 17) 

and 

«.'m..(Cn)= Vl) (3 IM) 

Now we define 

-''|(C>(|) I/max { ImuC/n ). • 0;,„,,(L>„))' ■ ) 

(3 l‘M 


f (v) (p ^ [p, p, ■ ■ ■ p,J': max IpJ - 1 } 

We note Ihut C'(.v) is the convex hull of its 2'^* vertices 

Definnitm 3. If / is 11 reiiLvalucd function defined on f ’(l), 
then 

p,(/) ^ max |/(p): p is a vertex of f’(1)} 

I^mma 1 l.et .?*) be a finite collection of 

p<iinls in a linear spuce, let ,V lie the convex hull of 
If,, ), und let / Ik a convex function dclined on 

.V ITicn max (/(f) f e vV) /(£,) for some j 

The proof of this lemma, given in Lx'.al (I9KFI), is elementary 
We recall that ) is a norm for any space of linilc 

dimensional matrices Ficnce ) is a am vex lunclion on 
any such .space Also, for a fixed matrix M. p{M^MN) ^ 
W/VM' ) IS a convex function on the space of symmclnc 
matrices S of a given dimension 
Now we will use the foregoing definitions and facts to 
estimate the largest hypercuhe (’(j) such that, for each p in 
the inlchor of ( (.*), P(t, p) is a strict Lyapunov matrix for 
A(f, p). The final result will be llicorcm 2. 

SiiHT Pjp) and Pjp) are linear in p and since a convex 
function of a linear function is a)nvex, Ixmma I yields 

P(Pn 'Pj^r))-sp{p, ^rjp))^^spjf>{P, 'pj). 

per(L) and xirO, (3.9) 
and similarly for P^(p) Then, since a sum of convex 


For p in the interior nf f'(.',((7,))), n follows from 
(3.10)»(3 11) that Condition I holds and it follows from 
(3 16)-(3 IS) that Condition 2 holds Therefore, we have the 
following theorem, which is the main result of the paper 

Theorem 2. Lei he a p^isitivc dclinitc. real syrnmetne 
n X n matrix. F^or each p in the micnur of C(.V|(C3(,)). Pit, p) 
is a strict Lyapunov matrix for A{i, p). 

From (3.3)-(3,.S), it follows that P,(f. p) is proportional to 
l/<ii for large cu. From (3.11) and (3.17) then, it follows that 
i*nd o,^.,(t>„) arc asymptotically proptiriional lo 
\/w Since independent of w, 

dominaics «„„,„(()„) for lurge w. 
.SO that .i |(V(i) is proportional to u/ ' for large to 

4, Sumericat solution of the Lvapunov equations 
Eliminating Pjp) from (3.4) and (3 5) yields 

ot'P.ip) + + ^o(p)'3r, 4 za',pjp)a„ 

^at\G'ip)P„+r„Gip)\. (4 1) 

The algorithm in Bartels and Slewarl (1972) for solving 
standard Lyapunov algebraic cquaikm.s can be generalized in 
the following way lo solve (4 1) for Pjp) l^l C be a real 
unitary matrix such that where A, has quasi 

Schur form. Then prcmuUiplying (4 1) by iJ, postmulliply- 
ing by 1/ and inserting UU^ where needed yields 

ot^P.ip) + Artip) + P.(pK; + 2A;P.[p\A. 

- ,oLl’[G\p)P„-t P„G{p)\V (4.2) 
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0 40 ^ 

j 

& J(1 I ' 

. .. i CP, 

i , 

, .-I 5 \ , ' ' ntit {•ciu.i«.|) 

,1 ^ 

J / 

j 

'■■ "r; i:>i. , ..V- J1 h f* 

Fiti I s,(/) VS frequency of uncertain parameter periui- 
haiions 

where r^ipj ~ ' Ilic variow* 1 x 1. 1 x 2, 2 > 1 anil 

2x2 blocks of (4.2) can be solved recursively as in Bartels 
and Slewari (1972). 


Numertcal optinmatioii of the matrix I. shtHilil uicfcsuur 
in most exumpfes, as in leal (19KH) and Ixal and 
Gibson (1990) for the ease of arnaiant unceriain parameters 
A.Imi. scmiic odimales in Section 4 perhaps arc mit the 
sharfsesl poaaible However, that .»,(C^>) asympiotKally 
pniportional to the. square n,x>t of the parameter frequency is 
inherent in the methml 

The meihcHls of this paper can be applied to the case 
where the perturbation G'(p)siniiir in (2 2) is replaced by 
v 

H,{p)%w {ioj ^ <p,) la this case, the mninn r,(r,p) is 

I -1 

reputed bv T. p) where each r.fi r) Has the form tm 

I -1 

the nght side ol (31) and valtsfies a I yupunov equation 
similar to (3 2) l-.siimatcs corresponding to tlutse developed 
in (V9) (3 19) are obtained by the same melluHis but with 
more uses of the inangic inequality, so that the estimate ol 
the largest hypercube lor which staluliiy robustness is 
guaranteed is cruder than for the ciim' treated in this papet 

,4rAifirm'fed|'rmrn/-- this research was siippinled by the 
United Slates An Force under AFOSK (irarit H70V7A 


5 Example 

Ihc mairuxr.s A„ and Cj(p| in (2.2) arc the following 4x4 
matrices; 


where 


.4o 



u'(r) 


0 0 
-K', 0 


A'„ - 


1 0 
0 4 




Pi Pi 
P: P^ 


(5 I) 

(5 2) 


Figure 1 shows Syil) a.s a function of tu foi (iip) factored as 
in (3 12) with 


G,(p) 1 01(2x4), (.S.3) 


and for dip) not factored (i c (#o I and (/,(p) ~ dip)) 
Ihal ^^(I) IS asymploiically pr()|>oruonal to f/»' as predicted 
in Section 3. i.s clear from Fig I 

Perhaps more interesting arc the local minima at ri> - I, 2. 
3 and 4 Wc recall a clussical result for the undamped 
Mathicu equation |.scc Nayfeh and Mcxik (1979) or other 
.standard references]; a parametric excitation of frequency 
twice that of the nominal .system makes the solution to ihc 
equation unstable Thus (he kKal minima at nr > 2 and w - 4 
(twice the natural frequencies of the nominal sysicm) might 
he expected Furthermore, results in C hapter S <>f Nayfeh 
and Mook (1979) for a mulli-dcgree'OfTrccdom Malhieu 
equation indicate additional instabilities produced by 
parametric excitation frequencies equal to sums and/oi 
(liflfercnce.s of natural frequencies of the nominal .sysicm 
[For the onc-degree-of-freedom damped Mathicu equation 
obtained by taking A,, and d(p) to he 2 x 2 mainces c»f the 
forms in (5,1) and (5 2) with A.',,- 1 and A, -P|, wc have 
obtained an v,(/) plot similar io Fig 1 hut with only the UK:iil 
minimum at w - 2 | 


6. Conclusions 

For linear systems with uncertain parameters that vary 
with time so that the known nominal sysicm is limc invanant 
and Ihc uncertain perturbations in (he parameters vary 
sinusoidally with time, (he Lyapunov robustness method here 
yields a stability-robustness margin that depends on the 
frequency of the uncertain parameter perturbations This 
margin is asymptotically proportional to ibe square root of 
the frequency of the uncertain parameter perturbations, and. 
as the example indicates, the robustness margin is sharp 
enough to identify important rciuinances 
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Abstrod—Stable dynamic systems admit ptvsitivcly invariant 
domains associated to their Lyapunov functions Conversely, 
some domains can l>c made ()osilivcly invariant (or systems 
with slate feedback controllers designed in such a way that 
some assiKialcd non-negative detinue lurKtions arc bound to 
decrease In particular, this approach can be* used to 
establish conditions on the gam matrix tor Linear 
C'onslrainciJ Regulation Problems (LCRP) We construct 
(ixed and variable regulators easy to compute through linear 
programming, for a class ot constrained linear systems 


IS profsosed in this pnpci It allows lor an easy on-line 
implemeniaiion of the conirol scheme wiih (x>fc!iible 
extensions to adaptive cases (Buriat and Hcnnci, 19K8). Hits 
mclhiKj i,s halted on linear programming. In the feaaible 
eases, it generates a rapidly cxjnverging conirol law; 
computation of the gain matrix can also be frequently 
updated to accelerate the amvergerue sfKcd by taking into 
accxiuni the current state of the system (ilohal stability of 
the variable regulating scheme is proven under a local 
stability condition 


/ntroducUun 

It ( IINK At tONTRoi limitations have long been considered a 
major problem m control engineering Actually, most conirol 
schemes do nol inlcgraie constraints in their design In 
practice, conirol laws often have to Ik complemented by 
adequate control limiting devices However, saturated linear 
controllers may fail to stabilize unslabic linear systems 
For some sets of initial conditions, stabilizing saturated 
linear controllers can be designed by the methmi of Ciutman 
and Hagandcr (IMH.S) llicir approach rests on the 
construction of an elliptic positively invariant domain 
included in the polyhedral domain ot constraints and 
including the .set of initial slates Hie shape of the invariant 
domains is directly induced by the selected L.yapunov 
functions So, the choice of classical quadratic Lyapunov 
functions is not the most eflicienl for the Linear ( onslraincd 
Regulation Problem (LCRP); ii dcKs no! maximize the si/c 
of the domain of initial slates for which a stabilizing 
constrained regulator can be computed ITiis limitation can 
be overcome by the use of non-quadratic Lyapunov functions 
of the type mircKiuccd by Roscnbrock (i%3). Along this 
line, some authors (Vassilaki er u/ Ben/aouia and 

Burgal. 19K8) have propsised mcihixls for constructing 
polyhedral positively invariant sets belter fitted or even 
pcrfccdv matching the domain of linear constraints 

In particular, for a linear .slate feedback, the set of conirol 
constraints generates a convex ptdyhcdron m the stale space 
Hus polyhedron can be made invariant by specific matrix 
conditions A simplified version of the invariance conditions 

* Received 19 July 1989; revised .3 September 1990; 
received in final form 28 September I99f). Hte original 
version of Ibis paper was presented ai the lllh IFAC World 
C'ongreics Symposium on Automatic C'onirol at the Service of 
Mankind which was held in Tallinn, Estonia, dunng August 
1990 TTic published proceedings of this IFAC' Meeting may 
be ordered from; Pergamon Prcs.s pk, Hcadingion Hill Hall, 
Oxford 0X3 OBW. U K. Hiis paper wa.s recommended for 
publication in revised form by Asitociaic Editor R. V. Patel 
under the direetkHi of Editor H. Kwakemaak. 

t L^boratoire d'Automaiiquc cl d'Analyse dcs Systi^mes. 
7, avenue du CxdoncI Roche, 31077 Toulouse, France. 

t Author to whom all correspondence should be 
addressed. 


roMiiiff mvanamr of fudyhrdral \ei.\ 

Consider the disireie-time lincui Oynamical system 
described by the equulion 

(1) 

with \\ ( lor any k ^ .V. A,, f 
Ixt Hid. n;) be a noi-rmpiy ttinvcx polyhedral set defined 
by 

W(CL (AW ;r r/A'- oi) (2) 

a t and tij is u vector in M* The inequalities between 
vectors arc aimporicniwisc. For instance, in definition (2). 
{^X ^ (Jt stands for (CLV)^ for i ^ I, , g 

According to the sclcclctl pair (CV, in), W(CV, lo) can be any 
type of polyhedral set (bounded or unbounded, including or 
not the origin [Hunt) Ihc ease of proper cones is also 
included in this representation, for fo ^ 0 

By definition, ff(d, u>) is said to be positively invariant for 
system (1) if and only if. 

X. e 0.) ^ X,. J » Xf^X, e f((C;. w) 

Vr f X. XkfX 


This definition ol positive invariance can be found, in 
particular, in IjushIIc (197b) 

1hc property of IT-^nvanance defined in Ciutman and 
Cwikcl (1986> IS closely related lo this definition. But it 
(ximbincs the positive invariance of a domain of the state 
space with linear constniinl.s on the conirol vecior and with 
an asymptotic xiabiliiy requirement. In conirast, poailivc 
invariance of an unbounded polyhedral set does not 
generally require or imply the asymptotic Uabilily of the 
slate tra|cclones cmanaltng from this net 

Existence of positively invariant polyhedral sen for Rynlem 
(I) is a generic properly which covers diflcrtnl types of 
dynamical behavKiurs. However, if rank G n and (oj), >0 
for I I. . . . g, then, poftiiivc invariance of fC(G, 
implies the stability of system (1). This laRl property can 
easily be shown as in Binons (19HHa) by selecting as a 
Lyapunov function of the system; 


^(Jri^max 



(3) 


The following proposition is valid for any type of 
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(Ktlyhctiral %c( Hid, iaj ) h providch u nccc»Kiiry and riufficicnt 
amdirH>n K»r H{(i, at) to Yn: n p(>»itivcly invariant sci of 
nyMcni (1) Th»^ bauic result on p«ilyhcdrul invariant sets was 
initially cslahlishcd by IliiMiiris (IWlMh) under some more 
rcslriiiivc londitions (in particular, all the cximponents of 
vector to were sup|MifkCd strictly positive) Here, these 
conditions are relaicd and a more direct prcMif is prenentc^ 

/Vo/iowfion I. Ihe convex polyhedral set H((j, iu) is 
positively invananl (or system (I) if and only if there exists a 


malro fi t such that 

H„ -0, for 1-1, . y I. . ^ (4) 

H(i - a A,, (5) 

Hw 1 io (6) 

f*riH}f A necessary and sufficient condition for K((/. cu) to 
be (H>siiively invananl for system (I) is 

(iA,,X - UK V.V f r’ dX - w. (7) 


Condition (7) is a spi^ciiil ease ot inclusion ol a p<>lyhedral 
convex set m an other fMilyheilral convex stM l>ic extended 
barkus' lemmii (licnnet. 1*W>) provides an algebraic 
charLicien/iiiion of such an inclusion 

Any ptiinf of f<ld, ro) also satisfies the set of linear 
inequalities /* X “ V' with /* f and tff f .A'' if and i»nly 

d there exists a (dual) rnainx // of r?' ** with non-negaiive 
coefYkienis satisfying conditions Hd t* and 
17ti.s result can easily be proven by loncaienation of 
necessary and suflicieni conditions related to each row /’ of 
matrix P Uy the standard f arkas lemma (see e g Schnjver, 
lOHb). a riccessarv anti sulTicieni condition for: 

P.X - V,V (iX t w 

IS 

3//, 1 H,(, p. H, to V- . (A/, - (I. V/ 

1. .X 

The simultaneous satisfaction of all these elementary 
condifitms for any point of H{d, is equivalent it) the 
existence (if p row-vectors //, salisiviiig the same types of 
condition as alnwe The exlended f iirkas‘ lemma is simplv 
obtained bv conslrutling matrix H Irom these p row-veciors 
In piiriicular, by setting P dA ami i)- m, the necessary 
arul siilTicicni ctnidilinn loi c') to Ih‘ posilivcU 

mvarnini can lie wriiicn 

.r-" Hd ^ dA„. Hto - UK 

/A, M) for i^'l.,. .g: /-I, .jir n 

hii’ortant tr tinj \tahihty n/n/er input mnstrainh 

Now, the considered nniltiNariahle linear systems can he 
represeiiteil by slate space equations of the following ivpc 

.V* , , ,4.V, I ftl \ (H) 

,V^ r being the state vector. l\ t if'” the control vcclor. 

Htr The control vector i.s subject to 

consttainis 

( Vri * ( /'^ - f'M (U) 

with (f ’m), >(>. (f/.V),'■(), for / - I. .m and A '■ 
0. 1. 2. Assuming that the stale ol the system is 

observable, we want to ctintrol its closeddiH>p dynamies. 
Then, the selected control law )s a linear state feedback, with 
F€ jr*"; 


a, - F\ \ ( 10 ) 

ITye closed Uxip evolution of the system is dcscrilKd by 

with A,, - .4 f BF (II) 

The general problem called LC'RF (linear Constrained 
Regulation Problem) consists of determining a matrix A^ such 
that the stale vector of .system (II) converges to 0 while 
respecting amsiraints [^) and relations (K). (10) 


Prom Kalman and Bertram (1960), it u well-known that if 
system (11) ha.s alt its cigenvaiucs in the unit circle of the 
complex plane, ii admits elliptic positively invariani domains 
axxrxiatcd to its quadratic Lyapunov functums The square 
riKil of a quadratic Lyapunov function is a contracting norm 
for the Slate vcclor. 

From iIm: properties of equivalence between norms (see 
e g Glazman and Liubilch, P)74). existence of a Lj 
contracting norm is equivalent to the existence of q 
polyhedral norm for which the state is contracting. 11ns norm 
can he written as in rclution (1) Lxjslcncc of .such a norm is 
equivalent to the positive invariance of R{d, ui) Hcnnei and 
Las.scrrc (199<») have prcscnicd a scheme for constructing a 
polyhedral positively invariant domain for any asymptotically 
stable system. Ihc converse problem, analysed m this paper, 
IS to shape the dynamical behaviour of the controlled system 
so that a particular domain is made positively invananl The 
convex polyhedron generated in the state space by 
consiramls (9) is 

H\F, Um. UM\ - {X t Urn - FX s UM). 

A spcciiili/ed version ol invariance conditions (4-6) is 
provided by the following proposition 

Propoxuton 2 A sulficicnt condition for Af(/-. (Jm, f/M] to 
be positively invariant is the existence of a pair o( 
non-negativc nititnces (/A ' c // f such lhar; 

A(4 4 HF) HF (12) 

Hp- P (1.^) 


with 


// //■ //, //--(JJ 

and 



1 his ctmdilion is also necessary when rank F ^ m 

Proof 

Sufliciency 

Invunancc ol W(A. I’m, UM] is readily derived from relations 
(12) and (13) by a direci application of Proposition I to 
system (II) with 


d 


4 A 

F 


and u) - p 


Necessity when rank F - m 

Assume now that Hid, lu) is a positively invariant set of 
system (11), with d and u) defined as above 

Then, from Proposition I, there exists a matrix with 
non-negalive elements. 




ol 




)• 


H„ f •if?*’" (it l.J f {1.2) such that: 

G'(4 4 BF) -- Hd, Hto ti). 


llicn. (A/„ - tP:)F - {H.z - /f,, )F = F(4 4 BF) If rank 
F'^ m. this relation implies: Hi^ ~ H^j ^ ^77 - M^i 
A/-A/,,-//,, Let A/' be the matrix of the non-ncgative 
components of H and A/ the matrix of the non-negaiivc 
components of (--A/). Ilrcn, matrix H ^ H' - H satisfies 
condition (12). And 


j(Af'),, ^min {iHn).r 

1( W )„ min {(A/,>)„. AT^),^} 


for 1 . y € (I, . . m). 


Thus, maiiiee.s H* and H witisfy the ncccvsary condition 
(13): 


("■ 

H 


«.:y 



' oh, 

hJ 
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Propositjoa 2 can abo he derived frcMn Pn>piL»siUofi 4 in 
Bilsorts (19HRb), which trealK the case of given non- 
symmetricaJ polyhedral domains of the stale-space 
Tlie algorithm of the neal section solves rciaiions (12). 
(13) by an indirect lechnM|ue A solution matnx H computed 
by this technique also guarantees the invariance of a give-n 
polyhedral domain of the state-space, /f|G. Um. VM\ with G 
fuU-rank Under this scheme, the class of matrices H can he 
replaced by the class of mainces H with no loss of generality 
In the special case of s)'mmeirical constraints {Um 

relation (13) can be equivalently replaced by 
(1 ~ \H\)Um 2r0) A ncccsiiary conditHHi foi this inequality 
to be satished is ( I - |Ay|) to be an Af-matnx (Benraouia and 
Burgat, I9H8) 

The LCRP can be M>lvcd whenever ji is pi^ssihle to find 
(H .H ^ ) such that 

> Matrix (A ^ BF) has all its eigenvalues kx'aicd in the unit 
circle of the complex plane 

• Positive invariance conditions (12), (13) are verified 
■ The initial state vector. A\>6 R\F, Um, UM]. 

Tlic algcbrK formuluticvn of this last condition is. 

Um s UM (14) 

In this paper, we propose a method for finding an easily 
ctimputahle pair (H, F) liclonging lo a subclass of solutions 
of equation (12) This design technique is based on the 
following proposition 

FropcKSiiion 3 If H\G, Vm, f'Af| is a positively invananl 
domain of system (11). and H an ussiKialcd solution of Ihc 
system. 

(HA 4 BF) //G, Hp t. p, 

then any polyhedral domain I’M] is also a 

positively mvananl domain of (11) if 

I t-'-Af;, Af #— 

I A/y - WA 

Pnutf OiA a- HF) ^ HG and A// //A imply i?(A -r 

BF) - HQ Ihcrcforc, under the assumed condition Hp p, 
Um, f/M) IS also positively invariant ( I 

Now, a controller letting H\F, Um. UM] 

positively invariani can be constructed as follows 

• Select a fixed matrix G t (or which /?|Ci. Um. UM] 

can be made positively invariant bv stale fcrdback. Then. 
3(// € / r J^'"*'*); HG - G(A ^ BF), Hp r. p 

• Solve the linear system 

( HG - (;(A + HUG) 

HU I)H. n t 
Hp 1 p 

• Set F - 1>G 

The subclass of controls obtained by this scheme is 
characicn/ed by the additional property of letting 
B{G, Um. UM] positively invananl. It is therefore important 
to handily select matrix G M) as to obtain a nonempty 
suhclas.s of controls for most feasible problems. 

A basic condition for Ihe existence of non-negative vectors 
{Um. UM) such that ^|G, Um, VM] can he made positively 
invariant by state feedback is that A.>rtG) should be an 
(A. Al)-invahani suhspace m the sense of Wonham (Hcnnci 
and fTc Bona ('astclan Ncto, 1‘^)) 

For any system in its minimal representation, the 
assumption rank B ^ m with m n is quite ger>cral Under 
this assumption, there exist matrices t iJlT'*'* such that 

(15) 

In particular, wc can select the left pscutkvinverse of 
B, ^ iB^B) ^BU The kcrrtel of is the quotient space 

^t'*//m(B). which is an {A, 0)-invanant subspace, fance 
er (Wonham, I9H5). 

If we select G ^ B^ ami apply Proposition 3, we can 
obtain a subclaiis of positively invananl controllers by 
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impoKing the fr>lk»wing «et of oomlitions: 


B^ABH « 

HB^AB 

(16) 

f » HB^ 

- B^ A 

(17) 

Hp < 


(IK) 


Equation (16) is obtained from condition with 

D ^ H ~ B^AB, since H commutes wiih itself And dearly, 
the choice of F from relation (17) isatishes condiiion 
B'^ {ABF)HB‘^ In the case m < n, u powiivelv 
invariant controller satisfying conditions (Ih). (17) and (18) 
does ncM generally guarantee the overall stability o( the 
dtwed loop system Some additional stability coiuliliom have 
to be introduced to gel a .siabilinng pemiiivcly invariiini 
legulaior 

An aiffonihm for mtvmft the tA BP 

A possible way to simplify the si ability analysis is to 
impose as a positively invananl set a rH>lyiopc‘ /f((f, lu) with 
/?((V, iii)c R\F. G'm. f/Af|, w > t) and rank G ^ n (Vassilaki 
rt a/ , IWK). Under this assumption, the fiiiu'iion T(A') 
defined by rrlaiion (3) iv positive deliiiilc and can iK chosen 
as a candidate Lyapunov function lor system (11) In this 
pajficr, the polytopt* to l>e muiniuincd invananl W'lll he 
directly consirucied by compiciing RfF, {/m. ( 'Mj under ihc 
assumplion (f/m), “0, (/^M), >0, lor / * I. ,m 

In the case m * n. il is always possible to add dummy 
control vaniibles (f^)^, m ((^a )^, to add n m 

independeni column.s in B so thul rank A n, and lo inqxisc 
the lollowing consirumts 

(1^) 

wilh, tor iivslHiiiC, (ffm )^,,"(f/M )„,,, « t#, lor i 
1. , a - m. and 0 • 0 as small as desired 

Under these extra condilH>ns, it can be assumed that }i\ 
and i>\ have Ihc same dimension, n, and lhal tank B n In 
this ca.se. the resolulion of the M'KP can be directly 
obtained from the following Pioposiiion 

pHfpo.’iUutn 4 It m - n and rank B n, conditions (20). (21) 
and (22) guarantee the |K)sitivc invariance of /f|^, Um. UM] 
and the asymptotic stabiliiy of the controlled system (11) 

B ^ABHHH 'Afi (20) 

■ HB ' // 'A (21) 

Hp^ p ( 22 ) 

Pnnrf From relations (20) and (21). wc can derive condition 

(12) 

/(A 4 HF) {HB ' B 'A)BHH ‘ 

H{HB ' B ’A) 

HF 

Thus, under mequalily (22). H\F. Um, UM\ is a positively set 
nl the clof«rd-kx)p sy,slcm 

Under condition (21), the dynamic mairix of the 

closed liKip system is; 

A,, HUB ' (23) 

Matrices A,, and // being similar, asyrnpiolic stability ot the 
controlled ftysicm (11) is equrvaleni lo the asymptotic 

convergence to 0 of the control H*querice, which xatisfics, for 
k ^0, I, . . the rccurreni relation (24) 

U, ,, - F{A 4 BF)X, 

« HFX^ 

//U* (24) 

Constraint (22) comisis of the two inequalitiex: 

H^UM^H Vm<{JM 
H VM ^ Um< Vm 

The summing up of these two incquailiiics yields 
{H* AH ){VM A Um) < UM A Um 
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Therefore, matrix 
Mitisfy; 


|//| • ((|A/,y|)) and vccu>r W 
\H\V/ 5af/* f// )W 


< W 


UM Vm 


B ^AX, -~Um^ {H; - ‘AT* B 'AX^ + VM 

(33) 


The vanttble regulating law m 


W in a powitivc vcelor t»f Jfi** Then (I - \H\) is an M-Matrix, 
and from a cimieal ref^ult prcM:;nicd in La.vaile (1^6), ■( is u 
necessary and sufficient condition for system (24) to he 
asymptotically stable G 

Ihc crKrflicicnis of matrices H ' and H can be taken as 
the unkfKiwn variables of a linear programming problem, 
denoted problem (11) and formulated as follows: 


V, - (34) 

and i& computed from the optimal solution (/f*, Hj, , ) 

of problem (fl^) by relation; 

~ H,)B ' 'A (35) 

Ihc closcd'lcH)p evolution of the system is described by; 




min f 


(25) 

suhjeet to. 


Up 4 fi 


(26) 

B 

'AH(H 

' H ) ^ (A/ ^ H )B 

'ab 

(27) 

B 'AX„ 

Vm 

Ur -H )B 'X„t.B 

'A„+ UM 

(2H) 


Note that inequalities (2H) simply express that the initial state 
should belong tc) Um, UM\ (relation 14) for a gain 
matrix T satisfying relation (21) 

An efficient way of solving the LCKP can be derived from 
the following proposition 

PrippoMiirm 5 II problem (II) has a solution (//’.A/ . f) 
with f • I. then the fX'RP is solved by using the control; 

f.; - A- with f (A7 ’ AA )Af ‘ B '/V {2^» 

Pnutf Prom Pmixisition 4, positive invariuiicc of 
Bit, Vm, VM\ and asymptotic stahiliiy of the elosed-lmip 
system derive from the respect ot conditions (27) and (2h) 
when f • I; and condition (2H) in problem (II) guarantees; 

.V„f B\t, Um. tlM\. I. I 

It Ihc optimal value ol f, r*. is strictly smuller ihan I, 
compute f by (29) and set (/* tXt, 

Note that the solution of problem (11) explicitly depends 
on the initial state of the system. through inequalities 
(2K), However, it is clear that the computed gain matrix F 
can also stabili 2 ;c the system from any other initial point 
belonging to A^IA-. Vm, VM\, and that the control trajectory 
always remains fcitsihic. If the initial state of the system is 
not (lerfcctly known. :i design technique imposing the 
invariance of u domain coniuining the domain ol possible 
initial states ((iulman and Hagander, I9H5, Vassilaki ei al . 
I9KH) IS probably more appropriate 

If stability of the closed-loop system is not 

achieved by (his algorithm. 

Ihc fact of iinp4rsing the invariance of A?|Af Vm. VM\ 
and relations (20) and (21) constrain,s the closed-loop 
cigcnvcciors to belong to some subspaecs. But under the 
assumptions of this paragraph, this is not a severe restriction. 
Any .set of n independent directions can generate an 
invariant domain of the closcd-lirop system. 

It IS only the sire ot the domain of stahili/iiblc initial states 
which may be reduced by using a control belonging to rhe 
investigated subclass. This possibility constitutes the only 
case of ‘'conscrvuiivcness ' of the proposed algorithm, when 
a suitable feedback exists but cannot be found by Milving 
problem (H) 

Ihc cOiciency of this algorithm can be improved when the 
current stale of the system cati f>e observed. A variable 
regulating scheme can then be implcincnled. T he gum matrix 
IS periodically updated by solving a linear problem denoted 
(IT*), Similar to problem (II) except for relations (2H). in 
which the initial stale vcclor. -V„. is replaced by the current 
stale vector. A*; 

min f* (3tl) 

subject to: 

H, f, (31) 

B 'aB{h; - H ,) = (h; - h, )« '.-i« (,i2) 


+BF,)X, 

Replace by il.s expression (35). It yields 
A\,,~-AfA/*/A ‘A* 

The eigenvalues of A/* arc also the eigenvalues of RH^B ’ 

AVoproidon h. If there exists an iiueger r such that problem 
(IT,) has the optimal solution (A/,, fj with t, < 1, then the 
optimal .S4dution of problem (II*) cxisis and verifies r, ^ 1 
for any integer k - r, and the controlled system is 
asymptotically stable 

Proof From Propi^sition 5, relations (20), (21) and (22) are 
satisfied whenever the optimal solution ol problem (IlG is 
such that <*' 1 Then, from Profwisition 4, A*, , i; 
A^jA'*. Vm, UM\, and (AY*. <\) is also a leasihlc solution of 
problem (n*«,), C'onscqucntly. the set of feiisiblc solutions 
of problem fll* ,|) i.s not empty and bv the choice of the 
objective function, we must have. r*,i' r*. and, by 
induction, r, ' I implies r* • I for any integer k -r 

Note fhal m the ease of time-varying linear systems, liKal 
stability eonditions r* • \ (or k “• r do not avilomatically 
imply the global siiibiliiy of the system Asymploiie stability 
of the system uiuler the variable feedback law can be proven 
by showing the existence of a I yapunov luneimn for ihe 
closed-loop system Since vector W has positive components, 
the function LiX). defined iis follows, is jsosiiive definite 


AT A') ™ max 


l(« 'X)A 

r: 1 


(37) 


( onsiraints (31) eonsiMs of the two inequalities 


A/; VM f //* Vm •: f * VM 
A/* VM f //* Um ' (\ I 'm 
The summing up of these two inequalities yields 


\H,\W <■ ( ,W 


ITS) 


The difference between two successive values of function 
/-( ) IS AlT* ^ ATA'* ^,) ~/-(AT*) From relation (36), derive 
B 'at* ,, - H^B 'K^ Then, majoratc L{.\\ ,,) using (3H): 


A (A\ . ^ max 


\[B 'A’*.,).l 

IV 


|(fl 'AT, 

w, 


W' 


I I V 

'* w, I ,e, w, \ 

JltfJW), |(fl 'AV),i 

* - 






^XJ,\ 

w; 


Then, /-(A'*,,) ^ f*ATA'*) and since f* < 1 for A: x> r. 
rtA.* * (I TfA ) IS a I yapunov function of the sequence 
of Slate vectors, which asymptotically converges to t); 
lim* A'* - f) C 
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1 

Or 
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- ? r 
-3h/ 


RIf Lw UM) 
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-V- 


( iO-~- 
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Fici I Trajeciory of ihc siate vccior .V* wnh ifK con.<itarii 
regulator 


I 

71- 

( 

I 

0 \ - 

! 

^■4- / 

j 


T- 1" .T"'"' 


.y— 




i . 

0 ^ ? 3 4 


Firi y liajectory of the state vector .V* with the vanable 
regulator in a cave t , > 1 


F^xampie 

Comidcr the scaind order ‘ivslcrn dcvcribed by the 
stale-space equation 




' 13 


17 -3 3 I 

il 3 ) 




3 II 
2 (I 



The control vector is subject to the following constraints 



I - 



and the initial stale vector is 


- 


.Ml 

3,S 


The unlorced system is unstable I'he eigenvalues of mairnt 
A arc; A, , - 1 i 

The constant regulator gives the optimal values 


f * - t) 93, 


H - 


/(I 3K 
' 0 91 


(I IS 
(I 


and the control law^ [>\ » F\\ is 

() n7b (I.Slb; 
(|,,S44 0 1K4/ 


f * - ( 


Simulation results are presented in l ig 1 
The same problem can be vilved using the variable 
regulator. The simulation results presented in Fig 2 show 
that the variable regulator cfinsiderahly increases the speed 
of convergence 

The same system now has to be controlled fnmi a different 
initial state vector 



The siieccs,sivc values of the rate of convergence r* obtained 
by the linear programming algorithm art 1 .53. 

f , = 1 . 6 «, €>-().%, f 1-0 92 , r ,-0 K 2 . f ,,--0 6 . 

We can see in Fig, 3 that although r„ - I, the system 
converges since we get r* < 1 after two steps The origin can 



Fig 2. Trajectory of the state-vector A'j, with the variable 
regulator 


be reached in 3 lime units So. in particular. .V„ helonga to 
the mammul U-invariant set driuird and ooiittrueted in 
( wikel and Gutman and Gutman ami Cwikcl tl9H7) 

Since 1. Ihc constant regulator is unable to jUabiluc 
the system In contrast, the vanahlc regulating scheme can 
Ih‘ satislaeiorily applied 

Many linear consintined regulation problems can Ik solved 
by constructing jsositively invariant domains asMKiaied W'ilh 
I yapunov functions TTie invarianee ninditions obtained by 
this approach can Iht used as constraints on the gain matrix of 
the control law A linear simplified verxion of these 
c<mditions is piesc*ntcd in this paper The I C KP can then be 
solved by a .Manclard lincai piogram The scleetcd objcciive 
function to b<^ maxirni/ed is denoted (It mcHsures the lute 
of eonvergente of the system to the origin 
Two types of regulators are proposed. In the fixed scheme, 
the same gain matrix is applied at each periiKl, while in the 
variable scheme, a new gain mainx is computed at each 
[KtkhI. from the knowledge ol the current slate of the 
system 

If r„* K siubihiy of the closed loop system is guaranteed 
with the hxeci and with the variable controller, hut the 
vanahlc regulator ma> considerably increase Ihe speed of 
convergence 

II *1. llte fixed regulator is unable to stabilize the 
system The variable regulator generates a feasible control us 
long as ibe Milution of the linear program remains 
numcncully (mile Several iieiiilions of the algorithm can 
then he computed off line. And stability of the dosed kHip 
system can olien he obtained by gelling r,* 1 after some 
pcncMJs of time Bui if the constraints arc loo severe, the 
process should rather Ih’ stopped to avoid divergence This 
variable control law can also be very eflicicni in an adaptive 
context. With a pnon unknown purumcirrs. Then, ui each 
updating time k. the best current estimates of matrices A and 
d H arc updated by a recursive idcniificution algorithm and 
the computation of the gain matrix also directly uses the 
informatjon on the current slate of the system through 
resolution of problem (II* ) 

ArAn/JH'frtJgemrnis —The authors want to thank Professor G. 
Bii.soris and the anonymous referees tor their helpful 
aimmenU on a previous version of the paper, which was also 
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Abelracl—T'hc dcierministic continuous time 1,0 output 
regulation problem is solved by polynomial equalnms as an 
alicmalive to the usual Hiccati equation approach In 
particular, it is shown that Riccati-bascd and t>^ilynomial 
methods are fully conceptually equivalent in sicady-siute 
regulation 

1 Introducfion 

This papi r deals with the classic Linear Ouadraiic Output 
Regulation (LOOK) problem Only the conimijnus time case 
IS considered here. I he discrete time case having been 
recently reported elsewhere (Mosca and Nistri, lURU) 

A conlinuoiis-limc. linear. Imie-invanant slate space 
rcpresenialion of the plant to be output regulated is 
considered 

J jt (0 7 f /'u(f I 

I V(/)-^ 

with u{t)f: .^9'" and \{t)i Ji*' Fhc problem is lo 

find, if it cxiMs, an mpul variable ii( ) e /.. minimi/ing the 
quadratic-cosi 

- I (IIKOli;,..-* ||u(f)||:,,Jcl/, (2) 

for an^ initial slate i(d) In (2) ' 0. '1^,, • d. 

||u(/)!|;i,: ii'(f)T?'(r) and the prime denotes lianspose Hv 
Parscval’s Lemma, the above ciisi can he expressed in terms 
of the Laplace transforms of y(f ) and nd) 

1 L' 

,, (llv(i)ir.,, + iiu(v)||:,. )ill (.') 

Inl) ,, 

It IS well known that under siahilizability and dctcctabiliiy 
assumptions on the triplet (4». O. //), problem 0) (3) can 
be* solved in sratc-fccdhBck form by using the unique 
nonnegativc definite solution of the rdcvani algebraic Kiccati 
equation Moreover, the resulting closed-loop system turns 
out lo be asymptotically stable 

The aim f>f this paper is to provide a dircci matrix-fraction 

’ Received 23 June 1989; revi.sed 3 January 1990, revised 
IK June 1990. received in final form 14 .September 1990. I“he 
original version of this paper was presented at the IFA( 
Workshop on System Structure and C onlrol which was held 
in Prague. Czechoslovakia during September 1989. The 
published proceedings of this IFAC Meeting may be ordered 
from; Pergamon Press pic, FIcadington Hill Hall, Oxford 
0X3 OBW, UK 11115 paper was recommended for 
publication in revised form by Associate Editor V Ku^era 
under the direction of Editor H. Kw'akcrnaak 

t Dipartimento di Sistcmi cd Informaiica, Umvcrsiia di 
Firenze, Via S.Marta 3-.SO 139 Firenze. Italy. 

t Industrial Conirol Unit, University of Strathclyde. 
George Street. Glasgow GI lOE. U K 

h Author to whom all correspondence should be 
addressed 


approach to the prohleni In this way, the solution is 
obtained by hrsl. solving a spectral factorization problem; 
and. next, linding the minimum degree solution with respect 
to a ‘ dummy ' polynomial matrix of a pair of bilHteral 
Diophuniine equations. Ihc spccihc ‘’minimumHlcgree'' 
properly that identifies the required solution will be made 
prcci.ve 111 Section 2. 

Hie problem was previously addressed by Kuikra (19H3) 
for .sciiliir input plants and comRlelcK reachable pairs 
(q>. C/) Becnusc of these niiher irNtnclive assumptions, the 
volution can be obtained in terms of a single Diophantine 
equation (KuCeru, 1983) In Section 2 it is shown that, in the 
general case, two bilateral Diophantine equations must be 
solved simultaneously Another related aminhulion is 
Grimblc (1987), where the |>olynomiHl solution lo the 1,0 
rror/iavm legulator with complete stale information was 
given lor the divcrete-imie case 

One of the reason.v for considering a pdynomiul solution 
lor the standard dctcrmmiHiic LOOK problem is in show that 
Kiccaii-hused and polynomial meihinJs are fully conceptually 
equivalent, as far as steady-slate (semi-inhnilc horizon) 
results are concerned In particular, .stabilizability and/or 
delectiibiliiy requirements m the Riccuti equation approach 
are replaced by conditions on the stability of grcalcat 
common left and right divisors of polynomial maina*A 

Ihc reader is referred to Kufx'ra (1979), whose notation is 
adopted hcrcalicr as much as pimihlc considering the 
differences between the discrete and continuous-time cases 
For any real raiKinal mainx R{xj. R’ix) :^ Further, 

for any fKilynomial mainx in the indeterminate s the 
following notations or definitions arc assumed hereafter: 
JP{\) denotes the degree of Pis), /’(a ) is said to tie 
row-reduird if the matrix of Ihc coefficients of the highest 
flower of A in each row of /’(a) has full row-rank; similarly, 
T(v) IS said to Ik* column-redturd if the matrix of the 
cm-flicicnis of the highest power of a in each column of P{x) 
has full column-rank; a square polynomial matnx Pix)» 
P,y^'' + P^s'' ’ 4 A P^ IS said lo hi: regular if its leading 
matrix coefficient F,, is nonsingular Any regular polynomial 
mainx is both row-rcduixd and lolumn-rcduccd The 
opposite implication is m general false. 

2 Main resulLv 

As is well known, the problem (1)- (.3) only depends on a 
completely observable subsystem of (I) obtainable via 
Kalman's canonical decomposition Hius, from the ouinct 
a.ssume that 

(A 1) (<^, //) IS a completely obikcrvablc pair 
Hereafter all quantities arc assumed lo be Laplace 
iran.sforms If y(i) denotes Ihc output of (1) due to jr(0) and 
the input signal is denoted by u(j ), 

y(x) ^HA ‘(j)|ji(0)-f (4) 

where A (a ) and B arc the following polynomial matrices 

A(i) (5) 

( 6 ) 
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Hereafter, for the sake of simpfictty, the urj^ument i wili he 
omittciJ unktis it is rc<|uircd to avoitl pcmihlc confusion. 1>ie 
quadratic coat (.>) can he conveniently rewritten as 

+ <7) 

f^t ufi also rewrite (4) as follows 

y(t) - ///4 ^ '(.i)u(i ) (8) 

where '(i) IS a righi-cc^prime (re) column-reduced 

matrii-fraction descripiKin of A 'ff. Hence, 

i 1, 2. m, where cknotcH the ailumn-dcgrcc of 

the ith columns of (Kailath, 

Substituting (H) in (7), obtain 


J 


1 ' |</M, > flr'V.w.M, 'u 

'r(n)4x’((IM 
4 r'(0M -qi./t 'x(0)|ds 


(9) 


that this property holds true), by using the Residue 
'^rheorem, it is easy to prove that i& identically zero. This 
follows from the fact that 3,,Z* < 3,,E, and hence Z*E ’ is 
a strictly proper stable transfer-matrix, and that u( ) and x( ) 
arc in Lj. Thus, minimization ol J amounts to minimizing 7,, 
Finally, premulliplying both sides of (15) by £* and taking 


into account (10), one gets 

E'X ~ ZB - (21) 

The following lemma summarizes the above discussion 
Lemma 1 Provided that 

(i) (13) and (21) |or (13) and (I6)| admit a solution 

(X. Y, Z) with 3„Z < a^E'. 1 ^ 1.2 _m. 3X - 3Y ^ 0 

and X nonsmgular, and 

(ii) /j. -1 7 1 is bounded; 

the solution of the LOOK problem is given by 

uis)^~X ‘V.r(v) (22) 


with X and Y specified in (i), and correspondingly, 


where Ai*:^iA/y and Ut £(i) lie a 

Hurwit/ pilynomial matrix solving the following xpectrai 
faciorizaiwn problem 

£•£ f (10) 

Since Ay is column-rcduccd, ByAy ' strictly proper. >0. 
from Ku£era (1980) it follows that E is column reduced 
By using (10) and adding and subtracting 
x'(0)/t *^,ByE '£ 'i(O) in (M). ohiuiii 

7 - 7, 17, (11) 


with 




I r 
J r 


f^L dy 


Av 


w« 

, m'(0)A •(/ 

2/r/ J 

E •firi^A '.r(0) f EAy ‘u 


Vr(0)dv 

( 12 ) 


Note that 7, does not depend on u In onler to .simplify the 
above expression lor 7,. let us consider the following 
bilateral Ihophantine equation 


/' •V 4 ZA - /fTT, (13) 

It is temporarily assumed that a solution (K. /) of (12) exists 

with < 3,^E*. i 2. m, where 3^Z denotes the 

row-degree of the ilh row of /. Under this assumption. (12) 
becomes 


L Kx(>r) 4 (E - YB.)Ay 'u 4 E Vt(0) (14) 

Further, let us tcmpofunly assume that the following 
p^ilyruimial equation can be jointly solved along with (13) 

XAy^ YBy^ E (15) 

Substitution of (15) into (14) gives 



/, - (K» + Au)-f E •Zj((I) 

(Ifi) 

Consequently the cost index 7, can be split into the following 
three component.^ 

7, -7,47,4 A (17) 

A 

1 f'“ 

. .v'(0)Z*A 'E ’/.((ndv 

2Jt/J 

(IS) 

A 

r ((Vt+A m)*£ */j(0) 



+ .t’(0)/'£ '(Ki + Am)) dt 

(13^) 

A 

1 f” 

, (Vj + Am )•(»■( + Am) di 

J 

(20) 


where 7, dcKS not depend on u Further, if A' and Y arc 
constant matrices, i c. SX ^ cJV 0 (Lxrmma 2 below verifies 


A condition under which (i) of Lxmma I i.s fulfilled is given 
by next lemma whose prend is given in the Appendix 

L^mma 2. Ixt the greatest common left divisors (CiCLDs) of 
A and B in (5) and (6) be strictly Hurwilz Ihen, there is a 
unique solution (X, Y, Z) of (13) and (21) |or (13) and (!5)] 
such that 

3„Z^:J^E\ 1-1.2, ,m (23) 

JX - 3Y - 0, and X nonsmgular □ 

The unique solution (A". Y, Z) referred lo in Lemma 2, will 
be called the minimum row-degree solution w r.l Z. 

Boundednevs of 7, 4 7, is clearly guaraniecd by ihc 
stability of the closed-loop system This, in turn, il the plant 
has no unstable hidden modes, is fulliiled if and only if 7: is 
strictly Hurwilz, In (act. det /■ is proportinii.il to the 
churadcristic polynomial of the closed loop system made up 
by the plant W.>A, ' together with the control law (22) Ihc 
next lemma, whose prixif is re|xiricd in the Appeiulix, gives 
a sufficient condition lor E to be strictly Hurwit/ 

Lemma 3 If (A I) holds then the speeiral laclor E is strictly 
Hurwitz n 

The previous lemmas show that the LO output regulation 
problem can be solved provided that (tfi, H) is a completely 
observable pair and the GC’LD's ol A and B are stable Ihis 
IS the same ns assuming that the given plant (q>. G. //). 
which in general need not Ix' completely observable, has all 
Its observable unreachable eigenvalues stable The results 
arc summarized m the following theorem 

Theorem 1 Consider the LO output regulation problem 
(1)“ (3) for the plant 2 - (<t>. G, H) Then, 

1. The problem is solvable if and only if the CjCLDs of /4,, 

and /J„ are stable, where A^y :~ .^I -- <t>„ and ®nd 

IS a completely observable subsystem of 
1 obtainable via Kalman's canonical olrservabilily 
dccomjxisiiion of 1. 

2. Provided that the solvability condition is fulfilled, the 
Optimal input signal i.s given by (22), where A' and Y are 
obtained by first solving the spectral factorization problem 
(Ul) and next finding the rfiinimum row-drgree solution 
w.r.t Z of the pair of bilateral Dinphanlme equations 
(13) and (21) (or (13) and (15)). viz. 3^Z < 3^,E\ 

3. Ihe overall closed-loop system us asymptotically stable if 
and only if the plant 1 has no unstable hidden mixlcs. □ 

11 is interesting to explore the amnection between the 
polynomial solution (A^ Y', Z) given in Theorem 1 (part 2) 
with the classic Riccati-hased solution of the LCX)R 
probkm. This is considered in Theorem 2. whose assertion 
can be easily proved, by showing that the triplet (25) fulfills 
(13) and (21) [or (13) and (I5)| and satisfies the row-degree 
inequalities 3^,Z < d^,E*, i = 1. 2, . . m 
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Theorem 2, Lci ihc pUnt 1* (♦. G. W) be st«tnU 2 Ahlc and A GCLD of A nful H 
detectable. Also let F denote the unique lynimetnc 

oon-negauve defrnite solution of the matnx algebroK RiccHti [ ^ 

equation | U I 


'GT + 'l^, -0 (24) 

Then, the minimum row-degree soluium w r t Z of the 
Dtophaniine equations (13) and (21) |or (13) and (15)| is 
given by 

XY^G’F Z-fltP n (25) 


which is stable. Thus, according to Ixmma 2 the problem is 
scdvahle. and. accorihfig to ITicoiein 1 (ptin 3), the resulting 
LO optimal Iccdhaci siabili/es the plant being the only plant 
hidden eigenvalue X ^ - i We «|!M> find: 


3. />urrux5ion and examples 

The polyiKimial solution to the L(JOR problem given in 
Mosca and Nistri (19119) looks like a direct translation into 
Ihc discrclc-iimc context of the one covered m the present 
paper. In fact, m both cases the soluliDn->-if it cxisiv -is 
given in terms of a spectral factorization problem and a pair 
ot bilateral Diophantine equations. NcverilKlcss. the degree 
constraints for the discrete-time case turn out in he ddTercnt 
from (23). 13ie discrete-lime case degree constraints, in the 
present continuous-time context, would Iran.slaic as follows 

3Z V 3Er (26) 

This condition iv weaker than the row-degree inequality (23) 
If £ IS regular—a property that i.s fulfilled in the standard 
discrclc-iimc case discussed in Mosca and Nistri fl989>—(23) 
IS equivalent to (26) The next example shows (hat in (he 
continuous-lime case, where £ need noi be regular (26) has 
to be replaced by (23) in order to gel the desired constant 
solution (.V. >') of (13) and (21) 

Examplr I Let 


1 - 1 0 


[ 0 ”}: 

1 [o fil 

[ 0 0 1 



'P, 

"’1(1 1 r 

“ (» I 


A possible choice for and H , is 


i 4 1 

0 

0 


/i > - , 

0 

1. ’ 

0 0 


Since ~ A, i.s llurwit/. one can set £ - A .. 

ronscqucntly. the solution in Theorem 1 (part 2) is as 
follows 

X ^ - T - 0, .. 

On (he contrary', (26) docs not yield either a unique solution 
of (13) and (21) or necessarily 3X - 3Y 0 In faci, it can be 
checked that 


1 

0 

Y - 

0 

0 

0 

/ - 

0 

. -1 

0 J’ 


.3 - 1 

4 i I ■ 

- 1 

1 


is one possible .solution of (13) and (21) fulfilling (26) [,] 

Inhere arc in general, nvo bilateral Diophantine equations, 
viz. (13) and (21) (or. equivalently (13) and (15)1, 
be solved with the row-degree constraints (23) in order to 
finding the LO optimal fccdback-gain matrix h - X ’K In 
particular, the reader is referred to Mo.sca et aJ. (1990) and 
Hunt et ai (1987) where ihc need to solve two Diophantine 
equations is thoroughly investigated Nevertheless an 
example is now presented to aid our understanding of this 
problem 

Example 2. Let 



// = I1 l|; 9^,-L ^, = 1 


Notice that (4>, G) is not completely reachable, whereas 
(tp, H) is completely observable. Wc find 


p-' M; 


1 0 .5 + i J 

loj 


and. via spectral fnciori/aiion, £ *“ .i t V2 Furlhci . Aj «“ 
I I; R? [I t)]. £• > 4 V'2. which implies 3Z “ 0 

(13) and (21) |oi (D) and (15)|, give 



V [ V, - \^2 4 I. ,v, - 

2(2V2 - 1)1 
7 1 



Hence. 


t ... ... V2 4 I 


2{2\/2 - I) 


and 



q> 4 (ih 


2 (2\f2 ■ I) 
7 

J 


(15) alone yicld.s A' - 1. v, V2 4 1, V^2 4 1 Howcvci. 

ii diHTs noi provide any informiition on v,. and Zj 11 


( one /icriom 

1111* dctcrminiMic continuous-time I (J output regulation 
problem has been solved via spectral facloruralion and a pair 
of bilateral Diophaniine cquaiion.s .Slabilizabiliiy and/or 
detectability requirements in Ihc Riccati equation approach 
were replaced by conditions on the stability ot greatest 
common left and righi divisi^rs of polynomial malriccs. 
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Apptndii 

PrtHff of l^mma 1. Il is known (Kuc4ra, WM) that (Li) and 
(21) are solvable prfivided that the OCLDs of A and B arc 
Ktrictly Hurwiu. All the Miluiions of (IJ) and (21) arc given 
by; 

Y^Y,,^TA- Z ^ Z,, 't:* f (27) 

where (A',,. Y^, Z„) is a tioluiion of (13) and (21) and T isi any 
polynomial matrix of compatible dimensions. By the Division 
Tlicorcm for Polynomial Matrices (Kailath, IMHO) there 
exiulK a unique pair (Q, R) such that 

Substituting this cxprctision in (27), one obtains Z - 
H ^ E*((J - T). Ihcreforc the minimum row-degree solu 
tion of (13) and (21) w.r.i Z is obtained by tacking 7 Q in 
(27); 

X X^, - QB. Y * y;, + OA; / - /if (2H) 

It remains to be shown that 3X - 'Diis can Ik 

concluded by lirsl noting that from (10) 

3,,A.. (2^) 

Ihis can be seen by considering that since 3 ^B^ * and 

> 0 . 

23,,t: - - diAt^„A,)„ - 2J,,a, 

where (E*E)„ denotes the ilh diagonal entry of E*E. F-'rom 
(13), it follows that 

which, in turn, by non.singulurity of implies that 3Y - 0 
Similarly, from (21) it follows that 

3jh:*X)-3j:^ 

and again, arguing as above, one finds that 3X ~ 0 Finally, 
by using (21). (29) and the fact that 'P^ -0. from (21) obtain 

3,,{E*X)^^d,,Al 


Ficncc, since E* and A* arc row-reduced, it follows tFiat X is 
noftsingular 

In Mosca et al. (1990) it is shown that tFie solution of (13) 
and (21) cotncidt with that of (13) and (15) 

Proof of Lemma 3, Finit, it will be shown that complete 
observability of (<I>, 6) implies that HB 2 and A-, are right 
coprime (re) In order to prove this, we begin by noting that 
by PBF1 test (Kailath, I9H0), cx^mplcte observability of 
(^,7/) IS equivalent to H and A re Tins, in turn, implies 
that H and A^ arc re, if A A, '£1, with A^ and B, left 
coprime (Ic) In fact. A = AA, and B = ATI, with A a GCLD 
of A and B Hence, for some p<ilynomiaJ matnccs U and V, 

/ -(M-K V//- (f 7 A)A, + 1/77 

We finally show that if 7/ and A | arc re, then HB;. and A , arc 
re. In fact, consider the transfer-matrices 

HA, 7J, ^HB.A, ' 

for which ^det A, - c3det A 'Die expression on the LFIS 
can be minimally reuli/cd in state-space form with a state of 
dimension equal to i^dctA, since 7/ and A, arc re Thus. 
HH 2 A 2 ' must be also realized in minimal form having the 
same stale dimension Ffcnce. we conclude that HB^ are A. 
are re 

Flaving proved that 7/71, and arc re, we next show ihai 
del 7.'(/£t>) # I), Vru € Jff and hence that L is strictly Flurwitz 
In order to prove this, we note that f/fl. and A, re implies 
that, for - (/ J 'Pj ’ and ^ , B. - qJiB. 

and nonsingularity of (f; and i/,,. are re. In 

fact for some polynomial matrices 0 and V' 

I UA, f VHB. ^ ( U(f ^, ' )A , f ( V ^ ')//. 

We now prove that del 7,(yci>) #0, Yu> f 'M by contradiction 
Suppose there exists u c JT', u # 0 and a) f such that 

0- ||7;(/u>)u|r'- ||A,(ya))w||'4 ||«,(;,„)ii||' 

Ihis implies that A^(/(i/)u- Bs{)(it)u - 0 Bui since B^ and 
A* arc re, for some polynomial matrices U and V. 

(f/A , 4 L//j)u -/u 1 ) This contradicts singularity of 
Lin'o). ‘ ' □ 
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Guaranteed Properties of Gain Scheduled 
Control for Linear Parameter-varying Plants* 

JEFF S SHAMMAt and MICHAEL ATHANSt 

Ke> Words —Gain scheduling; parcinu'ltr'Varying sysicms, robuMiicsv, iimc^varying syMcms 


Abfftract —Gam scheduling has proven Ili be a successful 
design melhodology m miiny engineenng applicaiions 
However in ihc absence of a sound theorciical analysis, ihesc 
designs come wiih no guaranices on the robuslncss. 
performance, or even nominal siabiliiy of the overall gain 
scheduled design 

rhis paper presents such an analysis for one iy|X‘ of gain 
scheduled system, namely, a linear parameter varying plant 
scheduling on its exogenous parameters C ondiitons arc 
given which guarantee that the stability, robustness, and 
performance proj>erties of the fixed operating fH>ini designs 
carry over to the global gain scheduled design llicse 
conditions confirm and formali/e popular notions regarding 
gain scheduled design, such as the scheduling variable should 
‘vary slowly." 

1 Inlraduition 

1.1 rrohiem staiemcru (iain scheduling (see eg Stein, 
l^HO) IS a popular engineering method used to design 
controllers for systems with widely varying nonlinear and/or 
parameter dcpirndenl dynamics, i c systems for which a 
single linear timc'invariant model is insufficient. I'he idea is 
to select several operating points which cover the range of 
the plant’s dynamics Then, at each o( these ptnnis. the 
designer makes a linear timc invanani approximation to the 
plant and designs a linear compensator lor each lincari/.cd 
plant. In between operating points, the parameters (i.c 
"gams") of the compensators are then interpolated, or 
"scheduled," thus resulting m a global feedback 
compensator. 

Despite the lack fd a sound theoretical analysis, gam 
scheduling is a design methodology which is known to work 
in a myriad of operating control systems (e g jet engines, 
submarines, and aircraft). However, in the absence of such 
an analysis, these designs come with no guarantees More 
precisely, even though the local point designs may have 
excellent feedback properties, the global gam scheduled 
design need not have any of these properties, even nominal 
stability. In other words, one typically cannot assess a priori 
the guaranteed stability, robustness and performance 
properties of gain scheduled designs Rather, any such 
properties are inferred from extensive computer simulalnms. 

* Received 10 February IV8*^; revised 14 Novcmt>cr 1989; 
revised 18 June 1990; received in final form 22 August 1990. 
Tlie original version of this paper was presented at the IFAC 
Symposium on Nonlinear Control System Design which was 
held in C'apri, Italy during June, I9K9 The published 
proceedings of this IFAC Meeting may be ordered from: 
Pergamon Press pk, Headington Hill Hall. Oxford 0X3 
OBW, UK. This paper was rcctimmcndcd for publication in 
revised form by Associate Editor R. Curtain under the 
direction of Editor H. Kwakernaak. 

t Department of Electrical Engineering, University of 
Minnesota. Minneapolis. MN 55455. U.S.A Author to 
whom all correspondence should be addressed. 

I Department of Electrical Engineering and Computer 
Science. Massachusetts Institute of Technology, Cambridge, 
MA 02139, U S A. 


I'his paper addresses this issue of guaranteed properties 
for one L'la.ss of gam scheduled I'lvnirul systems, namely, 
linear parameter-varying plants lliis class of systems is 
imporiani since ii can Ise shown that gam schedulrd conind 
of nonlinear plants takes ihe^ form of a linear panmieier 
varying plant where the 'piiramcicr*' is aclually a reference 
lra|ectory or some endogenous signal such as ihc plant 
output (cl Shummu and Alhans, I9H8, 1989) One example 
of a phywal system whose (lincari/ed) dynamics lake the 
lorm ol a pnrameicr varying plain is an aircrafi, where the 
time varying parameter is typiciilly dynanoc pressure (e g 
Sicin rt ai . 1977) 

( onsider a planl of the form 

i(r) - A(0(0)i(0 + B(N(f))MD. 

y(/) - VUHtiMt) 

I'hesc equations represent a lineai plant whose dynamics 
dej>end on a vector ol time varying exogenous purumeters, 
0. which take (heir values in some prcH‘iilx''d set 0(0 < H. 
(rain scheduled conlrollcrs lor such plants typically are 
designed as follows First, the designer selects a set ol 
parameter values, (0J, which represent the range of the 
plant's dynamics, and designs a linear timc-invanani 
compensator for each llicn, in between operating points, 
(he compensators arc mtcr|H>laicd such Ihiil lor all Iro/en 
values ol the parameters, the closed lixip system has 
desirable feedback properties, such as nominal stability, 
robustness to unmcMJcled dynamics, and robust performance 
(Fib 1) 

Smex the parameters are actually lime-varymg, none of 
these properties need carry over to the overall lime-varying 
closed Wxip system Fven m the simplest cawr of nominal 
stability fi.c no unminJcIcd dynamics), parameter lime- 
variations can be dcsiabili/ing 

In (his paper, conditions arc given which guarantee (hut 
the clowrd IrKjp system will retain the feedback properties of 
the frozen-time designs, 'rhese conditions fonnali/e various 
heuristic ideas which have guided suaxssful gain scheduled 
designs. For example, one primary guideline is "the 
scheduling variables slniuld vary slowly with respect to the 
system dynamics. ’ Note (hai this idea is simply a reminder 
that (he original designs were bused on linear time-invariant 
approximations to the actual plant In this sense, (he«e 
approximations muxl fn; sufbcicnlly faithful (o the true plant 
if one expects the global design to exhibit the desired 
feedback properties In fact, it is this idea which proves most 
fundamental in the forthcoming analysis 
The remainder of (his paper is organized as follows Ihis 
section eJosev with the mathematical notation to be used 
throughout (he paper, Section 2 addresses the tsiucs of 
robust stability and nibust performance The formal problem 
slaiement is given in Section 2,1 Section 2.2 presents 
background material on Vi^tcrra integrodiflferential cqua- 
iions. In Section 2.3, conditions are given which guarantee 
time-varying robustness/pcrformance given frozeniime 
robustness/pcrfontiance. The conditions arc presented from 
both a state-space and mpui-output viewpoint Finally, 
concluding remarks arc given in Section 3 
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F-Kt 2 General Mock diagram (or robustnesfi/performance 
analysis. 


F‘l(i 1 A linear plant M^heilulirig on cxogt-ridUN parameters 


12 MalhemuUcal ruHatUm Scimc notation regarding 
Htandard concepts for analysis of feedback systems (e g. 
Desocr and Vidyasagar, 197.^; Willems, 1971) is e.sliihli.Hhed 
;i? denotes the field of real numbers, ‘ the set 
{ft .1^1 f the set of n x I vectors with elements in 

and the set of n x m matrices with elements m 

A,j denotes the lyih element of the matrix A [ ( denotes Isoth 
a vector norm and its induced matrix norm. 

Let t - lift’* f denotes the Laplace translorm of f. 
„ denotes (he truncation and exponential weighting 
operator on f defined hy 


J] iiiul y. denote the standard Letn^sgue function spaces 
of integrabic and eKsenlially (Hiuiuled incasurable functions, 
rcspcclivelv. ^ denotes the .set of measurable functions, 
r such that 


||f|| sup |f(r)| • ^ 

ri * ' 

/4{ir) denotes the set whose* elements are of the lorm 
+ r'O; 

where /, .i^, t, ■* 0, J] r iind 

II/III i/„(0c '"Id/ / V i/;c '"i- * 

denotes the set of n x m matrices whose clcmenls 
arc in .vVio). Let A e and let A t he defined 

as A' ■ l|A„(|^,„,. rhen ||A(| |A'I •‘■^(‘0 i‘»d .-/'"‘"'(o) 
are uclincd as the set of Laplace transforms ol elements of 
.irf(o) and .irf" respectively f or further details on 

,vif(fi) and .nf'’'"^'(o). see C'allicr and Dcsoer ||97HI and 
Desocr and Vidyusagar (I97.S) 

2, Rohus( xiahiiity and robust prrformum t’ 

2 1. Probkm stairment. SuptxKse that one has earned oui 
the gain scheduled design procedure discussed in the 
iniroductiun for .some linear parameter-varying plant Then 
for any frozm value of the paranieicr-vccior, one has 
designed a feedback system which has dcsiruhlc nominal 
.stability, robust stability, and robust performance properties. 
Since the parameters arc actually time-varying, these 
properties may Ik lost. 

Now a stuniliird practice in robust control theory is to 
express robust stability and robust peTormance requirements 
as the maintaining of stability m the presence ol stable linear 
uncertainties throughout the feedback ltH>p (e.g. Doyle, 
1982, Doyle ft ai, 19H2) ITic original control system bkick 
diagram then may be transformed into the form of F'lg. 2. In 
this figure, H(W) represents a tinile-dimcnsional parameter- 
varying linear system, and A repre.seiits a hliKk diagonal— 
posiablv intiniic-dimcnsionul—stable linear .system which 
depends on only the uncertainties. In this framework, 
satisfying the variou.s robust .stability ami robust performance 
specihcaikms is equivalent to the feedback system of Fig. 2 
being stable for an appropriate class of admissible 


uncertainties (see Doyle, 1982; Doyle ei a! , 1982 for 

details). 

Employing ihis equivalent representation of design 
specifications. it then follows that the feedback diagram of 
Fig 2, being a product of a gain scheduled design, is stable 
for all frozen parameter values. Furthermore, .stability of Fig. 
2 for iimf-oarvi/iji' parameters implies that the robustness and 
performance properties are maintained in the presence of 
parameter time-variations. 

Lei H(ff) have the following state-space realisation: 

«(!)- A(N(r))^(0-^ll(ff(^))e(/)- 

y(^) -C(ff(r))i(0 

Furthermore, let the inpui/uutpui relationship of A be given 

by 

y'(/) I A(/ - T)y( r) dr 
llien the feedback equations arc 

i(t) A(f^(t))x(/) + [ B(9(i))A(7- r)(:(f^( r))m( r) dr 

(I) 

Phis equation represents a type of linear Volicrra 
mlcgrodiftcrcnlrii) equation (VIDL) In this section it is 
shown that the stability of (1). hence the desired robustnes.s 
and performance properties, is maintained in the presence of 
sufficiently slow parameter lime-variations. This generalizes a 
well known result for ordinary diffcrcnliul equations (e g 
Dcmkt. 1969) 

2.2 Volierra tniefi;rodifferential etfuations Before time- 
varying robustness and performance arc discussed, some 
facts are presented regarding equations of the form m (1). 
Fvaluuting (I) along any parameter vector irujeciory. one 
has that 

1(0 - A(/)i(r)4 I B(f)A(/- T)t(T)t(r)dr. (2) 

where A, B and C have been appropriately redcrined. Tins i.s 
the general form of time-varying VfDEs and will be the 
object of all of the forthcoming analysis Note that any 
conditions imposed on (2) can be translated immediately into 
condition.s on the parameter-varying (1). 

It WHS staled that equation (2) falls under the class of 
linear VIDFs. In fact, under assumptions to be stated on A, 
(2) actually represents a combination of VIDEs and linear 
dclay-difTcrcntial equations ITiiis. both types of equations 
arc treated under the .same framework. VlDELs and their 
stability have been studied in. for example. Burton (1983), 
('ordunennu and Laksmikantham (1980), Miller (1971), and 
delay-differential equations in Corduncanu and L^aksmikan- 
tham (1980), Driver (1977) and Hale (1977) 

In this section, a.ssumptions on (2) arc given, a definition 
of cxp^mcntial siahility is inirtxJuccd, a sufficient arndition 
for exponential stability in the case of lime-invariant A, II 
and C matnccs is given, and a perturbational result 
(ime-invariani VfDEis is presented. 

Consider the VIDE 


i 


i(r) - A(r)a(f) B(f)A(f --t)C(t)i(t) dr. 


with initial condition 

) - tpM 


\rU) 

U(6: 




t > I 




(3) 

( 4 ) 
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Note ihflt an initial ctuidiiion for (3) consists* of both an 
initial time, and an initial function, 

The following assumptions are made on (3): 

Assumption I The matnccs A; l#"* -• B; it" *"** 

and C; it*arc globally tniunded and LipschiU 
continuous with LipschiO: constants L^, Lg,, and , 
respectively. 

Assumption 2 For some o a 0, At 
VlDEs containing an integral operator as in assumpiHin 2 
have been studied in Corduneanu (1973), Corduneanu and 
Luca (1975) and Luca (1979) and references are contained in 
Corduneanu and Laksmikaniham (1981)) In case of 
time-invariant A, B and C matrices, solutions to (3) can be 
cxplially charactcnzcd as follows: 

Theorem 1. Consider the time-invananl VIDE 
i(r) - Aa(r)+ j BA(t - t)Ci( r) dr Kf). 

Ju 

I>I„. ft If.. (5) 

with initial condition (4) under assumption 2 The unique 
.solution to (5) is given by 

a(f 4 f„) ^ R(t)i(/,)) 4 I R(r - r)(f(r 4 4 F( r 4 r„))dT. 


( hi 

BA(f 4 r„ T)CX r)dT, r -0, 

I 

and R, known as the resolvent matrix, is the unique matrix 
satisfying 

H(() = I + I (aH(i| ♦ I BA(r- <It, 

/ •(), R((I’)=>1 

Froof Sec Corduneanu (1973) and Corduneanu and Luca 
(1975) ■ 

A definition of exponential stability for VIDLs is now 
inircvduced. 

Dcfininon 1 Consider the VIDE (3) with initial condition 
(4), This VIDfi is said to be cxtHinentially stable if there 
exists constants m. A, /J »0 where X such that 

|i(f)|Smf Vis I,, 

It is stres.scd that the constants m. A and p arc independent of 
the initial condition (0, /,,). 

This definition implies that not only docs the state decay 
cxp<^nentiall>, but also with a magnitude which is 
proportional to an exponentially forgotten initial function 
llic convention that A implies that the solutions cannot 
decay faster than they arc forgotten. Furthermore, this 
inequality will be needed in subsequent proofs (cf. Theorem 
2 ). 

The following theorem gives a sufficient condition for 
exponential stability for timc-invarianl VlDEs 

Theorem 2. Consider the time-invariant VIDF* (5) with 
initial condition (4). A sufficient condition for exponential 
stability is that there exist a constant ft > 0 such that 

A-BA(,r)C) 'e jir"'-(-2/^), (6) 

(7) 

Proof It is first shown that the resolvent matrix R is 
bounded by a decaying exponential. From the dchnilion of R 
in Theorem 1, one has that R satisfies almost everywhere 

R(/) = AR(f) + [ BA(/ - r)CR(r) dr, r >0. (8) 

Taking the Laplace transform of (8) shows that 
R(j) = (il-A-BA(r)C) 


It ffiHows by hypothesis that Rf ^"(-“2/1). FurtheniHiie, 
It may be seen from the deftnilion of R in Theorem 1 that R 
contains no impulses, hence R c: J/'i Fnnn (8), ii fidkxws that 
R e These ixiro imply that R e Now define 

Wm'S'RUJc'* 

Then R'e .rf"‘"(-/J) l»ec«u»c R « jrf*’- 2^J) Usin* the 
same arguments as above along with 

R(i)-(A + /JI)R'(»)+ [ BA(t- rk'"’ "CR’(i)ilr, i >0, 

It follows that R' and R'^J/’,. hence R'f Thus, it 
follow's that iheie exists a constant A,, for example 
IjR’jjy^. such that 

Now recall that the solution to (5) is given by 
nit 4 r„) - R(i)x(f,;) 4 I R(/ - t)FI i 4 r„) dr, i * 0. 

■'D 

where 

i I r*'* 

F(t4r„)'‘^ I BA(/4/„ - T)1XI) dr, r>(l. 

■'ll 

It IS now shown that F is also Iroundcd by u decaying 
exponential Rewriting the dclimtion of F. 

+ J BA(( + i„ rU-'"'’'" "Cc ’>( 1 ) 1)1 

•-C '*| 'BA«+r„ T)f''.'Cc '>(r)i1t 

Since At .^'’"'’(--2^1), it follows that there exists a constant 
A,, for example A. ^ |B| !|A||,^j IC'I, such that 

iif(M („)is*,c '”irr,„ „0ii,. 

Using the ex|K)iicnlial Ik>uiuK on R and F to l^ouiid x. 

|l(t -♦ /n)l 

r 4,C '“|»(/„)|4 [ *,C "*,C II If llT 

■'ll 

' *l(l 

which completes the priH)l ■ 

Theorem 2 is novel in that it takes a stale-space iip^miach, 
rather than an inpul/outpul approach, to the robust wtiibilily 
of lime-invariant linear systems. This approach is chosen 
since it corresponds to the original motivation of 
parameter-varying gain scheduled systems. Nevertheless, 
standard results on robust stability can he obtained from ihi.s 
theorem Rewriting R(i), one has that 

R(.i)»(l-(il -A) 'BA(J)C) '(.tl- A) ’ 

Now suppose that A is a stable matrix: thus i •--» 
(.rl-A) ’ e air" ^"(~ 2^) for some /J > 0. Assume further 
that Ae Then 

(.rl~ A) 'BA(r)C)f ■iir'’""(- 2/?) 

Under these conditions, U ^ -2P) if (Desi>er and 

Vidyaxagar, 1975) 

inf |del(l-(.tl-A) 'BA(J)C)| 

HtwM 2/1 

« inf |del (I - C(j| - A) '■A(*))| >0 

a* # #r Zfi 

However, a suDkienl condition for the above equation is that 

|C(( -2/} + )<U)I - A) ‘BA(-2^ + ju()| s y < 1, V,« e m. 

As this amdiiton approaches the standard small-gain 

robustness condition lor time-invariant linear systems (e g 
Chen and Dcsoer, 1982; Doyle and Stein, 1981) Unlike 
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pfcvkms reBulU, hnwcvcr, T’hcorcm 2 given a quantilativc 
indication of the rate of cxpcincmial decay of the 
Kiale-variabten 

Iliin lection concludcK with a proicntaUon of a 
ficriurhational rci^ult for time-invariant VfDfls 

Thtorrm 3 ('onnider the following perturbation of the 
VIDE (5) 

af/)*>ia(Of f BA(f - r)C*(t)dr-p {gi)(0, r>t„. (9) 


Thin, 

WOI ((*. +1 >- (i + y)c '") 

s*,(i + (t. + *)/)c 

<irf 

Thin, it is seen that k < y = implies exponential 

stability. Furthermore, 


where I is an integral operator on a Ixl 

r (rI - A -- BA(.t )€) ' e .air" ^"(~ 2p}, 

Af 

for some ft > (I. Assume further that there exist constants 
k > 0 and a ^ p such that 

|(ipi)(/)|s/t Vr,-0. Vi€,U 

Under these CAinditions, there cxistM a y -(I niich that the 
VfDE (9) is exponentially stable for k * y. 

f^roaf. I.XI (9) have an initial condition (4). Define 
x(/) w'i(/ t /„). As in Theorem I, one has that 

lit) « R(r)*(l) 4 f R(/ - t)(F(t 4 /,)) 

Jri 

4 (|pi)(T 4 I,,)) dr. I >0, 
where R is the resolvent matrix and 

Fi/ 4 [ BA(/ 4r„ - r)CXT)dr, t -0 

J{) 

As in the prcKif of Theorem 2, there exist /c, and k ^ such that 


li(0|s*,(i + (1I») 


2,3 Rohuitness and performance of .dowly-varying linear 
systems. In this section, it is shown that if the timc-varymg 
VIDE (3) is exponentially stable for all frozen values ol time, 
then it is exponentially stable for sufficiently slow 
timc'vanalions. In terms ol the original motivation of 
guaranteed properties of gam scheduled control sy.stcms, this 
means that robust stability and robust performance are 
maintained provided that parameter variations are 
suflicienily slow 

Before prtKceding with the main theorem, some 
us.sumplions and definitions are given 

Assumption 3 Consider the lime-varying VII)! (3) under 
assumptions 12, The matrix functions A. B. C and A are 
such that for each $ e \ 

.r — (,iI - A(5) - B( £ )A(.t »C( £)) ' f .V” ” ”( ■ 2ti I. 

Ae 

Via Ihcorcm 2 , chese two conditions imply that for each 
Jfthe limc-invariani VIDE 


IK/ +»„)|r..*,i. 

U,sirig these bounds to hound z, 

|i(/)h.*,c '‘‘|i((l)l + ( *,r " 

+* II I*..„»ll,)dr. 

By definition of the W operator 

iri*'.,.„...*ii,.-''ir'*‘..,„./.»ii*s“p ,1' '‘»t5)i 

It Bin, f I * 1)1 

S.C '"( ,sup |c *'0(£)|+ .Slip |c '’«(£)|) 


Ihas. 


c^)i(r)!%A,(l-p(*4^,)r)lir,,,^,i^ll. 

4 ( 4 ,* sup 

ft «*|n.t) 


Since the right-hand side of the above equation is a 
nondccrcQsing function of time. 


■(r) = A(^)x(r) 4 B(i:)A(r-- T)C(.;)x(r) dr, / ■ i„. 

fi 

(ID 

IS exponentially stable as in Definition 1 It is further 
assumed that this exponential stability is umlovm in i; lhai 
IS, there exist exponential stability constants (m. A,/l) lor 
(I I) which are indcfKndcnt of i- 
Note that in the case of gam .scheduling, one may use 
Theorem 2 to verify exponential si ability for all frozen 
parameter values, hence lor all time Furthermore, if the 
parameters lake their values in some compact set. then the 
exponential stability is umlorrn. 

De/jfiiriofi 2 lx*i assumptions 12 hold. Under assumption 
1, Id kff and kf satisfy Vr e 

!B(r)l--A^. |C(/)|-A, 

Tltcn the measure, K, of the rate ol timc-variaiions of (3) is 
defined as 

Ak" “ E4 i.ff |1A|| ^ fit 

fbe question of slowly time-varying stability of linear 
VfDE s IS now addressed. 


sup |c'**i(f)i■/.*,(I + (* + *,,)/) 

4 I k^k sup |c^*x(|)| dr. 

•'<» t\ 

Rewriting this equation yields 

/'(O r, + lea 4^ /(T)dr. 

-fii 

where Kx and / arc defined in the obvious manner. 
Applying the Bellman-Cironwall inequality (c.g Dcsoer and 
Vidyasagar. 1975), 

/(f) s(»-, +*^c*’'-"'v 
\ r,/ hx 


Theorem 4. C2onsidcr the time-varying VIDE (3) under 
assumptions 1-3. Under these conditions, (3) is exptmen- 
tially stable for suSicicntly small K, or equivalcnlly, for 
sufficicnlly slow time-vanulions in A, B and C. 

Proof Let R^ denote the resolvent maliix associated with 
the frozen-time VIDE (11) Fmm assumption 2 of uniform 
frozen-time exponential stability, there cxi.sts a constant K^ 
sSUCh that 

Similarly, define 

^ k/f It All ft) k(. 

Note that the constants /C, and represent worst case 
values of their frozen-f analogs in the proof of Theorem 2 
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Lei the conUiiion of (3) be (4 k and let r, denote 

■¥ nT. where T is m^ihc conslaot interval to be chosen 
Approximattni; A, B and C by piecewise comtant malnces. 
one has that 

i(0 ^ A(iJ*(f) + j B(IJA(i - !>€(/,)■(f )df 

j - T)C(T)i(f )dr 4 

where 


(|U«)(n (AfO " A(fJ)x(/) 

+ [ (B(;)- B(/J)A(r - t)C((, )»( r) dr 

+ j B(()A(/- t:(f„)|»(r)dT 

Then 

|(|l„»)(/)! KT ir«; ^*11 i„ -. IS 

( h(Kise any f/ c (0, fi) Then using arguments exactly parallel 
to those of the prind of Theorem ,K il can be shown that 

implies that 


ixfrjl 




A. 1 f - 


/I r)| 
2A', ' 




I O' ^ I t/‘ 1/ M ."X I »» ,' It 






where M is dehned in the obvious manner |tl (l(b| Note 
that since A^, I by delinition. one has M • I in general 
Ihis iKiund on x further implies ihiii 


I rf*!!#'"’' '•'up |c ' ^'xd) 

’ Ill. il 


:( sup |e sup |e ) 


' max c 


sup Ic ''1(^)1. 


l>e main idc« behind Theorem 4 hi as follows. Tlie 
time vary'tng VIDE (1) is ApfiroKMnated by a pieeewMe 
conjutttiH VfDE which is pmxwita: exponenbnUy liable Thu» 
on exch InirrvaK the ttmne•varying VIDB ix tfecomixwcd into 
a amsinni pan and a time-varying pcnurbation Using 
Ibeorem 3. ihc solution will decay provided that the 
pict*cwise amAiant approximaiKms are sufficiently aixurate 
over suflicicnily long intervah. which, tn lum, is guarnniccd 
hy sufficiently slow time variations 

3 ( om ltMiinfi rrmarks 

This paper has addressed the robust stability and nsbusi 
perfonnuniT of parameter-varying lineaf systems in Ihc 
avnteii of gain scheduling 'Uir n^sults may he summarixed 
as follows Tsseiitially, it was shown that a gam M.'hcdulcd 
system which has desirable Iccdback pro|>crtics lor all fnatn 
values ol the parameters mamtums these t>fopeilies provkled 
that the paiarneter time vanaiioirs are .sufhcienlly slow 
Explicit sufficient conditions on the parameter time- 
variations were given 'Dius the heuristic guidelines of 
“scheduling on a slow variable ‘ has been transformed into 
quantitative statements 

Unloriunatcly. the actual Inmnds on the parameicr 
time variations may l>e difficult ai l>cst to compute Tor 
example, verify the sufficient conditions for fro/cn 
parameter cxpoiirniial stability (cl Ilicorem 2) would 
require satisfying u smull-gam condition ojff the jm-axis. Once 
these conditions are verified, one can then use ITieorcni 4 to 
guaranirc time varying stability. Ifowcvcr, (his lequires 
compulation of the measure ol lime variaiions in Debnilion 2 
(A), il Ixiund on the resolvent matrix for the liozcn- 
piuamelci systems (A,), and a IhiuiuI on the exponenlially 
weighted input/ouiput norm ol (he linear uiiceriainliCK 
ritf l urlhrrmore, even if verified these rrsiilts arc 
apt to fxr conservative 

(n spite of these limiialions, the value of the result.s is ihnt 
they lead to new insights into gain-schrduled systems Eoi 
example, in (Krtorming the (lozcn parameter designs, one 
must guarantee some degree of internal exponential slabilily 
in addition to the input/output stability ol standard 
robustness tests. Turthermoir, the sufficiency ol Ihc 
umditiuns is simply a reminder thai the designs were based 
on time-invariant approximations to the actual time varying 
plant If ihcsc^ approximations arc inaceuruic, then one 
should not demaful guarantees on the overall gam scheduled 
system 


sup e ''Me r,_ ^.||.) 

■•= max (f I! ^*11,. 


sup Me'" '''■"'-’‘c , 11 ,) 

-Me 

In order to guarantee (12), chiKise 


r-4ln Af/f/J- n) 

Ihen 

HK, In M 

implies the desired (12). Eurfhermorc, recursively applying 
the hound on 1114,^7)X|| « show.s that 

x(Mc II 

x(Me 

Sulniituting the choice of T into the above equation yields 
which compkirs the proof • 
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Brief Paper 

Arbitrarily Small Sensitivity in Multiple-input- 
output Uncertain Feedback Systems* 

ODED YANIVt 

iCey tVordi—Control thcoiy; feedback a>nlrol. multivanahk ainirol syskicmt. mbusi umiroh 
frequency domain. 


Abstract —A square, linear time uivanani. muliiple-input 
mullipleoutpul plant R is considered, known only to belong 
to a set {R). The plant is embedded in a feedback structure 
designed such that the cloiicd loop retiponse belongs to a 
specified set for all R € {R). This paper develops sufhaeni 
conditiomi on the uncertain set {/?) such that arbitrarily 
small scnsitiviiy and internal stability can be achieved by the 
Horowiu synthesis method. Specifically, we show that, in 
addition to generalized single-input single-output like 
conditions, there ciisls a condition on the pole/zero excess 
of the controller. 

Ahhrrvuiiions —SISO, single-input singlcHUiipul, MIMO, 
mulli-inpul multi-output; 1.71, linear time invariant. IT. 
transfer function; M7T, mairoi transfer function; RHP. 
closed right half plane; KRHP, regular in the RHP; HFCi, 
high frequency gam. 


whose elements are (miper finite rational 77' Due to 
uncertainly m the plant's parameters, R (ff) where (R) t» 
a hniie set of possible L71 plants For all i, / 1. 2, , n Id 

the following dehniiiom hold. 

a non-ncgaiivc function of w 
«„(*■') a positive fuiuiion of ni. 

« a positive fundlon ol 
^ the system's TF from input to output y, 

Ihe system's IT from inpul m, to output y 

Pmhlem 1 Find strictly proper elements of Ihe MTTT* 
and a ^ diag|gXt)| in Fig I, tM) that the following 
condition are salishcd lor all A? ^ (ff}: 

SiahUUi': Hie closed syslcm shall In.* internally stable 

( 2 . 1 ) 


I Introduction 

7>iE TWO main reasons for using feedback arc to reduce the 
ckY&ed loop sensitivity to plant uncertainly and to meet 
disturbance rejection speciheations TTiis raises the question 
of whether or not there exists a common LTl stabilization 
controller for a given family of plants which also achieves a 
phon closed loop performance 77ic stabilization problem 
appears in the literature as the Mmuttaneoux xiahi/ization 
problem or (he rohwtf derign problem, and has been 
discussed by many authors (for example Vidya.sagar, 19H5; 
Saben, 1985; Ghoxh, 19H6; wSchmilendorf and Hollol, 1988; 
Barmish, 1989; Wei and Barmish. 1988) who include a very 
good iniroduction to the problem A imuc difficult problem 
IS the simultaneous stabilization problem with constraints on 
the dosed l(K)p system's performance. This problem appears 
in many applications, for example in Right control (Gamell 
and East, 1977), large space structures (Wci and Byun, 
1989), robotics (Paul. 1981) and chemical plant processing 
(Skogcstadi et al , 1988). This paper is devoted to the 
problem of robust stabilization with constrainis. Explicit 
ciitciia are established on the set {R) under which a 
controller exists for arbitrary robustness and performance, 
Speahcally, the elements of R ' must be stable, the sign of 
the hjgh frequency gain of the leading prinapal [k ~ ]) minor 
of R divided by the leading principal minor k is fixed over 
{R] for fc - 1,. , n, and there exists a condition on (he 

polc/zcro exce&s of the aintrollcr. The Horowitz design 
method for MIMO systems is the framework for this work 
(Yaniv and Horowitz, 1986) 

2. Statemem of the problem 

fn Fig. I R = |/?|,(j)l is the planl model, an n x n matrix 

* Received 4 Ap^ 1989; revised 19 February 1990, revised 
6 July 1990, received in Rnal form 4 August 1990. The 
onginal version of this paper was not presented at any IFAC 
meeting. This paper was recommended for publicauon in 
revised form by Axsodaie Editor P. Guimaracs Feireira 
under the direction of Editor H. Kwakemaak. 

t Faculty of Engineering, Department of Ekcthcal 
Systems, Tcl-Aviv Universiiy. Tcl-Aviv 69978. Israel 


Closed limp performant e Fur a given to,,, A,,, R,, xnd F,, 


for lit ri and i, y 1, (2 2) 

77ie frequency ( 0 ^, is defined ns the frequency above which 
the disturbances are low in magnitudr and sensitivity to plant 
variation i.s nul important (because at sufficicnily high 
frequencies Ihe ticnchts of feedback arc negligible). In vSlSO 
systems is often chosen us ihc frequency, tor which the 
open loop IS aboul * .Wh 

7his problem has been wilvctJ by Yaniv and Horfiwitz 
(1986) who developed a synthesis procedure 

Definition 1. An arhitranly small xensiuviiy set is a »ei {R) 
.Huch that for any choice of A^(to). V^^(u^) and 

frequency Ihcic exists a solution F, G to Problem I. 

Problem 2 Under the amstrainis of Problem I, find claxucs 
of arbitrarily small seniutiviiy sets to which the Horowitz 
synthesis mcthrxl for MfMO systems is applicable 
This paper is devoted to Problem 2. 

Assumptum 1. 7he design parameter G is diagonal, G ‘ is 
RRHP, and for all R t{R), W is proper. R "exists and is 
RRHP If G is minimum phase, as is the case in most 
applications, then clearly G ’ is RRHP A similar statemenl 
cannot be made aboul R and R V 


Intemai xtability 

3 I Brief review of the Horowitz method ITic feedback 
system of Fig 1 is described by 

|/4C 7 «|r,J (3 1) 

This MIMO problem can be reduced to SISI problems 
using the Gauss's elimination method (Gantmadicr. 1960). 
Applying this elimination method to equation (3.1) gives for 
A « 1. , n; 



I Hi 


I k 

( 32 ) 
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pKi. L n‘input fi-output fccdbi^ck structure R Hn 
uncertain plant. 

where 6,^ '“I it i ^ u and * 0 if i ^ u, and P*, satisfy the 
recursive etjuation: 

(ni“« ■ >>* a 3 ) 


PrcMj/ By Assumption 1, G ts stable; by Lemma 1, 
R(/ f GR) ^ « TG ' is stable; smcc G is strictly proper and 
R is proper. TG ‘ is proper Apply Lemma 11 of Vidyasagar 
(m5| 

In the next section, conditions on the set (P} arc 
developed which guarantee the cxtsicncc of solutions to 
Problem 2 

4. A rbiSrahiy imall sen$ihvity 

This problem includes simultaneiHis stabilization as well as 
robust performance Tins is naturally a more diflicull 
problem than that of simultaneous stabilization alone, so that 
further assumptions arc required besides those made in 
Vidyasagar (1985). 

4 1 The SISO case 


Substituting i k in equation (3.2) gives the following n 
equations: 

p:. 


1 + 

<-1 .M Kk ' 


V'» PftuAi ( \ / 1 4 

> A-^1.. ,n (34) 

I 


Lquaiion (3 4) is a matrix equation of the form 

\K\Uu .—/:;> 

Rcmriinging Ihc lernif. in (3.4) gives: 


(3 .S) 




y f Y f*^uHk 


• ku'fk t ■ *11^* 

1 + 


where 


9A-i/r 


(3 f») 


(3.7) 


Therefore by equation (3.h), the MI MO problem is 
reduced to SfSO problems us follows. In step k the 
designer finds g| and which arc the only unknown 
pariimclers in inequality (3.H) below, so that (1 4 f,^) is 
.stable and: 


A 


1/ ’ 


I +1* 


lK,<iK 
I 4 T, 


H, 


(3.8) 


where 


^ n.u,- X /*U, a^) 

u~\. .k I n^k * n 


and the r^^ appearing in can have all values that will 
satisfy 


ig (3 10) 

TTie problem defined above to he solved in step k is a SISO 
problem. It has a solution if certain amdiiions arc satisfied 
(Horowitz, 1979, Appendix 1). At the end of the de.sign 
prcKcss. the synthesized G » ding |gj and F guarantee 
that (2.2) is met. A modification of the Horowitz method for 
achieving the disturbance specifications in (2 2) is given in 
Yaniv and Horowitz (1986). Based on the above synthesis 
prtKedure, conditions arc now developed under which it 
generates an internally stable solution. 

3.2. Cottdiiions for inierruti stability 

Lemma 1. Under Assumption 1. if for all k 
1,.. + /1.) has no RHP zeros, then P{^ arc RRHP 

and the elements of T « (r^l arc RRHP. 

Proof. By induction on equation (3.3), Pj arc RRHP, which 
guarantees that and/J in equation (3.5) arc RRHP. Since 
[hj is upper triangular (\|'‘ is also RRHP. Hence the 
ciemenis of (r^| ^ [h^] Vjl RRHP 

Theorem 1. Suppi^ that the conditions of Ixmma I arc 
satisfied; then the system described by equation (3 1) will be 
internally stable. 


Lemma 2. Suppose that for all P € ) P), P # (I, P has no 
zeros in the RHP, and all P e (P) have the same HFO sign, 
then (P) will be an arhitrarily smalLiensitivity set. Moreover, 
for any given positive integer t and ()< x<: 1, there exists a 
stable and minimum phase controller G with f pndc excess 
over zeros, such that |I + GP| >jr or |GP/(l + GP)| < 1/jr 

Perruiril I Clearly, x is related to the gain and phase margin 
of a SISO system; for example, x ■ 0.5 gives a .TfT phase 
margin and (nib gam margin (or |1 GP| >x. 

Proof A constructive proof limited to a fixed pole/zero 
excess in (P) is given m Horowitz (1979. Appendix I) TTus 
can be extended by induction to the non fixed pole/zero 
excess. In Wci and Yedavalli (1989, Theorem .S .S), there is \\ 
constructive pnxjf to find a fixed controller lor the 
simultaneous stabilization of sets, including the sets defined 
in Ixmma 2 Using (r(iui)| - \/x in Corollary 4 3 in Wci and 
Ycdavalli (1989). |GP/(1 4 GP)|’ \/x is guaranteed TTicir 
“priHcdurc of synthesis" (Section h.l) can Ik* extended to 
guarantee that the open loop |(r(/riOP(Mij)| • Af if lo ru,, 
for any given M and ru„ (select t, .small enough in Section 
6 1); this will satisfy (2.2) A synthesis prcKcdure for the 
de.sign of F lor a given (# can Ik* found in Horowitz (1979, 
Appendix 1). 

One example of a set |P) which violates these conditions 
IS (P) - (.?/(.! - 1). I/(j - 1)). In this ease. ,v - 0 is a RHP 
zero of the first plant. It is not po.ssibic to simultaneously 
stabilize the two plants using a stable controller (G must 
have a pole in the origin in order to .simultaneously stabilize 
this set) Another example is )P} ^ (l/(.v 4 1), - l/(.v 4 |)), 
here the HFG sign i.s not fixed, so that it is possible to 
stabilize on condition that the Icwp transmission gum at .v -0 
IS below ODB. In the example (P) - (l/(.v ~ I), l/(> 1)). 

the HFfi sign is not fixed and no strictly proper stable 
controller exists which will provide simultaneous 
stabilization 

4.2. The MI MO case. Several notations are now intro¬ 
duced in order to reduce the complexity of the derivations. 
Let q*l-- l/Pii where g, -0 is substituted in equation (3.3) 
for i I. . . - 1 Let P* be the MTF P where rows and 

columns 1. . . , A arc deleted, and P” - I That is. P* is an 
n - k by n - k matrix, whose ij element is the / 4- k, j k 
element of P. Clearly, R^* ~ R and P" ' is the nn element of 
P 

Lemnuj 3. Suppose the hypotheses of l^mma I arc satisfied 
and dcl(P* ’)/dci(P*)#0 for all Pe(P} and A- 

I.n Under these conditions, there exists a finite 

minimum polc/zcro excess for each such that: 

HFG of Vfc = HFG of - HFG of dci (P* *)/dcl (P*) 

(4.1) 

Pnsof TTie right side of equation (4.1) is shown in Appendix 
Lemma A2. Substituting m = i = / « A in equation (Aba) of 
the Appendix gives: 

Vit “ /’t* - Uqt (4.2) 

Application of Lemma AI of the Appendix to P ' = V* 
makes it possible to calculate as follows; (1) Take the 
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invtw af V'*, (2) Erase rows and ci)4umm 1. . . A - J of 
the result; (3) V'l* is the llih element of the inverse of the 
result Since V* * W ' + diag lj<i, - , i?* i. 0, , 0)|, Vj* 

has the following form: 




(4,3) 


where t] and are sums of the roultipltcaiion of at least one 
of the g,fi by elements of R, so that AiB can he calculated by 
substituting g. =0 in equation (4.3) or in V\ Since 
substituting * 0 in gives R \ hy [.emmas AI and 

A2 in the Appendix; 




(4 4) 


Since by the Lemma assumptions AjB one can calculate 
the minimum polc/zcro excess required in each g, for the 
pok/icro cxoc&s of A{B) U) be less than the polc/rcro excess 
of ^,(As) In Lemma 1, it is shown that is RRHP. hence; 

HFG of * lim | | “ li*n ^ | as I ® ■ HFG of 

(4M 


An example of Lemma 3 for the lwo-inpui-4>utpui ease is 
now presented 

F, *xinv(ff ' + diag(g,. 0)) (4 6) 


hence. 


1 

/>' 

' 11 


I ^*\ 2 ^.’1 ^ 2:g I 


K\ 


(4 7) 


and the pole/zero excess required for g, is more than the 
polc/zcro excess of 1'hc next theorem is our mam 

result. 


Throrem 2 Suppose that the hypotheses of Lemma 3 arc 
satisfied, and that for k - I. . n the HFG of 

del (/?* ‘)/dci(W*) is fixed for all Rf {R}. then {R) is an 
arhitranly small sensiJiviry sri 

rrffo/. This is shown by induction on the n steps of the 
Horowitz method for MI MO systems '1'hc induction 
hyp<ithcscs for step k arc. the designer cun chixisc and 
such that; (1) Inequalities (3,H'^3.10) arc satrshed; (2) is 
stable with no RHP zeros, (3) (g* Fj[j has no RHP zeros 
over all R e (Rj. and (4) g^ has sufficient pole/zero excess 
such that the HFG ol q* is the same as the HFCi of q'* (see 
Lemma 3) 

First induction step, k ~ \ \ Since q, - del (Af )/dei (W‘), by 
hvfxiiheses it follows that the HFCi of q, is fixed, that q, #0, 
and that q^ ha.s no RHP zeros ITius the conditions of 
Lemma 2 arc satishcd, hence there exists a g, such that the 
induction hypotheses lor fc - I arc satisfied (a minimum of 
pole/zero excess in g, ha.s to be selected). 

Next induction step: By ibc induction hypotheses on step k 
and l^crnma 3. the HFG of q*,,, is the same as the HFG of 
ql',, which by the theorem assumptions is fixed #0, so also 
q*,i#() By Lemma 1. q^*, has no RHP zeros Thuii the 
conditions of L^mma 2 arc satisfied for 4 !, and the 

designer can ctuxxsc g^^,, and with sufTkricnl pole/zero 
excess such that the induction hypotheses arc satisfied 

When a given set (/?} docs fkil satisfy the hypotheses of 
Tlieorcm 2, it may still he an arbitrarily small sensitivity set 
Ibis IS shown as follows. 


minor A* is fixed and not eero lor k ^ , n, then the 

Horowitz design method (or uncertain MIMO teedhiicli 
systems can be used to find an intemnlly stable bandwidth 
limited solution for any desired dosed liH>p response 
tolerances and arbtUanly high disturbance rejection spectfi^ 
catKms A key requirement for the amlrciller elements is a 
minimuni polc/iiero excess ’Ibis paper assumes that (K) is a 
hiiitc set. due to modelling error (If) can be an infinite set 
and it is poasiblr to xhow examples of mhnttc sets |/t) for 
which the results arc not true, even in the SLSO case 
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Science Foundation IBSF), Jerusalem, Israel, and the 
NatKinal Science Foundation Gram F<>i-K-6()Hd75 at the 
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Appendix Proofs of Lemmas 
Uf 


Remark 2 If there exists an MIT G, such that \RG^) 
satisfies the hypotheses of Theorem 4 4. apply the design 
method on the set (WG,) in order to find a controller Gj. 
'Fhe controller which solves the problem is G'lG^ Hence our 
main result is not restneted to a diagonal design of G 

-S ConrfuLiionr 

If for all € (Af); (1) K ' is RRHP and R is proper, and 
(2) tbe sign of the high frequency gain of the leading 
principal minor (A - 1) divided by the leading principal 


/f « an n by n MU 
P-^R ‘ 

R^ - The M’FF R where rows and columns I... A arc 
deleted. Ibal is, W* i% an n - k by n ~ A matrix, 
whose 1 / element is the i 4 A,; 4 A element of R 
In addition define R'^ ^ R and R” ^ 1 
A* - dct(/?‘) 

AJ « 1 / cofactor of R^ 

Ai/,, Cfif ■« (-1 ^ ^‘*(dct of R^ after rows a, c and 

columns h, d arc deleted] 



568 


Brief Paper 


(Pjl « An « - A -f I by fi M7T dcAned recursively; 

pA pk 
' Irir 

i: 1, , n - 1 »nd it ^ k i \, , n, j \, n). (A I) 

Umma A\, inv(Af‘ ') »" |/*J| fi>r k ^ ,n, and i, / ^ 

k, . , n. 


Profif By induction. 

The ease /f « J. For k ^ inv (K") ^ ff ' « [P,^], hence 
the induction hypothesi.s is satisfied 
The general case Using the above notations, the 
induction hypothesis is: |Pj| * aJ '/A* V The identity 
(BckIc, m5, p 54); 


AA^^, Ci1 

is applied to 8* ' (whose cofactors arc A* 
gives: 






\kk 

\h\ 



(A2) 

which 


(A3) 


Thus, 


n' 




K 

'pj* 


K 

A‘ 


(A4) 


I he right side of (A4) proves the induction hypothesis for 
step A -f 1. 


Proof, ® UPtk ** calculated recumvety by (3.3) for 

^ «0(i » 1. . k - 1), whidi is the same rccunivc 

equation (Al) for the plant H. Hence (A5) is an immediate 
consequence of Lemma A] 

Lemma A2 Let /f be a square n by n MTF and g|, . , g„ 

be n TF. Define: 

p=(p,i-p ■ 

V'„-(/^,| + d.ag|«,-„0.0)) 

Pt ^ Defined in equation (3 3) 

=* Defined in equation (Al), where replaces 8 ' and 
TJ replaces P^^ The index m is omitted for cUnty. 

Then for A * 1, , m 

Tj - P^^ for (i ^j or i iar m) and i - k, , n (Aba) 
Pt^ g, for I = A. . , m - I (Abb) 


Proof. For a given m by induction on A. For A ~ 1 trivial, 
assume equations (A6) arc true for A - r. then by definition; 


V 



IA7) 


Substituting the induction hypjthcsi.s m equation (A7) gives; 


t/^ *' 

" " P'rr + f 


^ p:: 


for (i # / or I iii: m ) and i - r f 1, 


(AHa) 


l.emma A2. Suppose is an n by n MTF, then; 




dci (/?‘ ') 

' d«i (AJ‘r 


(A5) 


P* P' 

v ^ > = P' 4. a - ~ 


~ ‘ A. I = r-f 1, , ,/n - 1 (AHb) 
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Approximation of Delay Systems by Fourier- 

Laguerre Series* 

JONATHAN R. PARTINGTONt 

Key Woedi—Approximation Ihcory. convcigcnce analysiiN, iJclay*», error tiiialvHis, I'ountr antilysi». 
Lnplacc tran?ikirm.s; model reduction; system order reduction 


Abslnd — hrror cslimiilcs arc given lor the approximation 
of stable recorded delay sysicms in the L. and H, norms, 
using two recently advocated techniques based on Laguerre 
scries. In addition, some theoretical results on 
approximation are derived 

1 hitrodut tutn 

C'oNSim K A stable conimuous-timc linear lime invariant 
system, (which will usually be inlmite-dimcnsinnal). with 
impulse response ji,MO defined on (0. ^ ) and transfer function 
the Laplace transform of i e 

(i’(v) I e "gfr) d/ 

Wc restrict our discussion to single input singlcHiuiput 
systems, foi simplicity of noialion. tiowevcr our results 
extend to multiple inputs and outputs Ihe problem of 
approximating i; (or (i) in various norms is one whicli has 
been much studied in recent years In particular we shall be 
interested in the [nllowing norms 

lU’ll; IKl/ir'tlf) 


(the L, norm I and 


[Ki'li. - sup {liC/fA 111. Re -s ' i'l) 


(the //. norm) 

Note that wc also have 

\ Z.T J . 

(see e.g. Partington (LVKH), C hapter 2|. and we shall use the 
notation i|(/ll ^ to denote jig|j , 

Lhe norm of a .nstem has been shown to f>c of inieresi 
for problems of control system svnlheMs (Francis. IMK7), 
whereas the /.; norm finds applications in quc,slions of 
system identification (see e g Wahiberg and Ljung, IMHfi) as 
well a,s m LOG control, both norms have been eiinsidercd 
from the point of view of miKlcI reduction <i e rational 
approximation) in a large number of papers 

In Section 2. wc discuss two recently suggested techniques 
for approximating sysicms. (Gu rt at . 19HM. MakiLi. 
both based on Fourier Laguerre senes, these have 
advantages through being easier to calculate than more 
rapidly converging approximations (such as the Hankcl-norm 
and truncated balanced realization methods), and it is 
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in final form 22 August 1990 llte original version of this 
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Kwakernaak. 
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therefore hciplul to haxe theoretical results mdiciitiiig how 
fa,St they do converge 

In manv wav.s the mosi common, as well as the simplest 
inhnite-dimenvional syslem.v to analyse are those arising from 
dcliiy diHcieiitial equations (delay systems), and in parlicular 
the retarded delay systems (defined in Section 3) Wc give a 
cJctaiicd analysis of c'onvcrgcncx' rales of the two mcihoda 
based on Ihe concept of the tmiei of a delay system, a notion 
which IS of impintance in other mellxHfs of approximation. 

In Section 4 we give a discussion of a somew>hul diflferenl 
norm, the iirne-domain /... norm, and give some iheoriMical 
resLiltN on approximation in thi.v norm, w'ilh sf>ceial reference 
to delay sysicms 

Finally. .Section .S contains an example wt analyse one 
parlicular delay system in detail, and review all the 
appioximalion schemes for which error Ixmnds are available. 


2 7Vi o ifchmqiit*\ for apprtnimaiirxf!, .u-.vk'fm 

We shall aniilysc two techniques for approximating sy«tcms 
bv sv.sicms with II single (reflated) pole. Both have appeared 
recently m the liieriilure and have iipplieiUions to delay 
systems 

Ihe first approximation technique that wc shall discuxx is 
given by C»u er at (1989), and involves using the iwmtclry 
iHMwcen /y,(( . ) and the classical //. space on the disc, 
induced by the conformal map z « Ms " (A * j)/(A 4 .j), 
I M A(l : 1/(1 4 2 ); here A is a lixed fK>xitivc real 
number In general wc shall not be concerned with the actual 
value of A, since the estimates hold whichever value wc lake, 
however, there is evidence (see e g (ilovcr eru/., lt/9(>c) that 
best results may Isc obtained by taking A to be of the same 
order as n, the degree of the approximation 

Wc are therefore led to consider the following expansion 
of a transfer lunclion f#(.V) 



where the (r^) are consluiUs (in fad Gu ft al consider the 
slightly more general matrix-valued case but this adds few 
extra difficulties) 

Moreover, if wc write f/(j) * V2A/(A 4-.t)f;(5) then wc 
have 


//(O 


V r.V^ 2 i 


U 0* 
(A + ,1)' * 


i ' 


so that we can identify the consianU (cj,) as the c«>cfVkicnU in 
the Fourier expansion of His) with respect to the 
orthonormal basis 


(C.(J)) V2A 


(A-j(‘ 
(A + .,)'‘'-' 


of the Flardy space using the norm ||G||^ above, 

induced from (For simplicity of notation wc 

suppress the dependence on A ) 

Let L^{t)^c'|k^ d*/d/*(r*c ') be iKc ciaxaical Laguerre 
polynomial (sec e g Szegd (1939) for dclail»l. Tlicn the 
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functioHM (c^) Mp the l.ap4aee tramforms of the funcUonn 
^^(f)«(” l)*V2Ac *7.*(2Ai), which form an orthonornuil 
baaijt in tiH' space 1 . 2^1 

A degrce-yi approximation lo O'f.V) is given by 

6-0,. X ,2.2) 

Clearly HJt,) convergence of the sequence (6*'’) to G is 
cquivaicni to /G. convergence of the power scries expansion 
of Ci{M%) on the disc We cannot expect lo obtain 
convergence of the senes (T/'), however, althp^ugh we shall 
obtain convergence of the scries H^U) V2A G''’(j )/(A 
j) lo ti whenever flix) Is in /GfG ,). 

The second technique consists in truncating a Fourier 
expansion 


by 


and 


||0'-6|bi-4n''.' ' (2.5) 

i|G-C|U£:B/i ' (2.6) 


for jKJmc amslants A and B —sec Cilover ei ai (T9^)b. c) for 
details—so that there is a iradcHiff here between case of 
calculation and accuracy of approximation. 


3. Decomposuion of rriardfd systtrms and error hounds 
The most general SISO retarded delay system has the 
transfer function 


c;(.v) = /i2(j )/h,(i'i. 


(3.1) 


66)- X 


(A - .v)‘ 
(A f 1)* •' 


to obtain an approximation 


where 


>i,(.v) 




(.3 2) 


n 

6„(.t) ■ X ''.Vizi 


A «>(» 


(A - v)‘ 
(A + ,f)**' 


Again we suppress the dependence on A in the notation 
Note our nolational convention that G„ and //„ arc truncated 
Fourier scries, whereas G" is not 
The constants (i^) and {df,} arc related as follows: wc have 
that 


and hence d„/V2A - r„ and (d* ♦ (K i)lV2X i\ for k i 
This technique was used in Glover rt al (1990c) with A 
chosen to depend on n. and has been recently employed hy 
M^kilii in a number of papers (including Miikila, 199i()a,b) 
Indeed Miikilti (l‘W()b) gave an explicit error estimate lor this 
technique applied to simple delay systems of the form 
G'(i) «^^-c with H rational and strictly proper and 

/’ >(). Namely, it showed that if r i is the relative degree 
of H (that is. the denominator degree is r more than the 
numerator degree), then 

d* -0(A '*) (2 3) 

(this estimate is tight) and mi 

G - (Hk ' '). (2 4) 

ITence wc obtain 

l|f' (sll: - ' 

and can csliinutc ||G’ - as follows 


(6 (;,)(« '.•) 




and Ml 


l|6 - 6,11. rs y |r*| - IdJ/V-^A 

n I I 

(Tills is u similar argument to the one given in Makila. 
1990b). Note that for any sequence (c^) 0(A *') and n ^ I, 

wc have VJ,,, ^, (cj ^ f)(n’ *’), since 

X * f » "di -n' "/(ft - I). 

^--,3 1 Jf, 

Wc shall use this estimation technique several times. 

In Section 3 wt shall extend these results to general 
retarded delay systems, however wc remark now that with 
G(Jf)“C * R{s). and r as above, the optimal convergence 
rate achievable with any rational approximation of G is given 


and 

(3.3) 

With 0 - rr - " rn,. ' Pny Ibe p, being 

polynomials of degree and d, ^ c\, for i 4 0, and the q, 
polynomials of degree d, ^ rl,, for each /. Such functions were 
analysed in Bellman and C'ookc (l%3). where it was shown 
that they have only finitely many poles in any right half 
plane Fhcy have since been considered from the viewixnnl 
of approximation in Zwarl et al (l9Hh). Partington ei al 
(IMHh). Glover et al (1990a, b, c) and Partington and Glover 
(1990). ami we begin by summarising some of what is known 
about such systcm.s 

It is convenient lo dehne the index of a delay sysiem. lid) 
to be the unique value r v* I such that one may write 

r 

(;(.v) = «(.! , + X “’’/U + D' + 6(.V ' '). <3 4) 

1 

with R rational, P * I. the (a,) nonzero constants, and the 
(rt,) jxisitive coefficients. 

TTius for example c "'/(vc ’)- e ^7 (a 1) + G(.s ’), 
so it has index 1, whereas l/(vft* "I - l/(v + I)-^ (1 
c ’)/((^ !)(' ^ c ‘)) l/(v ^ I) + l/(.v 4 1)*’ e 7(> 4 1)’ 

4 G(.v '). and has index 2. For the ca.se G(.v)- c '^R{\) 
with H rational, (i e n,--n), the index /(G) is just the 
relative degree of R. 

An equivalent formulation may be derived from (ilover et 
al. (199()a, Section 5 and 1990b, Section S), where it is .shown 
that /(G) IS such that the Hankcl singular values of G and 
the minimum error in approximating G hy a sy.stcm of 
degree n arc bounded above and below by multiples of 
n Similarly in Glover et al. (1990c) it is shown that the 
optimal L; approximation error is of order The key 

to these di.scussions is that the dominant term which in¬ 
fluences the approximation rate i.s the term Sj’fl^c "' 7 (.r -4 1 )' 
occurring in (3.4) In the time domain this corrcsfKinds to 
analysing the impulse response g corresponding to G for 
which is the hrsl discontinuous derivative. 

It is possible to approximate unstable delay systems by 
writing them as G’(i) = G„^hk(0 + /^(O. where K is rational, 
strictly proper and totally unstable, and then approximating 
but other approaches arc often more satcsfactory. e g. 
the one based on coprime factorizations (Partington and 
Glover, 1990). Clearly the index of an unstable system is the 
same as the index of its stable part, but we shall assume in 
what follows that G is stable. As in Section 2, wc write (( 4 ,) 
to denoj^ the Fourier coefficients of the function 
W(j) == V^A G(j)/(A 4- 5 ) and wc write (d^) for the Fourier 
coefficients of G(j) itself. 

Our first result is a consequence of the results of Makilli 
and the decomposition technique of Glover ef al. 
(1990a. b,c). 

Lemma 1 . Ixt G be a stable retarded delay system of index 
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ri? 1 Then the cocflicicnts (cj and (t/J saiisfy 

and (3,5) 

d* - 0(* ' ‘) as k X 

Both these estimates are tight in general. 

Proof. Since H{s) is deajriy a relauied delay system of indei 
(r 4- 1) it is sufficient to prove the result for d*. We intn>duce 
the notation r,(.y|» LTfl.*-* 1)' (cf (3 4)|, and 

ohseve that it is possible to iterate the decompi^iiuHi method 
and write, for any S 

Gis) - /?v(^) ru) ^ t; , ,(0 ^ ^ TvU) + Vv(.t)> 

where Rf^ is rational, each T, is et^ual to a sum of delay terms 
divided Ky (5 + 1)', and 0(y ') 

Now it IS easy to verify that exponctUtally for 

any stable rational function, (e g. by transforming to the disc 
and examining the power scries), moreover each J] has the 
pntperiy that di^{T,) ^ 0{k ' * by (2 3) Finally, for 
sufficiently large N the coefficients d*(.S,^ ) are o{k ‘ ' *), 
by the results in Section 6 of Cilovei rr ai (l‘W(k:), 
specifically since by Lxmma 6.6 of that paper has an 
impulse response with {N - 1) continuous derivatives, and 
cx^xmential decay at integration by parts shows lhai the 
Fourier-Ljigucrrc cr>cffidcnis of a function / of exponential 
decay will decrease faster than any given power of A il / is 
sufficiently smooth 

It follows that d^((y) 0(il ' * ' *), as required Fo see 
that the estimate is tight, note that it is sufficient to verify this 
for d^iJ]), since all the other terms are dominated by this 
Apart from exceptional cases in which cm*fficienls cancel 
(this cannot happen for f* - 1 and may be impossible in 
general), this will be the case 

fV)rri//flrv 1 Let r»(,i) be a stable rciardcd delay system ol 
index r. Tficn the following Ixmnds hold 


IIG 

~(r\\. = (hn'^ '■) 

( .■' <>l 

IIG 

-O'JL ^ CHn'* ■') 

(^7) 

11G 


0 H) 


Proof. Since ||((A - ,1 )/(A + .f ))* ||.. =* 1, for all k. it follows 
that I|f7 ~ - Eh n Ka I and the first result follows 

because Ok ' ^ ’ Altcrnaiivcly, for r 2 one can 

use the error estimate given m Ciu er at (1989. nuorem 
2.17), namely 

I'? 

lie;-friu-V 2 A/n( V *■,;) . 

4 - « >1 

which gives a bound of 0(n which is 

The other two estimates follow from (3 .S) since ihe 
arguments given m Section 2 go through to this more general 

4 Approximation in fhr /. JO, -^1 norm 

It IS of interest in some applications 10 consider uniform 
approximation of the impulse response ol a linear system, 
and accordingly we write 

llgIL ess. sup U(f)| 

(»^ '»■ 

for the norm in LJO, ^) It is our first concern to derive a 
lower bound for the error in approximating a linear system m 
this norm; we then compare the various techniques available 
Although the LJO, norm is an operator norm, being 
the norm of the Hankcl operator 

(r«)(r) I g(r ^ t)u(t) dr 
Jo 

as a map from /.,((!, ») to /.,(0, *), lilllc appears to be little 
known about the approximation numbers of operators 
bciween these spaces, and wc proceed differently For g in 


/..j(n, X) wc write (g ) to demMe tbc mimmum error of 
any degree-A rational approximatHUi 10 g. 

TVown I tel g(/) lx a function in 1.^(0, Ibcn. (iM any 
/f(rj in I.JO, w'hosc laplacc transform is ralamal of 
degree n, we have 

!IA’ ifIL •s-ftup (f .(*■(()<> I* '<*' 

Pnh}f It IS a standard result that IlftU 

sup (|j/>i||j/j!6|lj.6 t6#l)). Hence 

lU* - »fll. IK* - II:' 

Since jtc also has a rational taplaiT transform of ilcgrce 
n, the result now follows 

Corollary 2 tel fi(.v) be a rciardcd delay system of index r 
with impulse rcsjsonsc ;g(f) Iben there cxisis a ctimdani 
A ■ 0 Mich dun for any dcgrcc-Ti approximant (J with 
impulse resfxmse /f we have 


/Vcw)/ Hiis follows liom f'hcorcm I (wc may take 1} 
and the known t. result (2 5), given in Glovci rl nl (!99(k') 
for r2 In the case r 1 the impulse rcsfxmxc g is 
diixontmuous and so it cannot be approximated uniformly by 
ixiniinuous impulse responses □ 

This inequality is not tight, and ihcri* is some evidence to 
suggest that the "coneci'' inequality should Ih* Hit' )}||.» ■«* 
An' ' for all values of r 

As regards achievable /,,((!, '*) errors, lilllc is known One 
possible technique is lo iipproximatc g(t) m the /., norm (in 
the ca.se r -2, miiundly). since llg AMU * Il8 ' Slli. 
provided that g(-*) :..j(>(c'/.) ., () ifii* mcdiods of filover and 
Fartingion (19K7) can lx used here and il can lx shown dial 
an achievable error Ixiund is 0((logn/n )' ') 

Alternatively one can use the truncated scries meihiKl ol 
Sections 2 and 3. and, since |li/>JU * I b’t Jdl A (S/cgd, 19.39) 
wc obtain the error hound 

IlK KolU X I'M '■ 0(n''* "'’l. 

5 P.^ampir 

( onsidcr the linear system with transler function 


\ ^ - exp ( 2 I ) 

This retarded delay system has been considered in several 
place's (Partington et al , 19KM; Gu et al . 1989; Glover el al , 
199db) for the purposes of assessing model reduction 
schemes and wr* collect together various results on this 
system Wc begin with fniunds 
FTic ilccomposition G(i) - 1/(a f I) + c ^ 7(» ^ 1)^^ 
0((i + I) ' shows that the index of is 2. and it alwi follows 
that the Hankcl singular values satisfy 

n'oj(f ) “• } j as n 'r, 

C TT' 

(cf Glover ft ai, IW)b| these provide an abMilulc lower 
bfiund (or the approximation error by any scheme 

In Partington ei al (1988), rwo approximation schemes 
were given the partial fraction scheme, with error 
0(logn/n), and the Pad^-like scheme of approximating c * 
m the above expression by ((2n--i)/(2rT + r))" this has 
error 0(n *^') The best known ibcoreiicaJ bounds for 
Hankel-norm and truncated balanced realization approxima¬ 
tions (Glover, I9H4; Glover ft a/ , 19H8) yield errors of 
Oin ’) though in practice these mcibiKk appear to perform 
better than the currently known bounds would suggest. TFic 
techniques given in Glover el ai (I99()h) (based on Fadd 
approximation) achieve errors of Oin which is the 
optimal rale Next, the lechnique given in Gu ei al (1989). 
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anttJy^d in Scctionjk 2 und 3, achieve errors of 0(n hy 
(3 6), since ihc indcJi of G is 2, and finally Ihc icchniquc 
given in Miiikiia (IWf)t>), alv> analysed al'Wivc, also achieves 
erron of Ofn by (3 7). 

Fewer results are available lor the norm Il>e 
theoretical (and achievable) lower hound, given in Glover e/ 
al (IWOt), IS Oin *'*), since the singular values of the 
scaled Harikcl opcraior arc bounded above and bok^w by 
multiples of n ' 

13ic partial fructiirn approach (Partington, I99()) yields an 
error of G(logn/vn) There is no error Uiund available lor 
Ihc optimal Mankchnorm approximation, and the error 
bound hir the truncated balanced realization (Glover et ai . 
IW8) IS not explicit Finally, the Iruncalcd l.agucrrc series 
gives an error bound of Ofn by (3 K) 


6 ( om luMffns 

Fourier Laguerre series do not achieve (he optimal 
convergence rate for model reduciion ol delay systems m 
general hul they arc usually easily computable and (with A 
chosen appropriately) can provide a reasonably cflicicni 
approximation icchnique. Numerical resulls (see e g, Ciladcr 
rt al., iWb) suggest ihal for lower order appr<iximations 
.several techniques fHirlorm satisfactorily, so that each may he 
useful in cerlain circumstances. For higher order approxima¬ 
tions (c.g. n :*• 'S) the asymptotic Inrhaviour starts to become 
more relevant and it is the case that a satisfactory approach 
in practice is to Iruncalc a senes to obtain a higher order 
appioximmion, and (hen pcrlorm a haliinced or llankci 
norm reduction of the (large) firiik'-dimen.sional 
approximunl 
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Abstract—The pcmibilily of lailonng Ihe quadratic objective 
function to generate optimal (X)licics which are accepuiblc to 
the policy maker is explored with iwo aliernaiive algorithms 
One of ihcM; is for objective functions with diagonal 
Hes.sians and uses updates of the desired values I’hc scc<md 
algorithm priKecds by updating nondiagonal Hessians, while 
keeping the desired values fixed The equivalence of b<ith 
algonthms are established. 

TTic arbitrariness of shadow prices are established lor all 
quadratic equality constrained optimi/aiion problems 
Starting initially with linear constraints, it is shown that 
cither one of the algorithms can lx* used to alter the shadow 
prices, by arbitrarily specified amounts, without altering the 
primal optimal solution In one step, the algorithms are able 
to change the shadow prices, while keeping Ihe optimal 
policy fixed It is shown that this is also true for nonlinear 
problems 

1 lnfn)(Jii( lion 

Wi (ONsiDi K two related is.sucs concerning the quadiatic 
objective function llie first is a methiKl for the sixcihc^tiion 
of Ihe quadratic ohjcciive with a diagonal Hessian ITie 
purpcjse of the method is to tailor the objective function such 
that the optimally generated solution of the decision problem 
IS also politically acceptable to Ihe decision maker We study 
the equivalent of the methcKl for nondiagonal ffessiuns Ihe 
method is then used to address the second problem which is 
the arbitrariness of the shadow prices, or Lagrange 
multipliers Ihe [xrssibilily of formulating opiimi/ation 
problems convenicnlly by using an appropnaic Lagrangian is 
not new (see (icolTnon, Ponslcin. I9KT| However, in 

the present study we arc concerned with the cunverve 
problem m which, while keeping fixed the (primal) optimal 
solution of the decision problem, we consider ihc possibility 
of altering, as required, the vector of (dual) shadow price, or 
L,agrange multiplier, values 

( onsider the lincar quadratic optimal decision problem 

min ((,t - x"*, D{x - x'^)) | V'x ^ h) (1) 

where jr e E". h ^ E"” is a hxed vector, I) is a diagonal matrix 
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with nun riegativc elemrnu, x"* is Hie desired or bliss value of 
I or the unconstrained optimum of (he quadratic objective. 
The c'olumns of matrix S c arc assumed to lx linearly 
independent The diagonal weighting matrix in (1) ixcurs in 
economic decision making and in general in linear quadratic 
optimal control problems In (he latter cast, (1) can be 
regarded us Ihe (runsenplion of the dynamic |m>b(em into 
static form (see e g Polak, 1971) Wc can state the two 
problems addressed below. 

Problem \ Ixt Ou E” denote the set of policies acveplable 
lo (he decision niukrr Wc u.ssumc that there d(K*s not exist 
an analytical churactcn/alion of U and that D exists only in 
(he mmd of the decision maker If an explicit characteriza¬ 
tion lif D was ixrssiblc, it could lx used lo iiugmcnt Ihe 
constraints of (1) und Ihe rrsulianl problem could easily be 
solved An anulytical characteri/ation is assumed to lx: 
inherently diflicull, or impiissiblc. and sometimes also 
polilicaliy unde.Mrahic from the decision maker's point of 
view Ihc pn>blcm is to tailor an objective function for which 
the optimal soluhon of (1), i*. also satisties ,i* c U 

Wc discuss two iy|Ks ol Milutions lo Problem 1 Ihc Hrst 
involves modi lie a (ions to and keeps O fixed as a diagonal 
mairix The sce'ond involves modifications to D and 
generates a nondiagonal weighting matrix while keeping 
hxed Wc establish the equivalence ol both methods. 

Problem 2 Suppose that Problem I has been Milvcd Hence 
wc have an objective function and x* it U Ihe Lagrange 
multipliers of (1) signify shadow prices. Suppoxc that the 
shatJow price vector, corresponding to s*, is not »cx:cptablc 
Ihe problem is lo alter the shadow prices lo suit the decision 
maker s requirements while keeping the original a * fixed 

By solving Problem 2, wc ensure that Inuh primal and dual 
variables satisfy the decision maker It must lie noted that 
Problem 2 is not the dual of Problem 1. In Problem 2. Ihc 
primal solution, ji’, is fixed and the dual vdution is altered, 
while in Problem I there i.s no question of fixing either the 
dual or the primal variables Wc discuss two solutions to 
Problem 2. Ihc first involves an alteration lo x‘^, while 
keeping D fixed, and the second involves Ihc alteration of D 
to a general symmetric matrix, while keeping fixed. Ihc 
shadow prices can be assigned arbitrary dcNirable values 
without changing (he optimal solulron 'Ihus. the shadow 
prices of constrained optimization problems with quadratic 
objective (unctions arc slvi.»wn to be arbitrary. This can have 
serious implications in the use and interpretation of shadow 
prices (sec e.g UNIDO, 1971; Dreze, I9H2). 

Ihc desirability of a diagonal D is due to aimputational 
reasons as well as the inicrprcialion of Ihe problem and the 
optimal solution Nondiagonal weighting matrieex can be 
diagonalized by appropriate transformations of the variables 
However, such (raoslormations lead to computational 
complicatums, particularly in relation to the constraints. A 
more important aspect is the difficulty of aligning an 
rnterpretation lo Ihe off-diagonal elements of a general 
symmetric weighting matrix. These elements arc usually 
understCKKJ to rcprexcnl trade-offs between achieving 
alternative objectives However, they arc difficult to axsign 
an interpretation as distinct from the diagonal elements. 
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which represent (he relative importarHX of each objective. 
Also, for linear quadratic dynamic problems, S4)lved via 
dynamic pro^gramming, maintaining the bliKk diagonality of 
D, m terms t>f the lime structure> is desirable at least for the 
physical intcrpreiatKm of the resultant optimal linear 
feedback laws 'fhls contrasts with the case when 
mindiagonal wrighimg matrices have to be factorized and 
the original variables have to transformed ui order to 
obtain feedback laws which may only apply to the 
transformed variables 

In most economic decision making problems under 
umfticling objectives, the precise value of the weighting 
matrix is not known Lven a judicious choice of the 
weighting matrix need not necessarily yield a solution of 
problem (I) that im in the set of acceptable jMilicies, U In 
Section 2, we discuss an iterative algorithm, involving 
mleractions with the decision maker, to specify a diagonal 
quadratic objective function (hat generates a s(»liiiion of (i) 
which IS acceptithif to the decision maker. The algorithm 
involves (he modilication of the desired, nr bliss, values of 
the objective function In Section 3. the method is shown to 
be equivalent to an ulteriiativc method involving the 
rcspeeification of the general non'Cliagonal symmetric matrix 
(Rustem et «/ , |M7Ki Rustem and Vclupillai, I'JHhii), In the 
latter method, (he desired values remain fixed but the 
weighting matrix is altered and does nut muinlain a diagonal 
structure. This corrcsptintlcncc is helpful compuiationally us 
diagonal matrices arc simpler to compute. Conversely, the 
corresp<indencc provides the nundiagonal weighting matrix 
that would generate the same optimal .solution as the one 
obtained by mcHlilying (he desired valuc.s In addition, the 
corrcsprmdcncc can fn: used to discuss the complexity and 
polynomial time termination properly of the algorithms by 
invoking the results m Rustem (I'^X)) and Rustem and 
Vclupillai (IdHKh) In Section 4. we discuss the use of both 
algorithms in solving Problem 2 

2. .Vpfri/vmg dta^onal quaiiratu ohjertriie funciums 

We consider a solution to Problem I An alternative 
solution and the equiviilcnce of both solutions are discussed 
in the next section Let (I) he .solved lor a given weighting 
matrix D and a given initial vector of desired values I he 
solution is denoted by 

» urf! min | (a ■ i,';. [){x - i;;)) | iV' i ■ b] 

ITie solution is presented to the decision maker who is 
required to rcspiind by either declaring that il 

i„l U. the decision maker is required to specify the modified 
form of If, that is in U 

rhe decision problem we wish to consider can now' In- 
formulated as the compulation of the jhiIicv, optimallv 
determined via (I), but which also is acceptable to the jHiliey 
maker and is hence in the set li. We assume that 
(x \N \ h) n rhe decision maker’s preferred alter 

native to i„ IS denoted by i^, By Jetinition, we have x 6 W 
but not nrifxutrily x^, t (i | (V* i - b) n Li In ease the latter 
IS true, such a preferred alternative would conceptually solve 
the decision problem. Let ^ - i,,, where i.s the 

rorrri'tmn vector that needs to be added to i„ in order to 
ensure that U, Using bj,. we can revise the desired 

or bliss value as r'f *-rjf + where rif, is a scalar 
Using this new desired value, problem (1) is .solved once 
again to yield a new- optimal solution, x, I’his solution is 
shown below to have desirable characteristics. However, us 
there is no guarantee that x, t U, the alnivc procedure may 
need to he repealed I1ie resulting algorithm is summarized 
below We discuss the complexity and (erminaiion properties 
of the algorithm in Rustem (l^>) and Rustem and Vclupillai 

{\mh) 

Algonihm. Updates of desired values with a fixed diagonal 
weighting matrix 

Step 0; Given [), x;!. the sequence {aj) and the amstraints, 
set k « 0 

Step I: Compute the sidution of the optimization problem 
X* «rg min | - x^. D{x ■ xj)) | S^x b) (2) 


Step 2 Interact with the decision maker. If slop 

OthcrwtM:. the decision maker is required to speafy tlM; 
preferred value x^, and hence, 

(3) 

Step 3: Update the desired values 

-11 “ ^4 4“ (4) 

set k ^ k + I and go to Step I 

The relationship of x*x^ and a*. is summarized in 
the following results llic choice of the objective function 
may also be based on criteria other than x* e U For 
example, in the linear stochastic dynamical systems, the 
weighting matrices might be chosen to yield a stable 
minimum variance controller (see Engwerda and Otter, 
1989). Also, the possibility of altering the desired values in 
order to change the solution hus been considered previously 
(see e g HughesTlallei and Rees (19H3)|. However, in the 
present study we consider the theoretical and equivalence 
properties of the approach adopted in this .section to 
respecilicaiion, discussed in Section 3, of nondiagonal 
weighting matrices while keeping x*^ fixed llie equivalence 
aisik provides Ihe key to the complexity and convergence of 
the jMjlicy design priKCss In addition, us it is povsihle to 
decompose a symmetric matrix into a sequence of rank one 
updates (see Fidcco and McC ormick, 19C>M), the method in 
this section and the equivalence result allow the possibility of 
expressing nondiagonal weighting matrices in icrms of 
diagonalized objective functions 

An allernalivc characterization of Problem 1 would he in 
terms of finding a solution that simply satisfies the constraints 
and U, without any optimality requirement One difliculiy of 
this approach is that O needs to be explicitly specified. Let us 
(i.v.rii/nr that this was possible and that U was characterized 
by the intersection of a finite number of linear inequaluies. ll 
can then be shown that Inith the above algorithm and the 
algorithm in the next section arc related to Khachian’s 11979, 
1980) algorithm for computing a feasible solution to a system 
ol linear mequulilies In this framework, the vector ^ is 
determined by one of the (linear) constraints bounding 
(he set U In particular, d is rclaied to the gradient of a 
constraint characterizing U. violated at x^ (Rustem and 
Vclupillai, I988h, Rustem, 1990), By invoking Khachian's 
result, we can obtain a polynomial time complexity for both 
algorithms, The added advantage of (he (wo algorithms in 
this paper is ihal they relate each iteration with an objective 
function and optimality that is useful to the decision maker 
Since the set ol acceptable policies, il, docs not exist 
anywhere except in the mind of the decision maker, the 
inlcrpretiiiion and spccilicalion of d is aided by the 
optimality, at each iteration, of (he quadratic objective 
function 

Proposition I Assume that D is positive scmi dchniie, the 
optimal .solution and Lagrange multipliers can be written as 

.1, + a*Z(Z'DZ) (.«;) 

where ZeF.""'" is an orthogonal matrix' such that 
/VV - 0. and 

A,,, - A* - rt^fiV'V) - /A/'OZ) 'Z'D)^ (6) 

PrtHtf To establish (5), we note that x*- x* e (x | N^x = 
0) and, as any such vector can be written as a 

linear aimbination of the columns of Z Tlius, we have 

, 1 ~ ft**' some vector w e E" and from the 

first order optimality condition of (2) we can write 

Z'D[Zw + X, - xi- <».M = 7. 'SX, „ - 0 

* The choice of the orth<.>gonal mainx Z is discussed 
further in Rustem and Vclupillai (19HHa). The numerically 
stable way of generating Z is by considering the QR 
dca>mposition of N. The matrix Z is given by the last n-m 
columns of the matrix of this decomposition (see Gill ei 
ai., 1981). 
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and thus 

f I ~ ® -Ziv ® -ZiZ^DZ) - xi - OiAil (7) 

From the optim^hy condition at iteration 1. we have 
- jt/] * Z*^A^A| « 0. Thus, expression (5) follows 
from (7). 

For (6), we ufic the optimality condition at A 4 1 to yield 

VOK,,-:..+jr.-ir;-aAI (») 

Using (5) and the optimality condition at k, D(Mh - 
NX^, leads to expression (6). □ 


.1. The diagonal version of non-dtufu^onal quadrtniv forms 
We consider the equivalence of the algorithm m Section 2 
with a method generating non-diagonal weighting matrices, 
discussed in Rustem ft 0 /. (I97H) and Rustem and Velupillai 
(198Aa) The complexity of the former is discussed tn Rustem 
(1990) and Rustem and Velupillai (198Hb), by exploiting this 
equivalence The following algi^hlhm uses the same as tn 
the algorithm in Section 2. It keeps the desired values hxed 
but updates the weighting matrix of the quadratic 
optimixation problem. 

Algorithm Fixed desired values and nondiagonal weighting 
matrix. 

Step 0; Given a positive semi-definite weighting matrix Um 
the sequence the desired values j(‘* and (he constraints, 
set k - (J. 

Step I; (\>mpuic the solution of the opliiiu/aiion problem 
X* “ iirgmin ((1 - .r'', C^id i'^)) I VVi h) 


Step 2; Internet with the decision maker If c U, stop 
Otherwise, the decision maker is required to specify the 
preferred value x . and hence, ^ x^, - 
Step ^ Update the weighting matrix 


Qi 


Q, 


4 p. 




(9) 


Set k - A: 4 1 and go to Step I 


ITic matrix compared in the algorithm ah<ivc is in 
general nondiagonal. It is shown Inflow that .starling with an 
initial diagonal matrix, the above algorithm and the 
algonthm in Section I arc equivalent At each stage, (he 
nondiagonal version above has a constant diagonal 
equivalent in the algorithm of Section 2 ITie equivalent 
results U) ProjMisition I related to the alxivc algorithm arc 
discussed in Rustem and Velupillai (l9HKa) We surnmuri/c 
these results. When is p<?silivc semi dcfiniie, each 
subsequent ilcralc of the above algorithm is given by 

X, - 1 . 4 (lOa) 

‘S'QJI - /.(/.’Q,/.) 

(KMi) 

. _ 


(sec Ruxicm and Velupillai, l9KKa; Tlicorcms 1 and 2, and 
Lemma 2). 

We now show (be equivalence of the solution of the two 
quadratic optimization problems; one with the diagonal 
Hex&ian fixed and only the desired or bliss values modified, 
and the other with the desired values fixed and only the 
diagonal matrix modified to a nondiagonal form 


Pwposiiwn 2. Let C?* be nonsingular TTicn, there exist 
and such that for 


ar,A, Qt., = Qt ^ lit 


QAKQt 

iA.Qti>t) 


(ii» 


we have 


argmin {(j - Jtj,0»ri -'i.r)) 1 ~ *») 

°argmin ( (x - xi, C\ .lU - xf)) | ,V'» « h) (12) 


Mtxreovtf. we have « a* If reslncwl such 

that ar 0. then the chime of Aj is rtsstncied by the 

inequality (A^, U " ^a)) 

/^roo/*. Considef the iipiimality coitditKms of the mimmiia 
non problems on both sides of (12). With the solution and 
the Lagfani^c multipliers denoted fes|K?clively by x*,,, A* * 
the left side yields 


TTie nghi side yields 


y* ^ Pa 






■ X?) SA I 


0 


Lquating both optimality conditions yields 

and hence * xjf where 


Pa 




(13) 


It can be shown that in (13) und Ag in (lOe) are 
equivalent (see Rustem, 1990) 

The inequality (<^a . > (*a * a)) ensures that 

»A . Ma^’^O To demonstrnie this when U*,, is given us 
above, we sec that given by (L3) is equivalent to A| and 
this i.s non-negative if the above inequality und p^ (I are 
.satisfied When the desired value is iHMiig u|Hlaled and an 
equivalent update to is being computed, (hen for n* 
and 


Ma ^ 


‘ (Ax.c'.(n., -ii)} 


(14) 


We now show that 


>b x^.c/aGa.) a*/))- () 

Ihc incqualily (x*,, , ,(14 , j i'/)) 0 follows 

from the optirnalily of x^,, lor the quadralic optimi/alion 
with yA M fbe expression lor C^a m« b«vc 


fL*- (aa - 1 

(Aa < 1 

^ (a* 


* A • y A * ) t A A I 1 A A ) ) 


A A . C^f A A I I ' A 4 ) ) + 


Pa 


M A*,yA^)(^ y*(AA., A?)) 


Since (xa,) Aa. C^fA* Xa)>-() follows frimi 
optimality of Xa with und 


Ihc 


yA^A^i Aj) .-(I 

holds if (i>A-yA(AA a'/)) ' (I (sec Rusicm and Velupillai. 
l9K8b. Ixmma 2) then we have y^l AA m x?)) * ^ 

/4* ri-O and the corresponding /u* is given by (14) □ 

The extension of the above result to nonlinear ciinslraints 
is straightforward when the diagonal equivalent of a 
nondugonal quadratic function is dexired. However, the 
useful analytical equivalence of ci and & cannot be 
e.stablished exactly in the nonlinear case The extension ol 
the methods to nonlinear constraints can be established by 
invoking a mean value theorem and thereby using a local 
representation of the c<mstraints (see e g Rusicm and 


“The alK7vc proposirion clearly holds lor Q,, ^ P and 
C>A ♦ I' above, is P with u rank-one update and hence 

it is no longer, in general, diagonal 
When 1% tmffuJar, it can he shown that (11) can be 
written as from which the relevant 

pam of xj,, can be recovered For example, when y* P, 
a diagonal matrix, clearly only those elemenu of 
corresponding to nonzero diagonal elemenis of P can be 
recovered The correspondence of given by (Kk) and 
can he established in the same way as in the following pr(M>f 
except that (10a) is used for X|,,,, 
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Vclupillai* rTicorcm 5), TV fcHtowing airollary 

lummarizci the C4|uivaknce of the two metfuKlji when 
applied to nonlinear con»traintA 

Corollary. (TTic extension to ru^nlinear ainxtraint.'s) Lxl 
xjf^, and | V defined hy (II) and let the coniiraints be 
given by 

G-U6K"U(x)-0) 

where g is twice differentiable and g kT - fc'" Tlicn the 
equivalence 

aro min ((jt - xi,^, Qt(x - xi,,)) U « G| 

« argmin ((j i'/, (^i,,ix - -if)) j-i t G) 
htilds b>r nr* given by (H) 

Proof The prcHif follows from the equivalence of the first 
order optimality conditions [1 

TV extension to nonlinear corisirainls is thus easily 
implcineniable as the basic ingredients that enter a* are 
and Both of these vectors arc known when any one ol 
the two quadratic problems have already been miIvccI 
Proposttitm 2 relates (he cITecl of a single u|xlaie of 
that yields , i or a single u^Mlatc of x* that yields x*,, As 
a corollary, we consider the sequence IC^a) generated by the 
algorithm in this section and the corresponding sequence 
(xjf) generated by the algorithm in Section 1 


Hiforrm I (The diagonalizihiliiy of i^uudranc forrru) l.el 
the sequence (y*| V generated hy (d) and («*} V 
generated hy (4). Let 1) then the equivalence between 
the diagonal and non-diagonal quadratic optimizations 

argmin((ji il', /))(* • ;il')) I 

atg min {{x - rlj, (,)*(!: - i^)) | N' t -■ h) < 1S«) 

holds if 




Dxi ^ fix;; 2. 




L>A 


(l-ShI 


Proof. (15b) follows from the following equivalence of the 
optimality conditions of both problems 


/>(«» - »i)= c*(<A ti!) 


[ 1 


The complexity of the algorithm in Section 2 can he 
dimissed, for 11 characterized hy linear inequalities, by 
invoking its equivalence to the algorithm in this section and 
the relation of the latter to Khuchian's (1^7*^, 
algorithm for linear programming As Khachian's algorithm 
IS known to be convergent in (xdyiiomial lime, its 
equivalence to the present algorithm wviuld ensure the same 
convergence rate for the latter It is shown in Rustem and 
Vclupiliai (IMHhh, IVorems 1 and 7) that the algorithm in 
this section is equivalent to Khachian's iilgohihm provided 
that xlf on the right of the equivalence (15a) is shifted, at 
every iic. in u way that will only affect the stepsizc a* or d* 
above (see Rustem, IWO) 


4. J'hf arhitranness of shadow pners 
We consider the solution to Problem 2. Let there exist a 
quadratic objective function that reflects the policy maker's 
preferences and yields an optimal policy that is accepted by 
the pcilicy maker It is not neccosary that this quadratic 
function should he specified through one of the algonihms in 
Sections 2 and 3 We show Vlow that cither one of these 
algorithms can be used, with a given quadratic function, to 
alter the values of the shadow prices of the problem without 
altering the optimal .solution. T'hc arbiiraiincss of the shadow 
prices for diagonal and nondiagonal Dbiectivc functions 
follows from this observation. This may clearly have 
significant consequences in problems where shadow prices 
arc used to indicate Iht "price” of scarce resources (see e g 
UNIDO. 1^2), The extension of this result to general 


rKinfincar objective functions and nonlinear constraints is 
also discussed below. We begin with the non-diagonal 
quadratic case Hence, we have a matrix and such that 

arg mm {(x - x*', Q^(x ~ i*^)) | jV^x =■ b) = x* e Q (16) 

We do not need to asiume that the inequality (d*. 0*lx* ~ 
x'')):r^O is satisfied. This is due to the transformation 
introduced in the following lemma 

Lemma 1. For a given if ( 64 . C*(x* -x*^)) 0 and 

thence 0 , then there exists a sufficiently small 

a* c (- 3 r., 0 ) $uch that the Iranslormation 

■“ " Jf*') (17) 

ensures that arg min {(x - x*. Q^{x - i^)) | N*x -h) - x^, 
and also F'or (d*, C>*(x* - x*^)) icf). A*with 

r* ““ 1 and thence ijf-x'^ Furthermore, for any sign of 
(* 54 , ^Tl. there exists a sufficiently small 

a* £ +*) Much that &t, I and n* 

Proof To show that x* is still the uilution of the revised 
problem, consider the solution of the latter which is denoted 
by i* Since iV'|i* ■ x* | ^O. we have i* - x* ~ Zw, for 
some vector w Furthermore the optimality condition of the 
original problem yields ( 7 a (^4 x*') A'A* - 0 Hence, we 

can write the optimality condition of the irunslormcd 
problem a.s 1 ) 4 ( 1 * x* i x* - x*) /VA* -• (1 where A* is the 
aSMHTiated shadow price vector. Thus, 

( 74 /H- QJ.i^ - X 4 ) - - C)*(x* " |xa - - x'^)|| 

f AA* ^(A* - xvA*). 

Prcmultiplymg by Z' yields Z\)^Zw - i). As pari of the 
sufficient conditions loi optimality Z'D*/ nonsingular (see 
e g (iill ft cjf , 1981), we have h - () and thence 

i* - x* ~ Zw -I) To show that lir* 0. consider 

^ (Xa X ^)) 

‘ ' ' Lhf't)* yx/'(J,7.) '/'t'.iV) 

Thus can be chosen to yield * 0 
To show' the scamd part of the lemma, we note that for 
(<* 14 , y*(x* r'^)) 0 , the above expression yields Oa ‘*1 

for any positive value of x* including x* 1 
To establish the last part of Ihc lemma, we note (hat 
cIa - I d IS chosen apprtiprulcly using the alxive 
expression for n* and p* "0 provided x* is chi>sen to ensure 
a negative denominator □ 


PropiPsition .3 (The arbiirarmcss of shadow prices) Let A* be 
the vccior ol shadow prices of Problem (lb) and assume that 
these shadow prices are unacceptable to the decision maker 
as a measure ol the ‘price'' of the eoncspimding scarce 
resources represented by the constraints Let A'' Ik the 
decision maker s preferred prices Then m the algorithm of 
.Section 3 we define !>* as 


-^1 (iH) 

then using this value, compute O* ., using (9) • Given Da . i 
and also f* in (17). we pass through one iteration of the 
algorithm to compute 

arg min 1 (.i - , ,(.i - i^)) i ,V'.i ^h] ^ t^,,. 


Then, we have 


Xa.I 


(19a) 


I A* + Q4(A^ - A*) (19b) 

where dr* is given hy 

, C?iK-_***• ^ 

* ( 6 ,. Q,f>,) Z{/.^Qt7) 

(I9c) 


• We assume that the denominator of (9) can he 
computed, at least approximately, for positive semi-definite 
^4 The error of such an approximation can be accounted for 
by an appropriate choice of p* 
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and for and a* jjivcn by ihc last part of Lemma I. we have 

{m) 

PrtMf * We consider the general case when is pcmiive 
scmi-defintle By Lemma L we know that \s unchanged by 
ihc transformation of the desired values. Since /\V«“(L 
expression (lOal yields 

fc ^ ^ ^ C?* ^ I ^ I - AI 1 ) “ a . 

Similarly, expressiem (Ulb) viclds 

A,., - A, ■ d,(A''A‘t '\'\I - ’/') 

x| \|A^’ A, 11 

and thence we have (19b) 

Ihc last part of the proposition follows from the ability to 
sc! 6* - 1 by chiKtsmg and Oa as cslablishcd in Lemma 1 

r I 

Thus, It Is possible to select (\ such that it will not alter the 
optimal solution x\ hut will change the shadow prices to 
achieve the preferred shadow prices. A'' 

We consider the diagonal quadratic forms and ufKiaies of 
the desired values that achieve the same effect as the at>ovc 
proposition W'c stale Prnj>i>Mtion 4 with slightly greater 
generality in (hat we do not assume that is diagonal, but 

simply fixed W'e do run use to uptlale (f* and. while 
keeping consiani. we icmsc Ihe desired values as iii 

Section r 

Prf}pfmii<>fi 4 I,el A* Ive the vector of shadow prices ol 
problem (lb) and assume thal these shadow prices arc 
unacccpiahle to the tlecision maker as a measure ol (he price 
of Ihe corresponding scarce resources rcf)rtscnicil hv the 
consirairils Let A^ he the decision maker s preferred prices 
Then in the algorithm ol Section 2 we define i\ as m (iHj 
then using this value, compute 

r/., T' f 

for some given value ol u* We pass through one iteration o( 
the algorithm to conipute 

arg mm | {x - (i ■- x ); i A'' x -- h ) - x^ ,, 

IhcMi. wc have and 

. 1 - A, aJA'' - A* |. (2ft) 

and with the choice ti* I. we have A^ , , a^'. 

Proijf l et T' be the desired value used in (Ih) Using Ihc 
same argiimcnls as in (7). we have 

.1,., V, /h - /A/'iJ,/) '/'CMa* ' 

The optimality condition of (lf>) yields 

C^fr, «") A'A, -0 (21) 

and (Si IS given by (IK) and as /'A' ft, wc have 

. 1 ■ Ai - I) 

To establish (20) consider (H) which can be rewritten as 

• I ~ ^^ Qk [^i ^ 1 ■■ I'i - A* - 1 

Using (21). (18) and i*., - x^ 0, this yields (20) 

The choice of a* - 1 immcdialcly yields A* ^- A'* using 
the same arguments as above □ 

Tbc extension of the above arbitrary nature of the shadow 
prices can alscj be extended to nonlinear amslraints and this 
is considered in Rustem (1990) In Theorem 2, wc discuss the 
case when the desired values arc updated lo alter Ihc shadow 
prices of the nonlinear problem 

• In this result (?* i’* assumed to be positive dcfmilc 
All that ts needed is that ^ x"')) ^0. Provided 

(his condition is satisfied, wc can arbitrarily change (he 
shadow prices 


Thtixrfm 2 Artnirahness of shadow prices lor nontiiiear 
problems when the desired values arc updated Ixt 

Q^l\ o - TjfdJlA'’ - AJ 

then 

ensures that 

arg min (( i i^. C>*(i ,i^)) j i t G) 

and 

arg mm ((i - i*. e.(» - i)) I » < G) " »» , i' «i 

and (urihermurc. A*,, A^' 

/V>o/ From the optimality conditions ot bolh problems we 
have 

e.d. > 1 ' CM>. ,)(>'■ A.l 

- Vv(r,)A'' 

Hence Ihe solution ol the second problem is given by and 

A'' [■] 

( (Afu /usionv 

Ihc fHissihiliiy o( amsiructirig quadiulic objective 
functions with diagonal weighting malntTs, or Hessians, is 
desirable Ixith in terms of I'oinpulHtional ctinvcnience and 
mterpreiubilily The extension lo nonlinear consiruinls 
pt'imils Ihc wilier applicability ot (he results 

llie arbiiraiiness of shadow prices seems in be an 
iniuilivciv obvious concepi Yci Iheie hiin been nuinetous 
iitiempis in ihc past to use Ihem ns (he price ol scttice 
resources or aciivines The two procedures discussed, one by 
Ihe updating A)f the weighting nuiirix and the nthei by the 
ujvdating of the desired values, iictually auiHiruct arbitrary 
shadow price values wiihoui altering the optimal solution 

AikntfwiciJfiemrnix The linaruial support ot tiSRt* is 
gtaiefiilly acknowledged The pajH-i has also benefited from 
the comments of iwo anonymous retcrecs and from valuable 
discussions with Rohm Hcckci 
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A Hierarchical-multiobjective Framework for 
Risk Management* 

YACOV Y HAlMEStt and DUAN Lit 

Key Wowto—ljsr{{€ sc^lc sy5tcm.s. mk . multiobiectivc opiiiiDZJilion; hicriirchiciil 
rrlinhiliiy 


Abstract —llic management of risik is adilrc.sscd in Ihis pji|Kr 
within the broad hierarchical-muliiobjeclivc framework 
Such a framework incorporates the hierarchical nature of the 
deasion making prtKciw: the multiple deciMon-makers at the 
various levels of the system’s hierarchy; the rnuliiobjcciive 
nature of large-scale .systems; and the quantitative/crnpincal 
and the qualitaiive/normative/judgmental asfx'cts ITirce 
major topic's dominate the methodological comf>orycnts of the 
paper hierarchical-multiohjectivc coordination, risk ol 
extreme events and impact analysis Various application 
problems arc used as a vehicle to a>mmunicalc the 
methodological framework with the readers 

I Introduaion 

Risk a mi ASi'kt of the probability and sc’veriiy of adverse 
effect,s—has become during the last decade a subject of 
intense study by scholars Irom diverse disciplines In 
particular, the process of risk iissessmcnl and management, 
which cnctimpasscs several steps that include the idcntilica- 
tion. measurement. quaniihcaiion, cvaluatmn and 
managcment/control of nsk, has gained cross-di.sc:iplinary 
attention that spans engineering; the natural, behavioral and 
MKial sciences; law; medicine; and business administration 
Previous research in sUK'ha.stic modeling and optimi/.alion. 
nevertheless, by and large addressed the quantitative, 
empirical aspects of risk management separately from the 
qualitative, normative and judgmental considerations, which 
arc the driving force.s that ultimately influence the 
decision-making process The fiKus on the former and the 
dc-emphasis of the lallci have l>cen counter to the holistic 
foundations upon which systems engineering is grounded 
Ilii.s paper attempts to capture some spccilic characterisiics 
of risk as.sessmcnt and management within the overall 
decision-making process If one accepts the premise that the 
decision-makmg process itself i.s driven by multiple 
conflicting and noncpmmcnsuraic objectives and that 
large-scale organizational and technological systems arc 
charactciiz^^d by inherent hierarchical structures and a 
hierarchy of decision-makers, then the princess of risk 
assc.ssmcnt and management can he best undcrstcKKl, and 
thus mcKklcd. via a hicrarchical-multiobjcclivc framework 
Furthermore, the thesis of this paper is also grounded on the 
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prcmiM: that nsk nianngemeni should Ik an integral part of 
technology management, not a vacuous afteilhoughi Ihrec 
major topics dominate the incihiHiological com|Hments of the 
papet hicrarchical-muluohjeclive coordination, risk of 
extreme events and impact analysis Applications from the 
areas of ihc niainicnance of infrastruclure and Iknid warning 
and evHcuiiiion sysfems arc uhhJ tis a vehicle to communicate 
the methodological framework lo the readers 

2 Muluptf nhfffiive aspnn 

Ufwnince (197b) makes a clear distinction iKiwecn riik 
and ,safciy Measuring risk is an empirical, scieniific activity 
(e g measuring the probability and sc^verity of huim), on the 
other hand, judging iuilely, which is a normalive, jxilitical 
activity. IS judging the accepiability of risks 11ie distinction 
between nsk and safety is at the heart of multiohjeclivc 
trade-ofi analysis Clearly, the determination ol bow sale is 
vale enough requires a balance among all ciisls. iKnctiis and 
nsk.v-—attributes that are measured and perceived in 
different, noncommensurule uniis For example, o classical 
mulhobjeciivc analysis might involve trading off the. spending 
of an additional $1000 pc*r day for the reduction of one part 
per billion (ppb) of irichloriKthylenc (ICl) m a 
municipality's contaminated groundwater (given that the 
contamination level is already at 10 ppb and $2 million has 
already iKcn spent m cleaning up Ihc aquifer that supplies 
drinking water to a communiiy of 20,tMNI (KO}>Ic). Such an 
analysis i.s also a risk management problem where the 
empirical act of measuring the risk of contamination must Ik 
followed by the normative slep ol determining Ihc level of 
risk that is dreined acceptable by the decision makcr(s) 

During the last two decades, the licid of miilliple cnicria 
decision making (M(T)M) has grown by leafts and hounds, 
developing Irom a primarily uiility-lhcory-oricnled M:hiHil to 
a diverse and balanced philosophical mtcrpretalion of 
utilities, attributes and objectives, More spcciHcaJly, the 
nonutilitanan school of thought advances the prcmiiKs not 
only that it is extremely rlrfftcull if not actually impossibtc in 
practice to model the preferences of a deciiiion-maker (or ol 
a group of decision-makers) through a uuliiy function, but il 
IS al,M> not needful or desirable to do so Tins premise is 
supported by the observation that the utility of a 
decision maker is likely to be highly iHmlinear and 
dynamic --(.onsianlly influenced by transient and cxogcmius 
elements that cannot be accounted for quanlilalivcly. 

The nonutilitanan muliK>bjcctjvc lrad€-<.)ff approach (c.g. 
Ihc use of the surrogate worth trade-off (SWT) methiKj 
(Haimes and Hall, 1974)] i« particularly appropriate for risk 
management because the acceptability of nsk is invariably 
driven by a host of perccpliom, heuristics, and biasea—a 
reality that tends to inffucncc and shift Ihc judgement of an 
acceptable risk level from an abtoluie venue toward a relative 
one that is suhjca to continuous changes and mcKliffcations 
(Kahmcman rt al , 19H2) Iliis fad coupled with the 
hierarchical strudurc of m<»sl large-scale systems and the 
hierarchical nature of the dedsirm-making process (as will 
be discussed subsequently) renders the hierarchical- 
multiobjective framework for risk management a natural 
imperative 
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F Id I Water disti 

^ Hifwchical a\pn r\ 

Most org'iini/^tiifnal as well as lechnological syslems arc 
hierarcKical in nafiirc, itnd thus the management of risk of 
such systems is nccessiiiily driven by this Fiicrarehical reality 
and must l>r responsive to it The risks asMK'ialcd with each 
subsystem within the hierarehical structure contribute to and 
ullimately delcrriiine the risks of the overall system riic 
distribution of iisks within the subsystems olien plays a 
dominant role in the alliKaiion ol resources within the 
organixational or technological system T his is manifested in 
the quest to achieve a level ol risk that is decmcil acceptahlc 
in the normativtvjudgmentiil ticcisinii making prcKrss, when 
(he trade iifTs among all the costs, Ix'nefils and risks are 
considered 

Perhaps one of the most valuable and critical contributions 
of the hierarchical iTuilliobjeclive (ramew'ork to risk assess- 
meni and managemcni is its abiliiy to facilitate the 
eviiluiitinn of the risks assovialeil with each subsystem and 
Ihcir corresponding contribuiion to the overall risks of the 
total system In the planning, design oi operaiional mode, 
the abiliiy to model and quanlily ihe risks contributed by 
each subsystem to the overall system markedly laciliiates the 
identification, quantification and evaluation of risk In 
parlicular, Ihe ability to model the intricate relationships 
among the vaiuuis subsystems and to aeeount for all rclevanl 
and imp<irlanl elements of risk and uncertainty renders the 
modeling process more tractable and ibe risk assessment 
priK'Css more reprcsentaiivc and encompassing C onsider, 
for example, ihe problem of maximi/ing the availability 
measure of a mamtainahle mfraslruciure system It is known 
that a given level of availahiliiy measure can be achieved by 
many difTereni c^nnbinaiions of leliahility and mam 
tamabilily Reliability is detined here as the probability that 
the system i.s operational in a given time pcrKul I he system's 
reliability can be improved by applying a cerlain class of 
preventive muinicnancc fKilicies, such as an 'age ’ jwilicy or a 
"block" fHihcy Maintainability is delincd here as the 
prohahility of the duration of the system's downtime 
resulting from either scheduled or emergency shutdowns 
The syslem s reliability or the mainiainahiliiy of each of ns 
sub,systems can be iiule|X'ndcnllv impnivcd if there is no 
budget consinjiiii. In most real world situations, however, a 
resource lirnilaiion usually acts as the driving force, and 
iradcofTs thus exist between the reliability and (he 
mainlHinubilily of the overall system 

Hierarchical control, when applied to risk managemcni 
systems, induces a harmonizing effect over the subsystems 
and contributes to the holistic approach within which the 
overall system is viewed Fault tree analyses {V S. Nuclear 
Regulatory Commission, 1981), for example, is a widely used 
analytical IikiI that decomposes the overall reliability 
problem into several levels of reliability problems and 
systematically calculates the fiiilurc rate of the overall (hip) 
event from the lower level to the upper level Studies aiming 
ul developing risk management strategics using dccomjH^^ 
lion and higherdcvel coordination are currently under way. 
Dealing with a low-dimensional muliiobjcciivc optimization 


i .I ... . , 

^ y ; -'r- . \ 7 , ---t. 
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ihutiori system 

problem and identilying the impact of the subsystems’ 
reliability on the overall system’s performance, a preferred 
Pareto optimal Milmion of a large scale overall syslcrn can be 
reached by introducing coordination among the sufssysiems 

4. //lerurrAiruf mu/Ziob/Cf /iPt' /rarTiPK'r>r^ for lar^t" si ak 
in/rmYruffurc prnhlerm 

In the preface to a major study by the U S Naiumul 
Academy of Engineering (1988) on infraslructure, Robert R 
White stales that "infrastructure is the term applied to 
large-scale engineering systems and includes an array o( 
public works, such as roads, bridges, and sewer systems, as 
well as privately managed utilities such as electric power and 
telephone service ’ I'hus, the fundamental chaiaclcnsiics o( 
infrastructure problems lie m their large nuniK'r of 
components and subsystems Most water distribution 
systems, for example, must be addressed within a iramework 
of large-scale systems In addition, a hierarchs ol 
institutional and organi/ational decision-making structures 
(e g. federal, stale, county and cily) is often involved in 
determining the best rcplacemcnt/repair strategy A cerlain 
degree of coupling exists among the subsystems (e g, the 
ovenill budget constraint imposed on the overall system), 
and this further complicnles the management of such 
systems. Different rcplacemcnl/repair strategies lor different 
.subsystems often have different impacts on the overall water 
distribution system, the needs for the resources and their 
apFXopriatc alUxaiion have a diverse impact on the reliability 
of the overall system. 

ITic modeling of deteriorating water distribution systems is 
a fixal issue in large-scale infrastructure problems (Andreou 
et <j/., I9K7, Mays and C ullinane, 1986). A water distribution 
system may consist of many sulssysiems I he type of complex 
water distribution system considered in this paper is a 
series-parallel network. One example is given in Fig. 1 

11ic unreliability of an overall water distribution system 
can he expressed as a function of the unreliabilities of the 
water distribution subsy^lems 

—/v) ('•D 

where h] is the unreliability of the overall water distribution 
system and ^ I, 2. , A. is the unreliability of the ilh 

water distribution subsystem. For the example given in Fig 
I. one possible decomposition may be as follows 
Components I. 2, 3 and 4 constitute subsystem 1; 
components S and 6. subsystem 2: components 7, H. 9 and 
10, subsystem 3; components 11, 12 and 13. subsystem 4; and 
components 14, 15 and 16, subsystem 5 T’hc associaied fault 
tree is given m Fig 2. The overall system’s unreliability is 
given by 

In most ca.ses, ihe optimiiation of a water distribution 
system is difficult to handle as a whole Hierarchical 
(multilevel )-mul(iobjcctivc approaches (Tarvamen and 
Haimcs. 1982, Li and Haimes. 1987a. 19H8; Haimes and Li, 
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Fi(. 2. FauU tree of the water distrihulion system 


lyHK; liairiics cl al , I^W(tb) solve lar^c-stalc muliiohjcctivc 
optimization problems by tlccomfxiMlion anti upper-level 
awrdmalion In general, the structural nature of multilevel 
detomtxiMlion show's the (nllowing advantages 

(1) OccomtMisition methods can reflect the intcrrutl 
hierarchical nature of large-sciilc multiobjcctivc systems. 

(2) Trade-off analyses can he performed among subsystems 
and the overall system, and 

(3) Through decomposition, the uimplexiiy of a large-scale 
multiobjcctivc system can be relaxed by solving several 
smaller subproblcms 

Assume that the following water distribution system 
consists of A subsystems Ihe nvcriill system's mufliohjcctive 
optimization problem is posed as follows 

niin|f|(( i.. ,( v),/>(/,, ./v)!' (4.2i>) 

Mibjccl Id >, -- m,| 1-1,2, . . . N (4 2h) 

m,. yj 0 I 1, 2. . N (4 2c) 

1-1.: , .V (4 2d) 

where ( , ‘ ( 'n, . \\) and / • , rn,, y,) are the cost 

function and the unreliability of subsystem i, rcs|>cctively. 

S' 

Fi 5^ (\ IS the overall cost and F, ,/m) is the 

overall system's unreliability, y, is the output of subsystem t, 
m, IS [he control of siibsysicm r, Ji, is the interaction input of 
subsystem i, H, represents the system's equation of 
subsysicm / , g, repicscnis the constraints of subsystem r: and 
IS a matrix representing the interaction between 
sul>sysicm i and the other subsystems, 

The optimization problem for a water distribution system 
will he used as a vehicle to present the hicrarchical- 
multiobjcclivc framework for risk management At the lower 
level, the overall optimisation problem can be dcconipo5kCil 
into several smaller water distribution suiTsystems. which arc 
interconnected by fixed values of cxMirdinalion variables set 
by the upper level llic ciHirdination variables often 
correspond to economic meaning, eg. shadow prices. AI the 
upper level, the coordinator adjusts the ccKJrdmation 
variables according to the trade-off values among the 
subsystems and the overall systems. 

Assume that the upper-level deasion-makcr’s preferences 
expressed in terms of trade-offs arc available The internal 
indifference trade-off vector A' in subsystem i is then 
obtained by mapping the indiffcrciKe trade-off vector, 
[1, A, 2 (F,, Fi)l, of the overall system into each subsystem: 

A- = [i.A„(F,,F,)|5] (4.3) 

Spccifk values y* arc selected for output vectors y, at the 
upper level at iteration k in the feasible decompositton 


methiid. llicii the overall system can be dewmpoiwcd into N 
subsystems, 


imnl( ,(i^, m,, i‘),/(x,, fw,. y,*)! 




subjcii toy* « m,) 

(4 4b) 

1 

(4 4f) 

.vf) s*‘* 

(4 44)) 


where the trade-off vector A' generated by equation (4.3) is 
imptrsed on the subsystems by the higher level cxHmiinatoi to 
generate the prrfcrred solution of the muliiohjective 
opittni/ation problem given in (4 4). 

In the nonfcasiblc melhod, the l agiangian multipliers 
asMW'iatcd with (4.2d) are used us the CiXirdmalion 
parameter Assume that .su|X'rscript A is used to iiulicait 
values assigned by the upper level ill iieiaiivm A ITie 
opiimizaiion problem for each sul>sysiem i then bc'coinrs 

(m,. V,) ♦ (v‘ jv, ( vj) I, 

A(T. T) 

subject to V, - ffj K' t4M') 

i,. m,, vj - () (4 Sc) 

where the itade-off vector A' gcncraitMl by (4 T) is imfxised 
on the subsystems by the higher-level cixirdinator to 
generate the preferred solution of the mulliohjrctive 
oplimi/ation problem given in (4 S) 

Based on (he soluiioris generated al the lower level, the 
upper level modifies the values of the tiMirdiiialion variables 
and sends them back to Ihe lowti level this ilcralion 
prfKcvs IS repealed until nil optimal conditions are met 

^ Ri.sk o/ eirrerrif events 

S 1 f^neri'irM Bv its niilure, an uncertinn event defies our 
ability Us characterize its state m terms of one single definite 
numlxr Indeed. Ihe miKlcliiig of a niiulom variable through 
a prohuhiiily density (uiulion ((xlf) consiiiulcs the l>e.M 
quantitative chaiactcn/ation of an uncertain event In effect, 
the pilf assigns a probability lor the occurrence ol the 
uncertain cvcni at a given level within a prespccificd dimiain 
In our quest to simplify the decision-making prixess under 
uncertainly, it has Ixtn a c^immon practice to use the 
expected value of Ihe random vanahle as the sole criterion 
that represents the prohahiliiy and .seventy of Ihe nindom 
variable Often, the expected value is ux‘d as Ihe rn^k 
measure asMXuitcd with Ihe random variable 

Reconsider, for example, the contamination of a 
groundwater system with the known citrcinogcn trichloro¬ 
ethylene (l‘('E). vSmcc the coiiccniraiion of TCT in the 
groundwater cannot fx* known for certainly, a p<if can he 
generated on the basis o( a sampling and nUHleling effort, Ixl 
X be Ihe random variable represrnimg the coniTnlration ol 
TC'E in parts per billion (ppb), lei pjx) lx the probability 
density function (pilf) of the 1(1' concentration, and let 
r,fx) be the cumulative distribution function (edf) of the 
TCT concentration. Then, the expected value l'AX\ of the 
aincentration of K'E in the groundwater system is given by; 

ATX) - I .rp,(ji)djc (5.1) 

Note that the expected value is a malhemaiica) art if ice that 
commensurates concentrations (events) having high values 
and low probabilities with concentrations having low values 
and high probabilities. Such an averaging prrKcm, while 
helpful in .some rciipcch, can distort the true danger (risk) of 
extreme values (of T(*E conceii I ration), leading to 
complacency and ultimately to disasicrs Experience has 
shown, rime and again, ihal when the expected value is used 
as the sole index for risk, it often leads to Ihe do-nothing 
option On the other hand,, when a different index, the 
conditional expected value (an index that measures the 
probability and seventy given that the event excurs in a 
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range of probability or a range of ftcvcrity, e g 
K'E cnncenlratiofi) is used, the do-noching option oficn 
becomes ai» mfcrior one fhe expected value of advenwr 
effects, wha'b has been the mmi common'y used measure of 
riik, is in many eases inadequate, since this scalar 
re present at ion of risk commensurate^ events that correspond 
to all levels of losses and their as.MK:taicd probabilities Ilie 
common expected value approach is particularly deficient for 
addressing extreme events, since these events arc concealed 
during the amulgamatum of events of low probability and 
high consequence and events of high probability and low 
consequence 'fhe partitioned multiobjcclivc risk method 
(PMRM) and its extensions (using results from the stalisiic^ 
of cxtrcmcM) provide a valuable UK)I in the quantification and 
evaluation of risk focusing on extreme and catastrophic 
events (Asf>eck and Mairnes, IMM; Karlsson and fiaimes. 
l9KKa, l9HKh; Mitsiopoulos and Haimcs, 1989) 

rhe PMRM IS a risk analysis method developed for solving 
nuiltiohjectivc problems with a probabilistic nature Instead 
ot using the traditional cxt>cctcd value, (he PMRM generates 
a number of conditional ex[>eclcd risk functions, given that 
Ihc damage falls within spccilk probability ranges (or 
damage ranges). Assume the damage (K'fi concenlration in 
the groundwater ease) can he rcprc.scnicd by a coriliniious 
random variable A'with a known probability density function 
where ‘ .q. is a control (Kilicy The 

PMRM partitions the probability axis into three ranges 
f)cnotc ihc partitioned points on the probability axis by a,, 
i I, 2 f or each o; and each j>olicy v^, it is assumed that 
(here exists a unique damage such that 

(^ 2) 

where IS the cumulative distribution function of A', These 
(with and /J,^ representing, icsfKclivcIy, the lower 
Ixmnd and upper bound of the damage) define the 
conditional expectation as follows 


rp,( \. V ) d\ 

1 - 2. 3. 4 

, (-VT) 

/ - 1 , .q 

p.(i. v^) lu 

where /,. /, and icprcscnl the risk with high prohuhilitv ol 
exceedance arul low damage, the risk with medium 
probability of exceedance and medium damage, and the risk 
with low probability ol exceedance riiui high damage. 
resfH'ctivcIy 

■f'he uncorulilional ex|K’Cled value of A' is denoted by Af v,) 
The iclalii»nship between the conditional expected values 
(/'.A / 4 I unconUiiional expected value {t\\ is given 

bv 

rdS) - 0 (S 4) 

where fl,. 1 ■' 2. 4. is the denominator of (.'>.3) 

( ombining one of the generated conditional expected risk 
functions or the uniHmdilional exjKCicd risk function with 
the cost (unction, /,. creates a set of muliiohjeciive 
optimi/tiiion problems: 

min I/,./;I' 1 - 2,3. 4. .S (3 5) 

subject to the system’s constraints 
Solving the family of the aUivc muliiohjeciive opiimiza^ 
lion problems offers more information about the probahilisiic 
behavior of the problem than the single multiohjcctivc 
formulation of ininiini/ing the cost and the unconditional 
expected risk function. min[/,,/s|' The trade offs between 
Ihc cost function /, and any risk function /], i t (2, 3, 4. 5) 
enable decision-makers to evaluate the marginal cost of a 
small reduction in the risk objective given a paniculiir level 
of risk assurance. The relationship iif Ihe trade-offs between 
the cost funciion and the various risk functions is given by 

where 

A,.-. 3t\/3f/, A,, >0. 1-2. 3. 4, 5 (5.7) 

IS the trade-off value between /, and / in (5-5). Knowledge of 



this relationship among the marginal costs is useful for the 
decLsMin-makers to determine an acceptable level of nsk. 
Any muliiohjeciive optimization method, e g. the surrogate 
worth trade-off (SWT) method (Haimes and Hall, 1974; 
Chankong and Haimes, 1983), can be applied at this stage 

While the muJttobjcclive nature of risk-based decision¬ 
making IS obvious from the preceding discussion, its 
hierarchical nature deserves more elaboration (Li and 
Haimes, l9H7c) Indeed, rarely are policy options on 
important and encompassing issues formulated, traded off, 
evaluated, and finally decided upon at one single level in the 
hierarchical decision-making pnxess. Rather, a hierarchy that 
represents vanous constituencies, stakeholders, power 
brokers, advisors and administrators and a host of shakers 
and movers constitutes the true players m the complex 
dcci.sion-making process. Relating to the groundwater 
contamination problem in the U S context, one may view 
Ihc U.S Environmental Proicclion Agency (EPA) as 
representing the higher level in the hicrarchical- 
multiobjcctivc decision-making framework (notwithstanding 
the fact that the USEPA itself has ii.s own hierarchical 
deci.sion-making structure). ITie lower levels include the 
Department of Natural Resources of each of the 50 states (or 
the .slate’s EPA) down to the regional, .slate and l(Kal levels 
Eurihcrmorc, concerns about the expected value of 
contamination and the conditional cxjxxtcd value of extreme 
contamination with TC'E vary within each level of the 
hierarchy, consequently, the n.sk measure.s vary correspHind- 
ingly At the upper level, the USEPA may consider 
long-term effects and a much broader geographical area, 
whereas at a lower level, a hxal government may consider a 
.shorter lime horizon and a much more localized geographical 
region 

5 2 (lassificahon of n\k~<'(miroi ITie class¬ 

ification ol systems on the basis of their response to extreme 
cvcnl.s can lx* valuable to the decision-makers in their 
qualiliitive/normativc evaluation of the acceplablily of risk 
(El and Haimes. E>9(l) Such a cla.ssiticalion might also 
provide an insight into the impacts that current decisions 
might have on future risk management options 

If a control has the same impact on the risk expectation 
anil on the conditional risk expectation of the extreme 
events, we call this class of system ’systems with neutral nsk 
control" fn other words, the control is “ncutrar' in terms of 
minimizing the expected value and in minimizing the 
expected extremes 

If a control has different impacts on the risk expectation 
and on the conditional risk cxpecialion of extreme events, 
we call this clas.s of system "systems with risk-manipulatahlc 
control" In mo.st eases, risk management strategics make a 
greater reduction m the measure of the conditional expected 
extreme than m the measure of the expected value 
Furthermore, for systems with risk-manipulaiabic control, if 
the minimization of the ex|>ocied value is consistent with the 
minimization of the asstKialcd variance, we call this type of 
system "systems with mean-variance consistency nsk 
control" 

Finally, when there exists an inconsistency between the 
mean and the vanancx, minimizing (he expected value and 
the expected extreme may conflict with each other. We call 
this class of system "s>^tems with mean-variance inconsis¬ 
tency risk control". 

live classihcalion of risk-control systems can also prove to 
be useful for researchers in the held, it provides a taxonomy 
that is based not only on the nature of risk but also on its 
impact 

6 Impaa ana/yxLs 

6.1 Oi'cnnew OckhI technology management ncccasanly 
incorporates gixxl risk management practices Determining 
the impacts of current decisions on future options, however, 
con.stituics what might be termed as the imperative in good 
decision-making Managers, public officials and other 
decision-makers arc commonly rewarded, promoted and 
otherwise honored not because of the large number of 
optimal decision,s thal they make during their tenure in 
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olRce; nitber, they arc acknowledged pnmanJy and 
dominafiUy for the few di&asimua dcdsioiis ihai they moke 
This trend cipUim, to a large eotent, the cimibervative and 
often ngid attitude of bureaucrais who avoid unicKlcd paiiu 
and experimental optKMix llie ahdity to model and oaacm 
the impocti* of currcni risk-hoiied deciMom on the stair of the 
sy&icfn in the future can ihuus prove lo he a potent tod in 
decision-making This abiltiy is pajlicularly valuable for 
risk-hosed decision-iiiaking associated with dynamK systems, 
where decision^moken often need to haiance shurtHcrm with 
long-term objectives. 

In this sense, impact analysis rs paramount to "looking 
before you leap" In particular, stage trade-offs in dynamic 
systems are needed to measure the impact of the vanations 
of the objective functions at the present stage upon the levels 
of the objective functions at the remaining siages. Impact 
analysts thus priivides useful information that might avoid 
adverse and irreversible conscijucnces resulting from whai 
might be perceived as an optimum present decision 

Consider, for example, the risk management problem 
ossoaalcd with hood warning and evacuation systems 
(Haimes rf u/, l^la) In general, such systems can be 
decomposed into a iwo-levcl structure. Two subsystems 
constitute the lower Icvcl—the forecast subsystem and the 
LXimmunity response subsystem Based on hydrological and 
meteorological information and oliscrvalions. the forecast 
subsystem calculates the forecasted HikkI crest By its nature, 
there can be no perfect forecast system, and two types of 
errors of forecasts occur fype I errors are the missed 
forecasts and Type fl are the false alarms The performance 
of a forecast system can be best judged by some statistical 
measures. The fraction of people in the community whi» 
respond to the ttixxl warning constitutes the stale variable of 
the community response system and is dependent on the past 
performance of the forecast system Type II errors (false 
alarms) have a “cry wolf effect and markedly reduce the 
system's credibility (thus decreasing the future rc.sponsc of 
the population to warnings oi to evacuations) Fhe general 
interaction between the forecast subsystem and the response 
subsystem is given in Fig 3 The task of the second level 
LXKirdination is lo set a w'urnmg threshold, which can be 
preassigned such that a ffinkJ warning will be issued when the 
forecasted (1(H>d crest is higher than the warning threshold. If 
the warning threshold is set higher, there will be a few false 
alarms and more missed forecasts, and vice versa Type I and 
11 errors have different impacts on fltXKj-Um reduction. A 
missed forecast results in an immediate fkx>d loss, while a 
false alarm reduces the population response fraction in the 
future. A lower response fraction will cause a higher flocxl 
loss; thus, there exist trade-offs between short-term and 
long-term risk management objectives 

6 2. Hierarchical impact analysLs Inr fttHfd warning 
.mrernt ITie ttotxi warning and evacuation system will be 
used as a vehicle to demonstrate the hicrarchical- 
mcthtxlological framework for impact analysis. t>cfinc H lo 
be a random vanablc which represents the actual fl(K>d crest 
and S to be a random variable which represents the 
forecasted flood crest. If the prior probability density 
function of the fkKxf crcsl ls denoted by g{hj and the 
conditional probability density funclion of s, given h, is 
denoted by f(s |A), then the posterior probability density 
function of h. given forecast j, is 

f{h\,)^-f(s\h)g(h)/k{s) (6 1) 

where k(.i) is the marginal probability density function of 
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Fig 3. Intcmaion between forecast and response 
subsystems 
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Booed (III hydrological and dimatic tnforntition. both 
observed and historical, the forecast suhsystcni piondes the 
forecasted value r of the flood crest. From the Bayesian 
(ormula given in (6 1), the prior representation of the 
uncertainty asscK’iated with the fl(K>d crest is then updated to 
• posterior form fih |.t) 

Tlic flood warning threshold i* is introduced in the 
following context: 

(a) No flood warning will be tssued il a < a*, and 

(b) A flood warning will be issued if a 5 * 

In other words, a fkxxl warning will be iauixl only when the 
forecasted flood crest j exceeds a preassigned threshold level 
r* Ihe selection of the fliKHl warning threshofd dtreclly 
affects the evacuation aciion which is implemented by the 
community response subsystem 

Ajuume that the elevation of the fltxidplain *one under 
consideration is y ; the proliabilily then that this /one will be 
flooded, conditioned on the forecast r. is P(h y 1 1 ) There 
exist lour possible outcomes that folkiw a flcHxi warning 
decision a correct warning that is a warning followed by a 
flcKvi. a false warning that is a warning not followed by a 
fliMxJ, a missed warning that 0 a fUnid event not preceded by 
D warning, and a correct quiet that is an event of no warning 
and no fliKid Ihc probability of a correct warning is 


v) “j (6 :<) 

The probability of a false warning is 

v)j Pih • V I .v)A(i) dv (6 4) 

The probability ol a missed fliXHl warning is 

| .0*(.«)ilv (6.5) 

All 

The probability ol aenng i'oiecily in not issuing a I1(x>d 
warning is 

n6- v l r)A(,,)ai (6.6) 

All 

It is clear from (6.3)-(6 6) that the value of the selected 
threshold r* plays a key role in determining the probabilities 
of Type I and T ype II errors If the threshold s* is scl lower. 
the forecast will have a lower probability value, T,,,, of a 
Type I error and a higher probability value, / p,, of a Type II 
error. If the threshold .r* is set higher, the forecast will have 
a higher probability value .n,. of a Type 1 cnor and a lower 
probability value of a TyjfK II error 
Denote the fraction of people in the community who 
respond to a call of evacuation by ttf lor the 7 Ih flood event 
If a past flood event has been predicted, then the confidence 
in the forecast system will incTcaie. and thus, future rates of 
response will also increase On the other hand, a Type II 
error will decrease oonfidcncc in ihe forecast system, thereby 
decreasing future rales of response. The experience of a 
missed warning will decrease people's crmfidcncc in a flood 
warning system and increase people's alertness to the 
possibilities of future flixxls. For simplicity, it is reasonable 
lo assume here that the rcsjxmse fraction will remain 
unchanged after a missed warning has been experienced. Il is 
also reasonable to assume that a correct quiet does not 
change the response fraction m the future. In view of the 
above discussion, (he fraction Of can thus be asaumed to 
evolve dynamically as a umirollcd stochastic process: 


♦! 


r,(l - Ot^) withpfoh. PijUf, y) 

Or wiihprob. y) + ?„,(*;.>.) 

. Cj«7 Pin(.»r. y) 

(6.7) 


where the values of c, and Cj arc between irero and one and 
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can Kt clctcmiincfj uiing icknufKactoi) mcth<Jils hai&cd <in 
ht.moncat dii(;4 

*rhc fkKMJ Wi*rnirtg ihrc'khoiil caiifiot he- Kkctcd in 
ai each ^tage since the dccisjon-maker must balance the 
desire for high present ttrKKl-liws reductirin with the 
p<xs.sihility of high future fUnxI lr>im. A muliiohjcctive 
multistage ciptimi/atiun mixlel can be adopted to hnd |hc 
optimal values for the HcmkJ warning threshold at vartouii 
stages IFvaluHlirig the trade-off between short and long term 
effects leads to an acceptable balance between the cupcctcd 
Ions reduction at the current stage and (he future response 
fraction that is the key clement in fUMid-loss reduction 

Assume that there are N successive ffwid events in the 
time hori/oii under consideraiinn Denote the cKpecied 
property-loss reduction at the 7 ih HikkI event by 

.1 *, yl. and the esf>cc(cd lifc-Uwvs reduction at the / ih 
Hood event by /!(cv,, vj", y) I’he maximi/ation of three 
noncommerisuratc/connicting objective functions is con¬ 
sidered The lirsi uhjcciive is in muximi/.e the sum of the 
expected property-loss reductions of all Hood events over (he 
time hori/on under consideration; the second objective is to 
maximi/e the sum of the expected life-lims reductions of nil 
Hmid events over the time horizon under consideration; and 
the third objective is to maximi/e the forecast system’s 
credibility, which is implicitly expressed by 7:'fOyv.|). the 
expected fraction of jKople who respond to the warning 
beyond the time horizon under consideration. Malhemiili 
cully, this ovciull mulliobjcciive optimization problem can be 
posc:d as follows 



I j\ ■ f \ ■ I o V , I ) I 

Mibjcci to (6 7). 

rhe multistage riuilliobjcctivc optimization problem in 
(6 H) can be effectively solved by muliiohjcctive dvnunuc 
progiiimming approaches, such as the envelope approach by 
tj and llaimcs (I^K7b. I‘IKK) I'he set of noninferior 
solulion.H provides the decision-maker the best solutions In 
balance the short- unci long-term objectives and to avoid 
adverse consequences resulting lrt)m what niight he 
perceived as an optimum fnescnl decision 

7. ( pnc/iiMorL) 

Risk tind uncertainty are lundainental elements of modern 
life, they are ever-present in the actions of human tarings, 
and are frequently mtigmiied m large-scale icchnological 
systems (‘.nginccring systems, for example, are almost 
always designed am! opi’rated under conditions of risk and 
uncertainty and are often expected to achieve multiple and 
c'onHicting objectives. Success is gauged tiy engineering, 
economic, legal and scKial criteria In make a rational 
choice, the decision-maker must evaluate the alternatives in 
light ol all these criteria, analyze trade offs between them 
and make a final decision that combines engineering analysis 
with S4)cielal preferences These complex and interrelated 
forces necessitate that risk and uncertainty he managed 
effectively within a holistic framework 1'hc prop<rsed 
hierarchical-multiohjcctive framework constitutes the build¬ 
ing blocks for ri.sk management in such a holistic framework. 
Those private and public oTganiznlions that can successfully 
address the risk inherent in »heir business—whether future 
pnxhict design, resource avarlability, natural forces, market 
changes or the reliability of man/machinc systems—will 
dominate the icchnological market 
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Expert Systems—Principles and Programming* 

Joseph C. Giarratuno and Gary Riley 


Rnwwrr: R JIROUSEK 

Czechoslovak Academy ol Sciences. Inshtulc ol Inlorniatiun 
Theory and Auiomaoon, Pixi vodarenskou ve/i 4. ( S 
Prague 8, Czechoslovakia 

Expj ri SYsn ms —one ol Ihe most Ircqueni terms in miiriy 
liclds ol present human professional acrivuics r^ a term 
provoking a lol of questions and contradkiory opinions On 
the one hand, the motto ‘ the problem is uui hard to copi* 
With, we need an cx(>crt system" has pcneit.iied the 
subconscious of many specialists and managers in-chicf. 
on the other, there are Mill pajx'rs publislxd. such as 
Streitberg (1988) stating the nonexisiciue of “real cx|K“rt 
systems 'Hiough there is nti exact definition of the ex|K'il 
system unanimously accepted by the Ariificial Intcliigcnce 
community, the notion has gained its indisputable place in 
AI and has become a regular part of Af courses for both 
undergraduate and gradualc students 

The bfHjk by Joseph Ciiarralano and (iary Riley is the <mly 
one I know which aims to serve as a basis for courses on 
expert systems supplemented w-iih a term project enabling 
students to develop skills in their design and piogramming 
For this pur]X)sc, the second pan of the binik presents a 
detailed account of an expert system programming language 
( LIPS and the f>ook is supplemented with disc containing a 
complete, executable expert system iiki| integrated W'lth the 
text 

CUPS (( l.anguage Integrated Proifuctioii System) was 
designed and develi>pcd at the Artificial Intelligence Section 
of the NASA/Johnson Space Center to facilitate laborious 
programming work connected with building expt“rt systems 
Regarding the differences between writing a program in a 
priKTcdural language and implementing an expert system, it is 
very important for students to complete one or two small 
expert systems of then choice flicir task should not lx* only 
the implementation of Ihe given techniques hut the project 
should consist primarily of choosing the most appropriate 
method (or the problem in question hir this purptisc, a 
wide range of methods and techniques useil lor knowle<lge 
rcprcsenliilion and processing in expert systems eimstilules 
the cnntenl ol Ihe first part of the book 

As already mentioned alxivc. there is no exact delinilion of 
the expert system In be called an expert system, a program 
procluci has to meet several requirements There is a 
common consensus about some of them; others are claimed 
only by some authors. And yet, it is very difficult, almost 
impossible, to say that some requirements arc more 
important than others All this wavering is reflected quite 
naturally in the first part of the introductory’ Chapler I 
'Fhough there is only one paragraph cniifIccJ "What is an 
expert system”, it lakes, in fact, nine of them to amw'tr the 
question The remainder of Chapter I is devoted to 
explanation of the most popular techniques and paradigms 
employed in expert systems today In addition, as an 
example of a prospective technique, antficutf neural .vv.irrfn.v 
arc introduced 

At this place I would like to stress one very p<»sitivc 
feature of the whole book Whenever a new term is 
mentioned, it is illustrated with examples and relations in 
other similar concepts arc explained When, for example, 
production systems arc introduced, the authors do n«i rcsirict 
themselves only to stating that knowledge is rcprcsenied in a 
form of IF-THEiN rules, and go back to the history and 

• Expert Systems—Principles and Pmgrummmg by J (’ 
Giarratano and G Riley P.W S-KENT, Bemon (I9K9) 
lSBN0«7g353356. £16.9.S 


show the origins of the pr^sductHin (ruk bavcd) systems in 
Post productum .rysferfu and Markov aiy^orukms 

The same pedagogicjil way of prescntalion is used also in 
furthci parts of the b<x»k that expand into a detailed 
diseuvsion on the theory (oi rather iheoHts!| behind expert 
sy-stems The theory explains advantages and diiMidvantiiites 
of individual meihiHis and iheirroit its knowledge is 
necessjiry when designing an expert system for a spedlic held 
of application (hapler 1 describes difltrent ways of 
knowledge represenialion I'hough the mmi p<ipular 
technique o Kau*d on productions, the authors bring in also 
\emanth nets and frumrs 'Hicy do not explain only sciifKTS 
and advantages of these methods hut also difhcullics with 
their appiK'ation (a paragraph describing difficulties with 
pfoduciion sysiems i.s unfonunaiely missing). A lulislanlial 
pun of ('hapter 2 is also devoted to logic: proptmuonai /ogir 
and onkf predkatr logic fins creates a necessary 
theoretical background for ('hupfer 3 dealing with meihiHts 
of mierence In (his chapter, rrsidutwn, Ihe primary 
inference mechanism of PROLCXi. is explained But 
naturally, in accxirdancc with other chapters, the authors pay 
iitteniion to several other methods like deduction, indwfion, 
ahduciion or mmmtmoiomi k ' ov-i of tnfereme All theia: 
mcthiHls arc again described on examples and compared with 
one another 

Accepting the authors Maiemcni that 'in (he real world 
we arc seldom iibsolulely sure of anylhing cxcepi death and 
taxe.s” (ami I Ixlievc this fact is one of the main im^mlsex 
leading to Ihe origin of exfxrt syslems). one has to consider 
( hapicfs 4 and .*> u» be among the moxl important theoretical 
parts of Ihe fwiok I>iey form a wide survey of methods 
designed for both reasoning under umxrtainty and inexact 
reasoning In contrusi with logical approach dcscrilKd in the 
previous chapters, these meihixis are important fot expert 
system application involving uncertain information The 
uncertainly may apply to lacts (data), knowledge (rules) or 
Ixiih. A numlxr of techniques has been suggested to deal 
w'ith uncertainly in expert system hut .some of them arc 
heuristic, no! supported by a malhcmulical theory, li is a 
virtue of the Ixxik that it emphasizes theoretically sound 
approaches based on either clawdul prolHthdity theory. 
Dempster Shafrr theory or Zadeh'n /mzzv thnoy All 
three iipproachts arc intrmluccd in Ihe biKik with help of 
examples some of which arc ustul .several limes to show the 
dilTcrcnccs Ixlwcen Ihe individual nuHlel.s. 

I have hitherto commented mainly poaitive aspects of the 
hrxik Now, I would like lo menlion a certain imperfection 
aflcrtmg presentation of some Ihcorclicul parts and iaxuing 
from Ihe extensive choice of theories included in the bcxik 

For example, when the classical probability theory is 
presented, basic terms like sample space, random variahle, 
prohahi/ify clLSirthufton, conditional prohahility or 
independent events arc explained and illustrated with 
examples Nevertheless, the authors do not intri>duce 
concepts like multidimensional distribution which would 
make ptxcvibic to define the dependence between random 

variables .the notion used to represent knowledge in most 

of the probabilistic expert systems Similarly, when 
discussing resolution as the principal inference rule in 
PROLCXr It might lie useful to mention its ways of 
implcmcniaiion and connected problems (fhough it can be 
found quite easily almost in any PROLOG manual) 

With a limited rmim for introduction of theoretical 
foundatums of each described method it is fairly difficult to 
determine what can be omitted To offict the subjectivity of 
their decision, the authors have supplemented caldi chaplet 
with bibliography ft enables the tccturem. who take the 
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brMik u KaMii tor iheir c<^urM;M, to go into more detail in the 
parts of fhcir choice and to skip Mime others Tliere is no 
doubt that from this point of view the bcHik is a success 'Tins 
feeling IS incteased also by the fact that each chapter is 
supplemented with exerciM:i and proNcms, NeverrhclcMi, the 
biMik taken as the only Miurce of information may leave a 
reader with a ralher sufierficial idea about theory of expert 
system Ixi us stress that this fact does not. however, 
decreaM.* the value of the IxHik as the basis for lectures on 
cxfKTt system theory and programming For this reason. I 
would like 10 repeal Ihe words from L A. Zadch's foreword 
Joseph Ciiiirrutorio and (iary RiJey deserve the thanks of all 
of us for undertaking a difficult task and making an 
impirtanl contribution to a better understanding of the 
fundamentals of experl systems' 

Hr/frt'fue 

Strcilbcrg, b (I98KJ On ihc nonexistence of ex^Krt 
systcm.v-”< nlical remarks on artificial intelligence in 
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Large Space Structures: Dynamics and Control* 
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Auioma iic control of large flexible space structures is nnc of 
the key issues in future spacecraft design The problem is 
cbaraeieri/ed by controUstructure interiietion resulting from 
(1 high ruimhcr of densely packed siruclural modes wilhin the 
control system bandwidth or close to it, combined with 
stringent micro gravity level or fHiinling performance 
requirements examples (or control systems of the first type 
arc in-orhil manulacluring facilities with large solar panels 
and of the second ly|X' arc very large space telescopes and 
laser pointing systems requiring (Hunting and target tracking 
to an accuracy of 0 01 arcsec or belter The problem to be 
solved is lliercfore not how lo control or stahili/e some large 
slruclure somehow hut rather hi>w to design both structure 
and control system in order to meet stringent system 
engineering requirements in an optimal way. This has to be 
kept in mind m order to trame the right question and solve 
rhe real problem. 

For this new type ol space systems, control engineers and 
mechanical engineers have to come together curb on a 
system engineering level it> properly match control .systems 
and siruclural design parameters to meet overall require¬ 
ments. and to predict on orbit performance of the space 
platforms as closely a.s possible These two steps, control 
.system design and overall (lerformancc evalualion, require 
different types of mathematical models—in particular those 
of Ihe .structure; a design model approximating the cs.scntial 
features of the system and a validHlion or truth nunlel 
approximating the real system as closely as pnissihle 

Mathenuilical models used in control system design have 
to properly represent transfer functions and responses 
between vsciisors and actuators, e g. those liKatcd on 
different points of a structure It is on this requirement that 
the mathematical modelling of the structure for control 
system de.sign has been bused Approximaiions which are 
quite different from the ones which are commonly used in 
.structure design may lead lo better and less complex control 

• /.urge Spacf Struattres. Dynafnirs and Contro/ by S. N 
Atluri and A K Amos Spnngcr. New York (1988) 
ISBN()-38M8<,HI(F9, U S. S89 50. 


ligurations. Lven Ihe extreme ca.se has been demonstrated, 
where control problems which were unsolvablc or only 
solvable at the cxpenH* of large complexity became .solvable 
with technically feasible controllers by re-cvaluuimg the 
modelling approach The iterative priK'cdurc between 
control system de.sign and mivdclling approximation is 
therefore the (irsl key issue m control-structure interaction. 

The second key i.vsuc is how it) design robust controllers to 
stringent performance requirements under high levels of 
uncertainty in the mathematical model itself due to the finite 
iipproximatitins used, Ihe model parameters and the 
disturbing environment Rohustnc.ss is required to a.s.sume 
stability and minimum in-orhit performance in the lir.si place 
while tine tuning can he done later by m-orhii identihcaiion 
and adaptation of control configuration and parameters with 
the spacecraft already flying in its real environment 

A third key issue is verification of mathematical models 
and closed ItKip system performance by cleverly designed 
cxpcnmcnls on ground and in orbit. Even with the powerful 
design uxds available nowadays, the imprirtancc of doing the 
right tests on u component as well as on a control system 
level cannot he overemphasized, (^nly hy testing can it he 
proven that the control system design problems have been 
solved correctly and that the nght problems have been 
solved- Concerning dynamics and control of large flexible 
space structures, we arc, with all three key issues, just in iKc 
beginning. 

llie monograph on dynamics and control of large flexible 
spac'C structures addresses the first two key issues Its fifteen 
chapters which are written by structural dynamicists and 
control ‘'theoreticians" are intended to give the status of thi.s 
highly interdisciplinary subject and an indication of future 
trends vStimulating early research work is reported; 
unfortunately the chapters stand pretty much hy themselves 
and arc only very kwscly related lo each other. They arc, in 
general, well wriiicn and give adequate references. In 
accordance with the status given in the monograph, the 
desired interaction between structural and control specialists 
is not yet achieved. The chapters on structural modelling on 
one hand oversimplify the control problem, and the chapters 
on control system design, on the other hand, are based on 
lincanzed modal characieristics (an approach which is well 
supported by practical experience so far) but do not question 
the assumptions. The weakness of the monograph is that the 
underlying control performance requirements, which are the 
real cause of the problem, arc hardly stated at ail and that 
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loo few realistic eiampfcs arc given lo dcmomiraic ihr 
appbcabiliiy of the described procedures although these 
examples arc surely available (Auburn and LorcU. IW; 
Elbufii and Higashiguchi, 

Fortunately there arc exceptions: In ihe chapter on 
'Modal Cost Analysis for Simple Cominua ' Hu. Skelton and 
Yang use modal cost analysis as a tool for seIcctKin of hniic 
clement models and base the ncceasar>^ modal reduction 
decisions on control objective functHHis. The “Model 
Control Inseparability Principle'' is demonslrnlrd on the 
particular example of an Euler-Bemoulli'bcam C 4 :«vcr* 
genoc of modal costs and of the closed loop design to a 
satisfactory level is better using quintic beam elemenls 
instead of the commonly used cubic ones llie physical 
background behind this is that in control system design, 
accuracy of modal shapes and slopes is more important than 
accuracy of modal frequenaes. 

The limits of finite dimensional approximations and misdal 
representations arc discussed in two chapters Zak in 
“Dynamic Response to Pulse Excitations in l-arge Space 
Structures" investigates stress pulse propagatitin along 
repetitive lattice type structures including reflections and 
transitions at joints. He suggests modelling by system 
equations with delay arguments. Von F-lotow m 'The 
Acoustic Limit of Control of Structural Dynamics" 
distinguishes isetween modal analysis with u global 
de.scripiion of entire structure and wave propagainm analysis 
based on .scattering properties of ItKal components He 
defines the acoustic limit of structure dynamic miHlclling by 
the limitation of modal analysts which is the sensitivity of the 
dcn.sely packed high frequency modes in iniHlelling errors 
Beyond this limit, mi^dal equations are useless (or control 
system design Alternatives arc active control of lower miHles 
and passive damping or ItKal active structural control based 
on acoustic mtKlcls Lhis is dcscnlx’d us '‘travelling wave 
control". Various examples for travelling wave control are 
given including cxperirricntai verification 

In “Continuum Modelling of Large Lattice .Struclure^", 
Noore and Mikulas develop equivalent continuum models for 
large repetitive truss and frame lattice structures of the beam 
or shallow shell type Numerical examples arc evaluated on 
the basis of frequency comparison with (inite clement 
approximations 

In “Nonlmoaritics in the Dynamics and ( onlrol of Space 
Structures" Atluri and lura deal with nnnlincarilies 
stemming from large deformations and rotations of the 
.structures and their members, changes in the inertia matrix 
due to ihc.se deformations, damping due to nonlinear 
hysteresis and flexible joints and nonlinear behaviour of the 
structural material. Tangent slitfncxs operators and tangent 
inertia o[>cralors arc defined for piecewise lineuri/ation. The 
concept of active control or damping by pie/o-ceramic 
actuators that arc bonded to the truxs and frame members in 
various liKalions is considered in detail 

Friction forces at structural joints and mtcrlacc.s are 
possible elements for energy dissipation and passive damping 
but may also he the cause of limit cycles in closed liKip 
syxlcms. In “Dynamic Friction" Srinivasan develops refined 
models to de.scnhc friction between contacting surface.s The 
investigations arc backed by numerous experiments 

Modi aruJ Ibrahim develop in “On the Transient Dynamics 
of Flexible Orbiting Structures" relatively general formula 
lions to describe arbitrary multi-btxly systems where each 
body may have an arbitrary clastic structure The idea is to 
develop a comprehensive data bank for spacecraft with 
flexible appendages. The formulations arc applied to the 
orbiler with deployable flexible appendages 

In “A Review of Modelling Techniques for the Open and 
Gosed-Loop Dynamics of Large Space Structures" Bainum 
compares various approaches to structural modelling and 
control system design. 

In “Computational Issues in Control-Structure Interaction 
Analysis" Park deals with general solution procedures for 
dynamical problems. The relevance lo control-structure 
interaction is not shown and the examples given are from 
outside the area. 

Meirovitch in “Control of Distributed Structures" bases 


his atntrol system design solely on modal lei'bniqties It is 
unfortunate that no numerical examplea what to ever art 
given lo show the fcasibiliiy of the cxtndusions 

Tlierc iie only three chapterx on control system design in 
the stricter tense fexxised on httw to achieve robust control 
under uncertainly in model equations, mi^del parameters and 
syslcm disturbances 

Lynch and Banda in “Active Control for Vibration 
Damping" use iintar quadritH: Gaussian with loop translet 
recovery (LCKT^l-TR) design technique" to develop a robust 
vibratmn control system l.OCi/LI'H modifies the ainven- 
lional LCXi prciWcm into a Kx>p shaping problem which is 
dealt with through the singular values of the open Uxtp 
iransmisMon matrix The ailvaiiiage of the methtsd is that 
amirol ohjcctives can intuiiively be rcprciicnlcd as bounds in 
the frequency domains and that it allows for establishment of 
uncertainly profiles based on Ihe diflefcnce between the 
design ami truth model In the numerical example given, an 
active vibration damping control system is designed using 
LOfi/l TR technique foi a two bay truss Mruciurc It w 
dcmonsirated that rohiiMness rectwery has to be balanced 
versus iiituation power and that the ctmirol (xiwer 
requirements set the limit on how closely a liesired open Uk>p 
shape may be approximated 

Bernstein and Hyland m “Optimal Projcciuvn for 
Uncertain Systems" extend the standard l.QCi to cx»vcr 
reduiTd order constraints on the dimension of (he dynamic 
compensAior and uncertainty miKlcHmg of deterministic 
parameter uncertainties and stochastic dislurbancjes vSomc 
mimeriad results tire given to ct^mparr (he optimal 
projection approach to various I CX» reduction techniques 
In this comparison optimal projection sc’ores very well 
Unlortunutcly the authors describe the underlying problems 
oniv vaguely uml refer the reader to (he relcrcnces. 

Kosui m "Adaptive (onlrol of Large Space Structures" 
uses adaptive unccriarnty mcKleliing in obtain frequency 
domain expressions lor chanicicn/ing a “set of unccnuiniy" 
within which the true plant lien It is suggested that the 
adaptive prixTss, referred lo as adaptive calibration is used 
to extract the set of uncertninty from online measurcmcnlH 
thus providing an approach to iniuhit redesign and fine 
tuning of the control system Ptirarneiric .system identification 
IS used to obtain ;i nominal estimate of Ihe plant transfer 
function Nonparamelrit spectral estimation mclhmls arc 
used to obtain a frequency domain cxprcKsnin for the mcHlcI 
uncertainly of the nonunal estimate ‘Die resulting eoniroller 
i.s designed to be robu.sl with respect Ir) the estimated set of 
uncertainty A large set of uncertainty will lead lo a low 
authority controller and a small set of uncertainty to a high 
authority controller The uncertainty estimation procedure is 
applied lo a laser fKiinting and control experiment, giving 
promising results 

llic last two chapters are devoted to simultaneous 
.structure and C4mlrollcr design optimi/uiion They prepare 
the way tor tradc-ofls of controller versus structure 
c<»mplcxity Parameters lo be optimized are structure weight, 
txmirol power consumption, siiflncss of mcmlK'rs, etc 

In "Unified Optimization of Structures and C'antrollcrs" 
Junkins and Rew start out from the “Eigenstructure 
A.ssignmcnf Theorem" and discuss two recently developed 
gcneraluEations of Ihe quadratic regulators for robust 
cigcnstruciurc assignment Ibey exchange the nonlinear 
algebraic Riccati Etquadon by the simpler linear algebraic 
Lyapunov Equation in the determination of the optimal gain 
matrix In the numerical example of structure versus 
controller design a two body structure exmsisting of a rigid 
body with a flexible beam attached by a tortional spring is 
considered The problem is solved by sequential linear 
programming techniques The different design objectives 
considered arc minimum eigenvalue sensitivity, maximum 
stability robustness and minimum mass They lead to 
distinctly different solutions for actuator locations, structural 
parameters and optimal coniol gains and impressive mass 
savings I1ic chapter is theoretically interesting and 
ambitious so that one would really like to see more than 
simplifled examples 

In “An Integrated Approach lo the Minimum Weight and 
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Optimal (Vtnlrol Dciiign ot Space Slruciuret^" Khiit conJudcrH 
two approiichcM to minimize stfmUurai weight, under 
comtrainh tin ciowed ifK>p eigenvaiuc^ and urntrol gain»i' 
norm. 

Unfortunately the underlying cxamplcii arc different and 
allow no compariMm of rcnuUfi. 

Modelling and control of large flexible %pace Htructure o 
prencnily iiivc$tiguicd and applied in many places and one 
can hardly expect one b<K)lc to give a full account Of the 
mtxxing Mubjcccs. I want to mention at Icdhl a few of 
engineering importance. For netting up mathematical nuMlcIs 
of complex xtruclurcn, the Craig Bampton Component 
Mmlel Analyms is to \yc mentioned. On the control side high 
authority control/low authority control (HAC/LAC ) is 
barely mentioned, One ( onirollcr at a Time (CC A'I), Filler 
Accommodated Model Frrors Suppression (f AMFSS) and 
Positivity arc not mentioned at all. f’hesc methods have been 
widely studied and even tested in various research program.s 
(Mitchell e/u/ . IMK4, IMKS) 

The monograph is not a lextb<H>k for learning ft addre.sscs 
the researcher in the fields of Dynamics and Control of I.arge 
Space Structures, and for those .s|>ccialists it is highly 
recommended. As a practising engineer m spacecraft control 
system dcKign, 1 enjoyed very much reading it: My adrenalin 
level was continuously high either from excitement or 
criticism Fhe monograph is restricied to the theoretical 
trcutmerii of problems only, rhe third key issue verification 
and tc.st is n<it addres.seiJ 'Ihe reader of this review might Ih‘ 
mlcrestcd to Icam that the Aerospace C ommittee of IFA( 
held a work.shop on "Modelling and Validation of Flexible 
Aerospace Structures and Aerospace ( onlrr)! m Huntsville. 
Alabama in April 1I 
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Applied Control of Manipulation Robots— 
Analysis, Synthesis and Exercises* 
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Modelling, Analysis and Examplest 

Miomir Vukobratuvic 
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Computer and Automation fnsiitutc, \ \^^ Budiip<.‘st. Victor 
Hugo u. lH-22, Hungary. 

Ai-TI.^R a sucx'cicsful scnc.s of six volumes on robi>tics, we now 
receive two further ones authored by the same |>crson and 
xchcKil: Miomir Vukobratovic, a professor working with the 
Mihajlo Pupin ln>stitute in Belgrade, Yugoslavia. The two 
new volumes are devoted to the dynamics of manipulation 
robrjis (i.e. on the most widespread type of rofniis) and on 
Ihcir control. Tbey arc tcxtlxxiks of undergraduate and 
graduate courses, a thorough guide for learners of modelling, 
analyius, synthesis and design. The course is defined by this 

* Applied Control of Manipulation Robots —4mj/v.vo . 
Synthesis and Exeremes by M. VukoTHauvvic and D. Stokk 
Springer, Berlin (1989) 470 pp , 100 Hgurcs. ISBN .V540- 
5146M. DMTTg mi 

t Applied Ihnamics of Manipidaiton HolhfLs — Modelling. 
Analysis ami Examples by M Vukt>bratov!c. Springer, Berlin 
(19KV). 471 pp., 176 Hgurcs. ISBN .KS4<F.S 1468-6 DM 138.00 


objective; it provides as few detours lor general knowledge 
or information about the broad subject as possible, and as 
such is noi a usual review of robotics 

lliis goal determines Imth the values of the approach and 
its limitations The main thrust of b<ith volumes is the 
computation procedure of robot design and therefore all 
detailed calculations, equations with multidcgrcc of 
trccdom, muliijomt constructs are given with a very practical 
addition of the corresponding computer programs wnlicn in 
Fortran-77 

In the tirsi volume, an mirixfuctory part deals with robots 
in general and their classihcaiKm This introduction, 
however, more serves the further chapters than gives the 
usual insight into techniques and application, a.s it is specially 
oriented to the understanding of the further text, i.c. the 
requirements of the different degrees of freedom for 
manipulation. 

The thrust of the first volume is in the seamd chapter, and 
extended over three quarters of (he basic text, more than the 
half of the appendices, and references It provides the 
complete mathematical model of the manipulator robots and 
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iheir dynamics Spenal attention is given u> vibraiHHt, 
flexible manipulatHHi ami cocnifinaicd manipuUiion pnib^ 
lems. These arc extremely delicaie cakutaium tasks, 
deformation and vibration are propagated by the loinis to 
funher parts of the robot, having different kinds of degrees 
of freedom, and most of the results are onginaled by the 
author himwU or by his sehixil under his aientitk 
leadership These delicacies are mostly neglected in the usual 
textbooks, handbooks and general reviews of the subject, yet 
they play a relevant role in practice Several limes they are 
the decisive factors of appropriate selcelMin of the robtu and 
of dcicciion of the limits of its usage. The third chapter of 
Vol I is virtually a research report bv the author on 
linearuaiion and sensitivity calculations which lead to the 
computer models of the design A surprising anangement ol 
the book is this volume’s nine appcndK'trs, (instituting hIhiuI 
the half of the full text This is understandable from the 
objective of the course; the reader should get a detailed 
practice in these very specific calculations, and those who 
complete all these should master the method, and not only 
know about it in general 

Tbc same refers to the other s'olumc SomcK)dy who has 
an expertise in dynamics should continue in the same wav in 
control In a rather similar way to the first volume, the lirsi 
chapter gives a general overview of robot control, the second 
chapter that of the kinematic level of control with a special 
attention to its basic problem, the inverse* kinematic and the 
synthesis of the lra)€Cl(uy based on the same Here the third 
chapter contains the mam thrust: the syntheso of servo 
systems and how the individual control elements should be 
designed (or the lulfillmcnl of the overall manipulation task 
I'his is synthcti/ed in chapter 4 dealing with the sinmltaneous 
motion control with a stHcul attention to the stability and 
the possibility o( a decentralized control Ihc global control 
follows in chapter 5. variable parameters and adaptiviiy in 
chapter b and the consideraiions nl motion eonstiainls m 
chapter 7 I'he construction of the second volume is slightly 
dificrcnl from the lirsi, the appendices (ollow irnmedintelv 
the chapters partly for exercises, partly lor amendments for 
.^omc more delicate details I hc slighi dificrcnces m the style 
of the two volumes is due lo an ass<K:iaie author, Dragan 
Siokic of the same group, hut also to the specific research 
mtcresls ol the authors wfuch unavoidably shill the 
proportions ol treatment in the direction ol those details 
which arc closer to their (K*rsonal scdpe ol activity Fhe 
authors offer the cornpulei programs ol these calcul.ilioiis as 
soliwarc products with documentation pfcpaicd lor IBM F'( s 
Who should be the reader of these iMKiks ' Ix'ss application 
people than those who intend to design the mechanics and 
control of manipulators However, the course is very useful 
lor anybody who will go luriher in his/her Ide m the design 
of any moving mechanical systems and their control .Such a 
thorough exercise, detailed analysis, synthesis practice is a 
lifetime cx|K:ricnce nl what should fse considered in the 


deygn of a mmpkx, inicramiicclrd, dynumH; system, bow 
should the controls of iiHtividunl avntfionefits atHl Uftkv 
should be aHvrdinaled. and how mnny vicw|WHiiis whinikl be 
aKnpromised In educutmg efigmeen the ndH^il oiniiol 
prcpiire the young gmcruiiim kw nil the lijsks they will 
encounter in itieii lilets—technology, economy. cKmiiginii 
opportunities—f>ui h dm‘i|>liniiry training, an liitcrnal drive 
lor a profesitional appomch, a hard lesion ol a ccrliin task 
completion is » kgacy for a whole jirofcssioiial life. What 
would I like to see scmirhow dittcrrnf ’ firstly, a more 
didactic intoHluclMin to each topic, starting with the hasK: 
physio of ilu^ eijuaitims and an iipproach by Doming down 
frtwn a bird sn-yc view to the specific equatKms Tlie auihom 
can answer that thi.v is done by the related cxiurses; but m H 
icxtbiMvk one would like lo m.t more reference to the 
required basic knowledge and view^uni A third volume. 
tntnniut non m may serve this gciKral iiilrtKliKtuHi 

but a guide tor the lull ixiurse, Ihiw lo divide il and how lo 
have a logical amtmuation would have been pre(erred, with 
some ficdagogical hints based on the experience of the 
authors Similuriv. all dtiails of practical reah/atton arc 
omitted, such as icchmdogical problems, economy, etc. 
Ibesc are beyond the ohjcclive ol the authors and the 
reviewer has li' Ih' resigned to it; howevei, the student and 
the design engineer must look at the task in such a totality; 
this IS |UKi the engineering view Omissions arc unavoidable 
il the auilHirs wanted to give .such a detailed guidance lo the 
design of these problems; they a>uld not get into all the 
topics of n general survey On the one hand this specific goal 
and its ihiirough luHillment is Ihc virtue of the bixiks, hut on 
the olhci. at least the interlaces to others should be given 

Ihcse are minor remarks from a diflcnng viewfKiint, and 
do not refer to ihc value of the unique c<nio*c I'he series and 
Its predecessors are unique undertakings and therefore not 
only Students ol rolsoiics and kincmahcs but all people 
involved in robot design should have them on then shelves. 
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Dynamic Models and Discrete Event 
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* Dymimic Models and [H%rreie Event by W. 

Delaney and E Vaccari. Marcel Dckkcr, New York (IWB 
ISBN fk8247 7654-2, U.S SW 7S (U S ). $119 .50 (other 
countries j 


'f ill BASIC aim of the authors is to provide a wide public of 
undergraduatcfi with u sysiematic approach to mockUing and 
lubseqiient Mmulating of real life pliemimena (syticms) I'he 
model is perceived as an abstract reprcsenlation of a system 
allowing reproduition of the system's behaviour (to varying 
degrees of a>mplciencss) aiming at elucidating one'x 
understanding of the system and prcdkting its future 
behaviour The braik is rKit about control ITic emphasis is to 
clarify the limitations and potentials of models at least from a 
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conceptual point of vtew, wilhoul relying un Kigh level 
icchnical/mathcmatical development 

The Hm half of the biK>k m devoted to the fundainental 
4y»icm/infoimalion thciiry problem ‘Ffoin raw data to 
model s Model identification issues arc discussed for a large 
variety of mixlelii: c^mtinuous time/diserete time, 
drierminmtic/Kiochatic. lumped paramcter/distrihuied sysi* 
eim, time invariani/non-staiionary, autonomous/foived. 
lincar/mmlinear. 

The Hccund half is more concerned with software 
engineering issues related to simulating, i c algorithmically 
approximating the behaviour of the model on a digital 
computer. The important application of Nimulatkin stressed 
here is its role in guiding experiment design and data 
conditioning for miKlcI identification and sufisequcnl model 
validation. 

Examples and cxcrcisc.<i are amply provided Some 
simulation studies arc presented in great detail using the 
BDSIM general purpose simulation package developed by 
the authors. 

The mathematical and computer science background 
required to access the material is kept to the hare minimum 
An elementary knowledge of linear algebra and calculus 
together with .nomc Fortran (^) literacy suffices to understand 
the technical content of the book. The material is intended to 
he easily accessible by any science or engineering student in 
the second year of the curriculum 

As far as I am aware the l>ook is unique in its kind. It is to 
the authors* credit to have tried to accomplish the above 
daunting educational task Most available icxtlxHiks cover 
cither the system theoretic aspects or the software 
engineering (simulation oriented) issues and none require so 
little prior technical knowledge of the reader Morciivcr most 
(undergraduate) IcxtbiHiks dealing with system theory arc 
only concerned with very limited classes of systems (typically 
(hose for which control theory is well develo(Krd) and hooks 
alHiul linear systems abound Nonlinear systems are less 
popular and discrete event systems arc largely forgotten 
OiKid graduate level textbooks or reference texts dealing 
with modelling identification (at least lor linear systems) arc 
ttvailable (e g C'ames, IMHH; l.jung, H7 An excellent senes 
of articles by J t' Willems (Willems, 1986) can al.so be 
recommended. Di.scrcic event systems seems to be more the 
realm of simulation oriented textlxuiks (e g. Hulgren, I9H2; 
Fishman, 1978) 

Unforlunalcly, I he authors have opted lor breadth rather 
than depth Although they state do avoid su^Krlicialitv. 
concepts and logic development arc strongly cmphasi/cd 
the biH)k gives a rather confused, blurred view on both 
miHlcllIng and simulation (falsely called a system theoretic 
approach) Moreover, the interested reader, who wants to 
read more to obtain a clearer picture, is not referred to the 
correct literature, at least as far as the system theoretic 
asfHTcts arc concerned (none of (he aUivc references arc 
quoted) 

The basil notion of system is defined m ( haptcr I on page 
I as “a set ol subsystems, related so as to form a unit " The 
following 51) pages fail to elucidate this definition" In the 
same chapter concepts as environment (‘influencing hut not 
Ireirig influenced") inputs, outputs, .states, behaviour, 
causality are equally confusedly introduced About 4(1 
Tundamenial" concepts arc proposed witht»ui proper 
delinition If the student is not lost at this point, and not 
completely disgusted with the apparent imprecision of 
"system Iheory/philosophy", there is more . 

The next three chapters discuss deterministic, and 
.sUKhastic models rather by example. The c.xposi!ion is 
directed towards identification of these systems ITic 
treatment is extremely superficial, and. therefore, m my 
opinion, unintelligible. How can one hope to convey the 
haste principles tor deterministic systems of stale space and 
input-output methods, stability theory (u.sing energy 
concepts), transfer functions, exact and approximate analytic 
and numerical solution mctfwHls m less than 60 pages’:* Even 
more superficial is the discu.ssion of stochastic systems Here 


the reader is humed from the banic definition of probability 
as given by B. Pascal to the Cromer-Rao bound for 
mformaiKHi content, in less than 200 pages. In the mean ume 
the reader ts cxp<rsed to linear (and nonlinear) regression 
algorithms in correlated noise environment applied to data 
generated by a pofcsibly (mildly) nonlinear system! TTiis is 
quite inconsistent with the educational intentions envisaged 
by the authors CTaniy and understanding arc abandoned in 
favour of encyclopedic coverage of material. 

C'hapicr 5 forms the bridge between the model based firsi 
half and the software engineering treatment of simulation of 
the sequel It discusses complexity as a motivation for 
simulation studies. Tacitly it is aiisumed that it is actually 
possible to build a relevant model (e g from models of 
subsystems) for the complex system. Here and in the sequel 
the emphasis shifts towards discrete event systems. 

flic discussion of sound simulation techniques and the 
interaction between modelling and simulation is completely 
at the descriptive level. No quanlilaiivc criteria for quality of 
software, algorithms and .simulation studie.s arc discu.ssed 
!S<inie generic information about artificial intelligence 
(artdkiai reasoning) and its role in a general simulation 
context is also provided 

As a minor point, yet quite annoying, is the rather 
unfortunate discussion of pseudorandom number generators 
using the Lchmer's congruent method, presented in Chapter 
7 This method is sound but the implementation discu.sscd is 
by no means iicccptablc! (Sec e g Park and Miller, I9KH or 
Fishman, 197H). 

From an educational point of view i1 i.s unfortunate that 
the hiK)k uses Fortran as its programming environment (with 
exception of the artiticuil intelligence discussion, where 
Prolog and Lisp arc mentioned) Moreover no mention is 
made ol the many software packages available for simulating 
(continuous event) systems such as Matrix,. Mallab, 
f:,asy5 

In conclusion, it is a pity that the goals set by the authors 
themselves arc not met in their lxK)k Surely education 
should in the first instance strive (or clarity, not quantity A 
book introducing (at the undergraduate level) modelling and 
simulation in a unilied framework, honouring this principle 
would be most welcome indeed' 
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(with highesi honors), hi.s 
M S.F T in 1959, and Ph.D in 
control 111 I9bl. all (rtmi the 
Uriivcrsily of Calilornia at 
Berkeley 

From 19(il lo 1964 he worked 
al the MU Lincoln l^l>oratory, 
Lexington, MA Since LH>4 he 
has been with the Mi l Flecincal 
Fngincering and C ompuier Science Department where he is 
Profc.ssnr of Systems Science and Lnginccnng He also 
served as director of the Mil laboratory for Inlormalion 
and Decision Systems (formerly the Flcctfonic Systems 
L,ab<rralory) from 1974 to 19H1. He is co-founder of 
AlTHAliiC’H, Burlington, MA, where he is ( hiel Scieniilic 
C onsullanl and C'hairman of the Board ol Directors, and has 
also consulted for other industrial orgam/a turns and 
government panels 

Dr Athan.s is co-author ol Optimal ( onirol (McOraw Llill, 
1966), Systems, Networks, am/ (’omputatinn: Hasu (\mcepis 
(McOraw Hill, 1972), and Av.orm.t, Networks, and 
Compulation Muinvariahie Methods (McGraw Hill, 1974) 
In 1974 he developed 65 TV lectures and accompanying 
study guides on Modern Control Theory He has authored oi 
co-aulhorcd over 251) technical papers and rcp«7rts His 
research interests span the areas ol .system, control, and 
estimation theory and its applications to the fields of defence, 
aerospace, transportation, power, manufacturing, economic 
and command, control, and communications fC') systems. 

He has received many awards including the American 
Automatic Control Council's 1964 Donald P. Eckman award 
for oulstanding contributions to the field of automatic 
control; the 1969 F E Terman award of the Amcnc 4 in 
Society for Engincenng Education as the outstanding young 
electrical engineering educator: and the 1986 Education 
Award of the A ACC for his outstanding contnbulions and 
distinguished leadership in automatic control education. In 
1973 he was elected Fellow of the IEEE and in 1977 Fellow 
of the American AssiKiation for the Advancement of 
Science. He has served on numerous committees of IFAC. 
A ACC and IEEE; he was president of the IEEE C'ontrol 
Systems Society from 1972 to 1974 In additkm he is a 



member of Phi Bela Kappa, Fla Kapfwi Nu and Sigma Xi 
He wa.s associate ediioi of the lEtE 7ransnt*’tn**u on 
Auiomatir Contnd, co-cdiior of the Journal of Dynamic 
Ecfsmffmcx and ( ontrtd and aicvociale editor ol Autismaiica. 


iompk BentMiMMi was l>orn in 
Minsk, USSR, on 16 Febiiiary 
19.S2 He received the M S F E, 
degree from Ihe Byelorussian 
Polyiechnicni Institute, Minsk, 
USSR, in 1979, mul the Ph D 
degree in elccirical engineering 
from the llliiuiis Institute of 
I cchmdogy, Chicago, in I9H4 
From 1975 to IWW), he worked 
IIS an engmeer in the I>csign 
Biircuu of Broaching Machine 
IiHils. Minsk In 19H5, he was ii lecturer and a posldocioral 
research fellow in the Department of Flcctfitul Engineering 
and Coniputcr Science. University of Michigan, Ann Arb<,»r 
At prescni. he is an Associulc ProfcsMir in the Dcparlmcnl 
of Mechanical and Industrial Engineering, University of 
Illinois a( Urbana-C'humpMtgn His curicni rcwrarch interests 
arc in control of distributed piirametcr sysicms, nonlinear 
dynamics, and self-tuning control Joseph Hentstnan is a 
recipient ol ihc 19K9 National Science Foundation Presiden¬ 
tial Young Investigator awaii) in dynamic systems and 
control. 




W, Andrew Berger received his 
M.S E E and Ph D degrees 
from Drcxcl University. Philadel¬ 
phia, PA, Ml 19H4 and P/88. 
rcsfwctivrly Since then he has 
l>ccn Assisiani ProfcsMir ol IJ- 
ectrical Engineering at ihc Urn 
vcrsiiy nf .Scranlon, PA Hix 
research inicrcHts are in the areas 
of Multivariable Systems and 
Digiul Signal ProccsMng Dr 
Berger is a memiKT of the IJiEE 


Jenn-Pral BdiinI was born in 
C'astrcs. France, on 8 November 
iWiI He graduated from Univer¬ 
sity Paul Sabatier. Toulouse, 
France, with a M S degree in 
19H4. and a DEA in 1986. He 
received the drxioral degree in 
control engineering from the 
same university in 1989 Since 
1989, he has been employed by 
C'.l S.l . a company speciali/ed in 
computers and services, in 
Toukmsc. Hi.s main fields of interest include adaptive 
identification and control, optimization and control under 
coast ramts. 
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theory. Mis current ___ 

control, aduptivc control and robotics 


AlcMMdro CMMvole was Nirn in 
Fkrrence, Italy, in I^SK He 
received the Dr ling degree from 
(he University of Flore nee, Italy, 
Since 19H7 he has been a 
Ph D student at the Systems and 
Computer Linginccnrig H^part- 
ment of the University of Flor¬ 
ence Mis research acitviiy is 
primarily concerned with the 
|)olynomial approach to the //-2 
and /y-inlinily optimal control 
rc.sei«rch interests include optimal 


Wel-LlanR Chen was born in 
f aiwaii in l%2. Me received the 
BS degree in mechanical en¬ 
gineering from the Taiwan Na¬ 
tional University. Taiwan, in 
19H4. and the MS and PhD 
degrees in mcchunical engineer 
trig from the University of Cali- 
forniit, Ixis Angeles, in I^H7 and 
I9V0, respectively Dr ( hen is 
now an Associate Professor of 
Mcchunical T.nginccring at Kaoh- 
siung Polytechnic Institute, I aiwan Mis mam research 
interests arc in robust control, .system idcntilication and 
adaptive control. 
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'T 




Diiina.s Chin graduated in March 
l‘>Hy with First ( lass Honours in 
electrical engineering from the 
Nalioniil University of Singajiore- 
UfKin graduation, he started 
employment with Singajxnc 
Aerospace us a Systems Engi¬ 
neer He is currently with IBM 
Singapiue 


AJc«i«idro Dc Lm was born in 
Rome. luty. on 11 Ociuber 1^7 
He received the l^urea in elec¬ 
tronic engineering in 1982. In 
1984 and in 1987, he received 
respectively the Masters and 
Ph D degrees in systems en¬ 
gineering. both from (he 
Univcrsilii di Roma 'La Sapi 
en/a ’ From 1985 to 1986 he was 
a V'lsiting Scholar at the Robotics 
Lalviraiory of the Rensselaer 
Polytechnic Institute. Troy. NY Since 1988 he has been a 
Researcher at the Dipariimcnio di Informaiica c Sistemist- 
ica, Universita di Roma 'La Sapicnzu". His research 
interests arc m nonlinear control systems, with applications 
to induction motors and robotics In this latter area he is 
involved in trajectory planning, mixlcling and control of 
manipulators with elastic joinis and ttexible links, optimiza¬ 
tion schemes for kinematic redundancy resolution, and 
hybrid force-velocity conirtil. Dr Dc Luca is a member of 



IETF 


Jamel lakhfakh was fH)rn on I.*' 
July 1%2 m Sfux, lunisia After 
gradualing from high sch(H)l with 
honors in 1982. he was awarded 
fellowships by the lunisian 
(lovcrnmeni to further pursue his 
undergraduate, and later, gradu¬ 
ate education 

He received his H S.. M S. and 
Ph D degrees in mechanieal 
engineering in 19Kfi. IMK7 and 
1*88), resjvctivelv. all Irom the 
Umversilv ol Illinois at Urhana-C hampaigii From l9Mh to 
P88) Dr lakhlakh served as a research assistant in the 
Department of Mechanical and Industrial E.ngineering and in 
the Energy Systems Division of USACERl In 1990 Dr 
lakhlakh joined the Paulina ( ompaiiy in Tunisia His 
interests are in control ol distrihuied parameter systems, 
optimization methods, adaptive control, and nonlinear 
dynamics 



J. Diislych IS a scientific research 
itvsisianl and senior lecturer at the 
Department of Electrical tingi- 
ncering at Ruhr-Llnivcrsiiy 
Bochum. Germany- Dr Dastych 
studied cleciriciil engineering and 
198.1 submitted his doctoral thesis 
in control systems engineering. 
His prc.scni research activities 
have focused on identification and 
modeling of dynamic .sysiem.s. 
industrial control applications, 
simulalion methods and tcKils, CAD .systems for application 
in conind systems engineering and robust control. 


Gila Fnicblcr received the D.Sc. 
degree in mathematics from the 
Techniori- Israel Institute of 
Technology, in 1988. She was 
then a Lady Davis Postdoctoral 
Fellow at the Fcchnion. Pres¬ 
ently, she is a visiting researcher 
in the University of California, 
Los Angeles. Her research inter¬ 
ests arc in robust control theory, 
where ,she has developed mathe¬ 
matical methiHls applicable for 
stability and design problems, and in optimal control ihesiry. 
Dr F'ruchtcr has been a member of IEEE siiKc 1986. 
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J. S. GlhvHNi fccchxrtJ ihc BS in 
nermfiace engineering, MS in 
engineering mechAnic% and PhD 
in engineering mechtiiiK's (mm 
the IJni^crMiy 4>l Texaii at Autttin 
in l*)70. m2 and 1975. reiipct 
tivcly. He sained on ihc racullie% 
IxiurdK of ifwr University of Tenas 
ai Austin and V^irginia Tech 
before joining the facutty of 
UCLA in 1977 C'uiTinily. he is 
Professor of Mechaniail, Acr 
ospace and Nuclear Enginccering at UCf A His research 
inicrcsis include control and approxinuilion of disinbuled 
systems and adaptive control and identification 



Mkiiacl Ctriinlilr was Ixirn in 
1943 in (irirnshy, England He 
was awarded a first class HSc 
honours degree in electrical en¬ 
gineering from Rugby C'ldlege nf 
Technologv in 197(1 Subsequently 
he obiained MSc (1971), PhD 
( 1974) and DSc I19K2) degrees in 
control engineering Irom the 
I'niversiiy ol Hirnnngham and a 
HA degree iii riiathernatics from 
the Open I 'niversitv 
In 1971 he joined the Systems f:ngiricenng Department of 
CiF.C I leelneal Projects I td as a design engineer, and was 
promoted l<) Senior I ngmeer in 1974 He was then seconded 
to the Industrial Automation (iroup at the Inqx’rial ( (dlegc 
of Stieriee and leehnology lor research into Tandem Mill 
Automalion 

The University ol Struihelyde. (ilasgow , appointed him to 
the Professorship ol Industrial Systems m 19H1, and he is 
now the Director ol the Industrial C ontiol Unit and Past 
('hairman ol the Department ol I leelromt and Llcctneal 
Lnginccrmg Mis group is cimeerned with industrial control 
problems, particularly Ihose arising in Ihe Aerospace, Wind 
Lnergy. Steel. Marine, Lleciricily and Cias supply industries. 
His research interests currently include selLluning and //,, 
robust control theory. mulTivaruible design techniques, 
optimal control anrl estimation theory 

Prolessor (irimblc has chaired several 11 1 I- and ILAf. 
Working (iroups and Societies He is the Managing Ldilor ol 
the Jipurnal of Afiaptive ( (truro! and Signal i*nH€\s\n^ and 
Wits an Associate l:ditor ol Af4romafica Me edited the 
Prcnlice-Hall Inlernaiional series on Systems and Control 
Engineering and was the riencral C hairman (d the IF AC' 
Adaptive Control and Signal Pnxxssinp Symfmsium held in 
Cdasgow. 19H9 

Professor Cirinible was awarded the IF’EL FFeavisidc 
Premium m 197M for his papers on control engineering and 
the CcM>pcrs Hill War Memorial F’n/,c and Medal by Ihe 
Institution of FdectneaL Mechanical and C ivil l-ngmeering. 


Valker Hahn was born in 1954 in 
Dortmund, Ciermany. m I97H he 
got the I3ipl.-liig. degree in 
electrical engineering from Ruhr- 
UnivcTsity in Bochum From 1978 
to 19h4 he worked as a scicnmi at 
Ihc imiiiiutc of ciccirical ccmtrol 
engineering of Ruhr-Univcrsiiy 
Bexhum with Prof Dr-Ing H 
Unbehauen. At that time he was 
concerned with adaptive control, 
especially direct adaptive control 




for nonminimufH'phasic multivariable systems In 1983 be gin 
the degree 'Dr-lng ' 19H.3 he joined the Uhde company m ti 
pnxciis control engineer, and «ince 1985 he has worked a« a 
control engineer tn chemical mdusiry. at Buyci ACf 



Yncnv V. linimri received the 
B S dcgiee in LX>4 from the 
Hebrew University, Jcrusulcm, 

I Mac I, the MS degree, in en 
ginccnrig in 19h7, and the f*h.D 
degree in engineering with dis* 

I met ion (majoring m large scale 
systems engineering) in 1970, 
lH>ih from Ihe Uiuversily of 
( alifomifi ui U>s Angeles 

He IS Lawrence R, Ouaries 
Professor of F nginccfing and 
Applied Science and Diiccior ol the (enter lor Rnik 
Management ol Engineering Syslems td the University ol 
V'lrginia, ( harlottcsvillc, Viiginui He is a former C'hmfmiin 
of the Deparim»‘ni of Systems Frngincenng at Uase Wesiern 
Reserve UniveiMiy. C leveland, OH His lesciirch, tciiching 
and con,suiting aciiviiies are in deciHionMnaking under risk 
iirul unccriiuiiiy and conllicl resolution in liiigc viale syslcms 
within Ihe hiefaichical-multiobjeitive framework, moiivincd 
by his eniensivc studies ol water resources syslcms From 
September 1977 to August 197H. he was the Ainencaii 
lieophysital Union ( ongicsMOiial Science f ellow and sjKiit 
three months in the I xecutivc Olticc of the Ibesidcni and 
eight months with the U S ( ongress He is ihe 

author/eo-iiulhor of five Ixwiks, the most rccein ol whicli is 
Hirranhual Multiohfnfivr Analvdx of Lurjfr Aiu/e ,ViM7emv, 
published by Hemisphere Publishing C oinpany, PWtl He is 
also the cdiloi7ci>-edili>i ol louricen other volumes, the 
aulhor/co-iiulhor ol ovei KKI technital pw|X“rs, I el low of the 
lEF:^!-. iiiul Ollier sosieiies, Vue ( hairman ol the IF-AC 
Systems Engineering ( ommitlec (1987 ‘81) and (orincr 
( hairman ol the ( oininiitce s Working (iroup on Water 
Kesourees Systems He is an AsMXiaie Fklilnr ol 

Aui(/maiua> lft,t frunsavnf)f\s on Svstems, Man and 
( vhi'rnetu.s, ( (fntnd Theory and Aditamed ‘Trehnotoffy. 
fnformation and DeriMon /rchntjloffirs, and Hrlwhihfv 
Tnfiinrenntt and Sy\irm\ Safety 


r. ( . Hang graduated with Eirsi 
Class Honours in electrical en 
ginccrmg from the University ol 
SingajKirc in J‘l7tL He received 
Ihc PhD degree in control 
engineering from Ihe University 
of Warwick, UK. in 1973 From 
1974 to I‘177. he worked uk a 
Computer iind Systems lech' 
nologist in the Shell Eastern 
Petrirlcum ('ompany (Singa|'H»re) 
and the .Shell International Petro 
Icum Company f lTre Hague) Since 1977, he haii txjcn with 
the F^eparimcni of F'leelneal Engineering, National I bit vers- 
ity of Singapore, where he is currently u Profesjtor and Head 
of the Electrical Engineering Department FU* was a Visiting 
Scientist in Yale University and Lund Institute of 
technology in 19M3 and 1987. respectively His current 
research interests include computer prrxcss control, adaptive 
control and expert systems applications 
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jMMHClMiie Hcmci wa& born in 
Tunk, l unifia, on 2H November 
I95() He reecived the diploma in 
aermpace engineering from 
Sup’Adro, France, 1974, ihc M S 
Degree from Stanford University, 
1975, the DcKlcur-Ing^niei^ diph 
oma in Toulouse, France, I97H, 
and the Docteur ds-Sacnecs dipl¬ 
oma from University Paul Saba¬ 
tier, roulouse, France in 1982. 
He joined LAAS in Toulouse in 
1976, and since 1979, he has held u research position at the 
French Research Center (C N.R S.) His main fields of 
interest include system theory, control under constraints, 
optimization and stochastic systems 


FHcv Lee is a Reader in the 
Computer Aided PrcKctw Engi¬ 
neering Group at the [>epartmcn( 
of Chemical Engineering, The 
University of Queensland. He has 
been conducting research in ad- 
sanced prcKcss control for the 
past Jieven years. His primary 
research interests arc in the use of 
mtxlel-bascd control algorithm.s, 
particularly using nonlinear proc¬ 
ess models. Prior to joining the 
department, he worked at ICI Australia Engineering 
designing, installing and commissioning computer-based 
control systems Dr Lee is a member of the Institution of 
Chemical Engineers (U>ndon) 




Ke«m S. HiHiff was born in 
laegu, Korea, in 1957 He 
received the H S degree in 
mechanical design and prmJuction 
engineering from Seoul National 
University, Korea, in 1979 and 
the M.S. degree in mechanical 
engineering from Columbia Uni¬ 
versity in I9H7 He i.s currently 
working for his M S. degree in 
applied mathematics and Ph D 
degree in mechanical engineering 
at the University of Illinois at Urhanii-C'humpaign. From 
1982 to 1985 he was a research engineer at Daewoo Heavy 
Industries, Ltd. Korea, solving vibrational and acoustic 
prohicm.s for diesel engines. His research interests are in 
nonlinear systems theory, control of distrihuicd parameter 
systems, and adaptive control theory. 




l^nardo was born in 

Pe.saro, Italy, on 10 January 1963. 
In 1987 he received the Laurca in 
electronic engineering and in 1989 
he liK)k the Masters degree in 
systems engineering from the 
Universiii3 di Roma "La Sapi- 
cn/.a", where he is currently 
working towards the Ph D. dc 
grec. His current research inter¬ 
ests are in mixlcling and non 
linear control of ncxihle robotic 
structures 



Jiy H. Lrc WHS tK>m in Seoul, 
Korea on 10 March 1965. He 
received a B.S in chemical 
engineering from the University 
of Washington. Seattle in June 
1986 and a Ph.D. from Caltech. 
CA, in 1991, also in chemical 
engineering. Currently, he is an 
Assistant Professor in the 
Department of Chemical Engi¬ 
neering at Auburn University, 


AL He is b member of Tau Bela 
Pi Honor StKiety. His research interests include robust 
inferential control, analysis and control of multi-rate 
samplcd-data systems, control structure selection and 
decentralized cimtrol. 


J. Levine wa> b«m in 1950 m 
Paris, France. He obtained his 
DiKtoral de .3<‘mc cycle and his 
Doctoral d’Elai at the University 
of Paris-Dauphinc in 1976, 1984, 
respectively He is the head of the 
Centre Auloinatique et Sysli^mes 
(Center lor Automatic C’onlrol 
and System Ibeory—previously 
Section Automaiiquc, CAl) ol 
Ecole des Mines dc Pan.s His 
research interests include non¬ 
linear control theory and its applications, nonlincai filicrmg 
and nonlinear identification. 






Daan Li was horn in Shanghai. 
C'hina He graduated from Fudan 
University', Shanghai, China, in 
1977 and received the MI' 
degree in control engineering 
from Shanghai Jiaolong IJnivers- 
ity, Shanghai. ( hina, in 1982. and 
the Ph.D. degree in systems 
engineering From Case Western 
Reserve Universilv, Cleveland. 
Ohm, U S A . in 1987 

From 1977 to 1979 he was an 
the Shanghai Institurc of Instruments 
for Industrial Automation, Shanghai, China. From 1982 to 
198.1 he was on the faculty of Shanghai Jiaolong University 
He has been a faculty member at the University of Virginia, 
Charloilcsvillc, Virginia, If .S.A , since 1987 He is currently 
a Research Assistant Professor m the Department of Systems 
Engineering. His research interests arc large-scale multioh- 
jeetive systems theory, dynamic programming and multiob 
jcciivc control. He has authored and co-auihorcd over 30 
technical paj^ers. He was the guest co-cditor of the S|>ccial 
issue on mulliobjcciive discrete dynamic systems in 
Control—Theory and Advanced Technolof»y 



As.si.siant Engineer in 



Feirr McIhIobIi is the Engineer¬ 
ing and Technology Manager at 
Queensland Alumina Limited, 
Cilad.stone, Queensland, Austra¬ 
lia. His department’s respon¬ 
sibilities include raw material and 
energy efficiencies and process 
control computer applications 
within the plant. 
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Peter M. MMi is |Me«ently the 
Senior Re&eaa'b Eogtneer (ProC' 
css Conirol) wih CRA Advanced 
Tcchniciil Dcvclopmeni in 
Australia He received the B E. 
degree (rcrni the University 
C ollege of Onind Oucenshiml in 
\m) and the M E. (Rcse-arxdi) 
degree from the University of 
Oucensland in From im) 

to 1988 he worked at Queensland 
Alumina, applying conventional 
and advanced control schemes in dustrihuted control system 
environments. 

He is presently working toward the PhD degree at the 
University of Western Australia. His current research 
interests are in nonlinear process control using neural 


Miaafted Monri is a Professor 
and Executive Ofticcr for Chemi^ 
cal Engineering at the California 
Institute of Technology. Me re 
ccivetl his diploma in chemical 
engineering from the Swiss Fede¬ 
ral Institute of Technology in 
1974 and the Ph D degree from 
the University of Minncstita m 
1977 He was on the faculty of the 
University of Wiseiin.sm from 
1977 untii 19H3, when he assumed 
his current position. He also held short-term positions with 
Exxof Research and Engineering, and KT. His interests are 
in the urea of process control and design, in particular rohusi 
and decentralized control and the effect of design on 
operability He is the principal author of the bcHik Rohusi 
Proms i omrol published by PrenticeHall (19K9) Proic.ssor 
Moran has received several academic honors including the 
Donald P Fickman Award of the American Auioniiitic 
C ontrol Council in 19H(); the Allan P Colburn Award of the 
AlChli in 19H4; and the NSF Prcsidenlial Young Investigator 
Award also in 19H4. 


networks 




Edoirdo Moses received the Dr 
Eng degree from the University 
of Rome, Italy, in 1963 and the 
Libera DiKcnza in 1971 From 
1964 to 1968 he was on the 
technical staff of Scicnia S.p.A.. 
Rome. Italy From 1968 to 1972 
he wa,s associated with the Instit¬ 
ute of Science and Technology, 
University of Michigan. Ann 
Arbor, U.S.A. During the acade¬ 
mic year 1971-1972 he was 
Visiting Associate Professor in the Department of Elcciiical 
Engineering, McMaster University, Hamilton, Ontario, 
Canada, and in the Department of Electrical Engineering, 
University of Naples, Naples, Italy From 1972 to 1975, he 
was Associate Professor at the University of Florence, 
Florence, Italy, where, since 1975, he has bwn Professor at 
Ihc chair of System Theory and, from 1980 to 1987 Chairman 
of the Dipartimento di Si&icmi e Informatica, From 1984 to 
1987 he was responsible for coordinating a national research 
project on system and control engineering. He has worked 
on statistical theory of signal detection and processing in 
radio communicaiion and radar, representation of stochastic 
processes, estimation, system identification and adaptive 
control. His current research inlcrcsis are generally in rt^ust 
control and adaptive fdlcring and control. Dr Mosca is a 



member of the IEEE, the Sctentifk CiHUKil of the Itaftan 
Group of Auiomatic and Sysietn Engineering of the National 
Research Council fCNH); the IFAC Technical Committee 
on TTicivry ; and an editor of the tmemMionai Jmtmai of 
AdaptnKt Control nnJ AVgnai Pnwrssmg 


:Kr' 


was born in Flor¬ 
ence. Italy, m 1948. He rcocived 
the Dr degree in Mathematics 
from iImt University of Florence 
in 1972 F-rom 1974 to 1979, he 
was Assistant Professor at the 
University of Calabria, C'oscnra. 
Italy In 1981) he moved to the 
Engineering Faculty of the Uni¬ 
versity of Florence, where, since 
1982. he has been AstuKialc 
Professor in the Systems and 
Informatic's Dcparimeni His mam research interests arc. 
topological methiMis in nonlinear lunclionol analysts, 
dynamical systems ami mathematical contoil theory. 


YrMhfkaga Nkohlhawa was Ixirn in 
Shiga Prefecture. Japan on 18 
March 1933 He received the 
BE, MT^ and ITi I), degrees m 
flcclricul engineering all from 
Kyoto University, in 1955, 1957 
and l%2, rcspcclivciy. Since 
I9fi0, he has been with the 
Department of Electrical Engi¬ 
neering at Kyoto University, 
where he is picscntly Professor in 
charge of the Insirumcnlalion and 
Control Laboratory During the period September 1966 to 
Marcli 19(>H, he was Visiting Assistant Professor of 
Engineering at UCLA, l>os Angeic.s, CA, and was working 
at ilASA in 1976 His prcseni research interests include 
opiimnl/rohusi control, systems optimization, energy systems 
and distrihutcd-aulonomou.s syslem.s including hio/neural 
sysicm.s Dr Nishikawa is a member of several academic 
instiiulcs, and currently he is serving as C'hairman of the 
Working Group on Energy Systems Management and 
FUxinomics, EMSCOM of IFAC 




Gteteppe Oriolo was born in 
Taranto, Italy, on 6 August 1962 
In 19N7 he received the l.4iurea in 
electronic engineering and in I9K9 
he look the Ma.slcrs degree in 
systems engineering from the 
University di Roma ‘‘La Sapi* 
enza”. where he is currently 
working towards the Ph D. de¬ 
gree. His current research inter¬ 
ests arc in trajectory planning and 
motion control of oonvenlioiial 
and redundant robot arms. 
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3^ma0km Perliiigltta obiairird hi» 
Ph D. in lh« Pure Mathemalic^ 
flrpanmcni ttf the l.inivcr<my of 
C'^mhri(f|p;t in IVhtJ and amtinued 
lo work in pure Punctumal 
AnnlyuH until when he 

moved to the C ambridge Umver 
Mly f.nginecnng Department 

Since IMHV he han Iwen a lecturer 
in the SchiHil of Mathemaiicfi ui 
the University (if I.eeds lie has 
written om- h<H)k. an iiitnxluction 
lo Mankel operators, and his currenr research interests 
inc'lude appliciilions funchonal analysis lo systems theory 


No too SatMiowiy was txirn m 
Wakayama City, Jap^n on 23 
Auguat 1939. He graduated fiT>m 
Kyoto Univcrsjiy in Japan in 1%2 
and received the M E, and Ph.D 
degree* in electrical engineering 
from Kyoto Univenuty in 19(i4 
and 1%9, respectively. From I9<S7 
to 19K#>. be was with the I>epart' 
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